- Design and productionize state of the art tooling and open source technologies to enable the development of frontier foundation models for Databricks customers
- Solve complex problems at scale around data preprocessing, model training, hyperparameter tuning and model evaluation
- Implement advanced optimization techniques to reduce the resource footprint of models while preserving their performance and balancing usability for our developers and customers
- Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps
- Facilitate our user community through documentation, talks, tutorials, and collaborations
- Contribute to the broader AI community by publishing research, presenting at conferences, and actively participating in open-source projects, enhancing Databricks' reputation as an industry leader.
- Below are some example projects:
- Composer: Large-scale distributed deep learning training library
- Streaming: Library for efficient data loading from cloud object storage
- LLM Foundry: Framework for developing and evaluating Large Language Models
- Hands on experience with the internals of deep learning frameworks (e.g. PyTorch, TensorFlow) and GenAI models (e.g. GPT, StableDiffusion)
- Experience with large scale, distributed training on GPUs (e.g., Nvidia, AMD) and alternative deep learning accelerators
- Strong sense of design and usability
- Effective communication skills and the ability to articulate complex technical ideas to cross-disciplinary internal and external stakeholders
- Prior history of contributing to or developing open source projects is a bonus but not a requirement
-
Runtime Engineer
2 days ago
Oven San Francisco, United StatesJob Description · Job DescriptionOven is on a mission to make JavaScript faster and simpler. That's why we launched Bun, a fast all-in-one JavaScript runtime, bundler, and package manager. We're looking for people to help us build the future of JavaScript and infrastructure on th ...
-
Runtime Engineer Zig or CC
2 hours ago
Oven San Francisco, United StatesOven is on a mission to make JavaScript faster and simpler. That's why we launched Bun, a fast all-in-one JavaScript runtime, bundler, and package manager. We're looking for people to help us build the future of JavaScript and infrastructure on the Internet. · Position · Bun is w ...
-
Omega Venture Partners San Francisco, CA, United StatesAbout the Team · The Platform Runtime team builds core components to enable productive research from small to state of the art scale across OpenAI, with the goal of accelerating progress towards AGI. We frequently collaborate with other teams to speed up the development of new s ...
-
Principal Engineer, Runtime
1 week ago
SambaNova Systems Palo Alto, United States Full time· The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. · SambaNova Sui ...
-
Databricks San Francisco, United StatesDiscoverCustomersPartners · Databricks PlatformIntegrations and DataPricingOpen Source · Databricks for IndustriesCross Industry SolutionsMigration & DeploymentSolution Accelerators · Training and CertificationEventsBlog and PodcastsGet HelpDive Deep · CompanyCareersPressSecurity ...
-
GenAI Staff Machine Learning Engineer, AI Runtime
11 hours ago
Databricks San Francisco, United StatesP-984 · Founded in late 2020 by a small group of machine learning engineers and researchers, MosaicML enables companies to securely fine-tune, train and deploy custom AI models on their own data, for maximum security and control. Compatible with all major cloud providers, the Mos ...
-
Senior Principal Engineer, Runtime
1 day ago
SambaNova Systems Palo Alto, United States Full time· The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. · SambaNova Sui ...
-
Senior Software Engineer, Runtime
1 day ago
SambaNova Systems Palo Alto, CA, United StatesThe era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. · SambaNova Suite ...
-
Principal engineer
1 day ago
Bayone San Francisco, United StatesThe position is for Principal engineer Level reporting into me. I am looking for a hands on engineer who has deep understanding of building E2E Cloud Platform. · The candidate should be an expert in · Cloud Foundations ( IAM, Networking) · Runtime Platforms ( Kubernetes, Serverl ...
-
Manager, Software Engineering
2 days ago
Viant Technology San Francisco, CA, United StatesIrvine, CA / Los Angeles, CA / Seattle, Washington / San Francisco, CATechnology & Development – Engineering /Full-time /HybridWHAT YOU'LL DOYou will directly manage a team of engineers that work with Viant's ad server, managing a high-volume, low-latency application that process ...
-
Principal Software Engineer
2 days ago
Viant Technology San Francisco, CA, United StatesIrvine, CA / Los Angeles, CA / Seattle, Washington / San Francisco, CATechnology & Development – Engineering /Full-time /HybridWHAT YOU'LL DOYou will serve as the technical lead working with a team of engineers on Viant's ad server, managing a high-volume, low-latency application ...
-
Software Engineer
2 days ago
Oven San Francisco, United States Part timeOven is on a mission to make JavaScript faster and simpler. That's why we launched Bun, a fast all-in-one JavaScript runtime, bundler, and package manager. We're looking for people to help us build the future of JavaScript and infrastructure on the Internet. · Position · Bun is ...
-
Engineering Manager
2 days ago
Knewin San Francisco, CA, United StatesYou will directly manage a team of engineers that work with Viant's ad server, managing a high-volume, low-latency application that processes billions of unique requests a day. Primarily supporting Viant's Demand Side Platform, VIANT DSP, you will collaborate with stakeholders in ...
-
Salesforce San Francisco, United StatesTo get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job CategoryProductJob DetailsAbout SalesforceWe're Salesforce, the Customer Company, inspiring the future of business with AI+ Data ...
-
Signaling Engineer
18 hours ago
PGH Wong Engineering San Francisco, United StatesJob Description · Job Description Salary: $124,800 - $170,000 · PGH Wong Engineering, Inc. has a proud and lengthy history of delivering innovative, challenging, and complex projects. PGH Wong was established in 1985 on its extraordinary foundation in systems engineering and is ...
-
Senior Train Control Engineer
1 day ago
PGH Wong Engineering San Francisco, United StatesPGH Wong Engineering, Inc. has a proud and lengthy history of delivering innovative, challenging, and complex projects. PGH Wong was established in 1985 on its extraordinary foundation in systems engineering and is now a full-service engineering, architecture, construction manage ...
-
Salesforce San Francisco, United StatesTo get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job CategoryProductJob DetailsAbout SalesforceWere Salesforce, the Customer Company, inspiring the future of business with AI+ Data + ...
-
Sr. Product Manager, Environments
1 day ago
Databricks San Francisco, CA, United StatesRDQ325R14 · At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data ...
-
Engineering Manager
2 days ago
DataBricks San Francisco, CA, United StatesP-931Founded in late 2020 by a small group of machine learning engineers and researchers, MosaicML enables companies to securely fine-tune, train and deploy custom AI models on their own data, for maximum security and control. Compatible with all major cloud providers, the Mosaic ...
-
Software Engineer V
4 days ago
Tailored Management San Francisco, United StatesJob Description: Software Engineering - InfrastructureLocation: Remote (US)Duration: 12 Months · We are looking for an experienced Software Engineer to join the Software Engineering (Infrastructure) team. The Software Engineering (Infrastructure) team builds large, distributed c ...
GenAI Staff Machine Learning Engineer, AI Runtime - San Francisco, United States - Databricks
Description
P-984
Founded in late 2020 by a small group of machine learning engineers and researchers, MosaicML enables companies to securely fine-tune, train and deploy custom AI models on their own data, for maximum security and control. Compatible with all major cloud providers, the MosaicML platform provides maximum flexibility for AI development. Introduced in 2023, MosaicML's pretrained transformer models have established a new standard for open source, commercially usable LLMs and have been downloaded over 3 million times. MosaicML is committed to the belief that a company's AI models are just as valuable as any other core IP, and that high-quality AI models should be available to all.
Now part of Databricks since July 2023, we are passionate about enabling our customers to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI platform so our customers can use deep data insights to improve their business. We leap at every opportunity to solve technical challenges, striving to empower our customers with the best data and AI capabilities.
You will:
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents base salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks utilizes the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.
Local Pay Range
$192,000-$260,000 USD
About Databricks
Databricks is the data and AI company. More than 10,000 organizations worldwide - including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.
Our Commitment to Diversity and Inclusion
At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.
Compliance
If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
GenAI Staff Machine Learning Engineer, AI Runtime professionals in San Francisco
-
Kineret Stanley
Data Scientist (ex-Apple, ex-Google)