- Lead a team of Frontend, Backend, ML, Research, and QA engineers to build dynamic benchmarks and environments. Manage timelines, provide technical guidance, and ensure high‑velocity output across the team.
- Act as a DRI for benchmark and environment delivery, stepping in hands‑on to unblock the team as needed.
- Partner directly with research teams at leading AI labs to turn real‑world failure modes into benchmarks and environments that measurably drive model improvements where it matters most.
- Work closely with researchers at SORL (Patronus AI's Scalable Oversight Research Lab) to help design experimental benchmarks and environments.
- Work closely with the Head of Engineering to drive processes and set the engineering vision across the company.
- BS/MS in Computer Science, Mathematics, Statistics, or another quantitative field.
- Have 2+ years of experience leading engineering teams.
- Demonstrated ability to take ambiguous problems from 0→1 and deliver high‑impact outcomes end‑to‑end.
- Experience with modern UI frameworks like React and web‑oriented programming languages like TypeScript.
- Experience with Python and backend frameworks like FastAPI or Django.
- Experience with relational databases such as PostgreSQL and familiarity with vector databases and columnar databases.
- Experience working and communicating cross‑functionally in a team environment.
- Creativity in problem solving and strong communication skills.
- Have good character, integrity, and respect for others.
- Competitive salary and equity packages.
- Health, dental, and vision insurance plans.
- 401(k) plan.
- Fun global offsites.
-
As a Member of Technical Staff focused on Production Quality, you will own the full-stack development and quality assurance of our production agent systems. · ...
San Francisco2 months ago
-
As a Member of the Technical Staff you will join a team with deep expertise in machine learning optimization data science and software engineering. · Strong skills and professional experience in at least one of:software engineering in a collaborative production environmentapplied ...
San Francisco $110,000 - $400,000 (USD)1 month ago
-
About Kiso · Kiso Technology is a firm based in San Francisco that develops algorithms, models, and software systems to solve complex problems in a variety of domains. Clients range from early-stage startups to some of the largest companies in the world. · About the role · As a M ...
San Francisco $110,000 - $400,000 (USD) per year1 week ago
-
Member of Technical Staff · humans& is a human-centric frontier AI lab. We believe AI can be reimagined, centering around people and their relationships with each other. · We are looking for researchers and engineers who have done exceptional work at the frontier of modern AI. I ...
San Francisco1 week ago
-
We believe AI can be reimagined, centering around people and their relationships with each other. · ...
San Francisco, CA1 month ago
-
As a Member of Technical Staff focused on Production Quality, you will own the full-stack development and quality assurance of our production agent systems. · ...
San Francisco, CA1 month ago
-
Amazon has launched a new research lab in San Francisco to develop foundational capabilities for useful AI agents. We're enabling practical AI to make our customers more productive, empowered, and fulfilled. · In particular, our work combines large language models (LLMs) with rei ...
San Francisco, CA1 month ago
-
We're hiring a member of technical staff to work closely with the founding team. · You'll shape both our products and research direction. ...
San Francisco, CA1 month ago
-
This job is with Amazon to develop foundational capabilities for useful AI agents. · You will contribute directly to AI agent development in an applied research role. · ...
San Francisco, CA1 month ago
-
Nooks is the AI Sales Assistant Platform (ASAP) that automates the busywork so reps can focus on the human part of selling and generate more sales pipeline. · ...
San Francisco1 month ago
-
As a Backend Engineer, you will play a key role in architecting and building backend services, automating workflows, and scaling data infrastructure. · ...
San Francisco $175,000 - $275,000 (USD) Full time1 month ago
-
We're enabling practical AI to make our customers more productive, empowered, and fulfilled. Our work leverages large vision language models (VLMs) with reinforcement learning (RL) and world modeling to solve perception, reasoning, and planning to build useful enterprise agents. ...
San Francisco, CA1 month ago
-
We're looking for our first engineering hire: a Member of Technical Staff who will shape the technical foundation of Contrario. · ...
San Francisco1 month ago
-
The AGI Autonomy Perception team performs applied machine learning research, including model training, dataset design, pre- and post-training. · ...
San Francisco, CA1 month ago
-
Catalog is building the commerce layer for AI - the missing infrastructure that lets agents not just search the web, but understand, reason about, and transact with products. We power the next generation of AI experiences that will reshape how people discover and buy online. · Ro ...
San Francisco1 week ago
-
As a Backend Engineer you will play a key role in architecting and building backend services automating workflows scaling data infrastructure. · ...
San Francisco, CA1 month ago
-
Taste is building the taste layer for AI, teaching models what great feels like across subjective domains such as style, quality and emotion. · Design and build the core backend and data systems that power Taste's product and research platform. · Build backend systems for data in ...
San Francisco1 month ago
-
This role involves architecting and building backend services, automating workflows, · and scaling data infrastructure for a fast-growing company. · ...
San Francisco $175,000 - $275,000 (USD) Full time1 month ago
-
We're hiring a member of technical staff to work closely with the founding team. You'll shape both our products and research direction. · Backend engineering: Design and build scalable infrastructure and systems for AI agents · ...
San Francisco $200,000 - $500,000 (USD) Full time1 month ago
-
Amazon has launched a new research lab in San Francisco to develop foundational capabilities for useful AI agents. · You will contribute directly to AI agent development in an applied research role to improve the multi-model perception and visual-reasoning abilities of our agent. ...
San Francisco $170,000 - $300,000 (USD)1 month ago
-
Job summary · The Amazon AGI SF Lab is focused on developing new foundational capabilities for enabling useful AI agents that can take actions in the digital and physical worlds. · Develop multimodal Large Language Models (LLMs) to observe, model and derive insights from manual w ...
San Francisco1 month ago
Member of Technical Staff - San Francisco - Patronus AI
Description
Member of Technical Staff - Engineering Lead
About Patronus AI, Inc.
Patronus AI is building hyperrealistic, diverse reinforcement learning (RL) environments and benchmarks to steer frontier AI models. Our mission is to enable next generation AGI capabilities through scalable oversight.
We are a team of AI researchers and engineers formerly from companies like Meta AI, Amazon AGI, and Google. As a team, we have published research papers at top ML conferences (NeurIPS, EMNLP, ACL), and we are the creators of popular AI products and benchmarks such as FinanceBench, SimpleSafetyTests, CopyrightCatcher, Humanity's Last Exam, and more. Our customers include foundation model labs and Fortune 500 enterprises like The Volkswagen Group. We are backed by top‑tier investors including Notable Capital, Lightspeed Venture Partners, Stanford University, OpenAI, Databricks, and more.
Responsibilities
As an Engineering Lead at Patronus AI, you will lead a team of engineers and researchers to develop dynamic benchmarks and RL environments to test and train foundation models. As the DRI for these benchmarks and environments, you will work directly with world‑class research teams to ensure quality and delivery.
This is a 0→1 leadership role solving hard problems in simulation design, reward modeling, world data integrity, and task validity. Your work will directly impact the capabilities of frontier models released by leading AI labs.
In this role, you will:
Qualifications
Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.
#J-18808-Ljbffr
-
Member of Technical Staff
Only for registered members San Francisco
-
Member of the Technical Staff
Only for registered members San Francisco
-
Member of the Technical Staff
Only for registered members San Francisco
-
Member of Technical Staff
Only for registered members San Francisco
-
Member of Technical Staff
Only for registered members San Francisco, CA
-
Member of Technical Staff
Only for registered members San Francisco, CA
-
Member of Technical Staff
Only for registered members San Francisco, CA
-
Member of Technical Staff
Only for registered members San Francisco, CA
-
Member of Technical Staff
Only for registered members San Francisco, CA
-
Staff Technical Recruiter
Only for registered members San Francisco
-
Member of Technical Staff
Full time Only for registered members San Francisco
-
Member of Technical Staff
Only for registered members San Francisco, CA
-
Member of Technical Staff
Only for registered members San Francisco
-
Member of Technical Staff
Only for registered members San Francisco, CA
-
Member of Technical Staff
Only for registered members San Francisco
-
Member of Technical Staff
Only for registered members San Francisco, CA
-
Member of Technical Staff
Only for registered members San Francisco
-
Member of Technical Staff
Full time Only for registered members San Francisco
-
Member of Technical Staff
Full time Only for registered members San Francisco
-
Member of Technical Staff
Only for registered members San Francisco
-
Member of Technical Staff
Only for registered members San Francisco