LLM Evaluation Engineering Lead - Redwood City
1 month ago

Job summary
We're partnering with a deep-tech AI company building autonomous agentic systems for complex physical and real-world environments. The team operates at the edge of what's possible today designing AI systems that plan act recover and improve over long horizons in high-stakes settings.Responsibilities
- Build eval harnesses for agentic LLM systems offline + in-workflow
- Design evals for planning execution recovery and safety
- Implement verifier-driven scoring regression gates
- Turn eval failures into training signals SFT DPO RL
Job description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
Lead Software Engineer
1 month ago
C3 AI is looking for a highly skilled and experienced lead software engineer to join their Generative AI team. · Work across teams to architect robust software engineering solutions. · Implement and enhance engineering best practices company wide. · Build systems and tools to ena ...
Lead Software Engineer
1 month ago
Hadron Energy busca un Lider Técnico de Desarrollo de Software basado en San Francisco Bay Area para diseñar e implementar la infraestructura digital requerida para desarrollar reatores nucleares avanzados. · ...
Lead Software Engineer
1 month ago
This Lead Software Engineer will work closely with our cross-functional team including reactor physics thermal-hydraulics and digital I&C engineers to architect build and manage the company's core engineering software ecosystem. · This role spans high-performance computing HPC fo ...
Lead Backend Engineer
1 month ago
We're a stealth-mode startup reimagining how modern enterprises secure and manage their endpoints. Our mission is to build an AI-native platform that delivers autonomous control, deep observability, and resilient device operations. · ...
Support Engineering Lead
1 month ago
Retell AI is using the first principles to reimagine the call center with cutting edge voice AI. · ...
Lead Hardware Engineer
3 days ago
We are delivering technologies to enable the long-range,wireless transfer of power. · Lead a team of electrical and mechanical engineers. · Actively drive the team to analyze and design our system. · ...
Lead Backend Engineer
3 days ago
We believe consumers and businesses can coexist. Our platform allows consumers to access savings tools, earned wages and rewards without cost or hidden fees. · 6+ years of experience building and owning backend systems in production environments · Strong experience designing APIs ...
Lead Server Engineer
3 days ago
We put our players first, and we're looking for the most talented and creative game developers in the world to help us become the world's #1 mobile gaming company. · ...
Lead Backend Engineer
1 month ago
Built for consumers and companies alike in a world driven by data, Attain empowers consumers to leverage their greatest asset-their data-in exchange for modern financial services. · ...
Support Engineering Lead
4 weeks ago
We're scaling fast, and we're looking for bold, ambitious people to help us build the gold standard for voice automation. · ...
Lead iOS Engineer
3 days ago
+Job summary · As a Lead iOS Engineer, you will be joining the recently acquired UnifyID team at Prove. · +Bachelor's degree in computer science or related field/experience preferred,5+ years of professional software development experience preferably in a fast-paced environment/l ...
Lead Android Engineer
3 days ago
We are looking for a seasoned software engineer with deep experience on Android to join our A+ technical team in designing and building innovative mobile solutions to our customers. · ...
Lead DevOps Engineer
3 days ago
We are looking for a self-starting professional who thrives in a fast-paced environment to join our team as a DevOps engineer. · A general idea and interest on how complex computer systems are orchestrated on AWS and Azure Cloud. · A subset of Docker experience required. · ...
Support Engineering Lead
3 weeks ago
Retell AI is using first principles to reimagine the call center with cutting-edge voice AI. We're scaling fast and looking for bold, ambitious people to help us build the gold standard for voice automation. · ...
Lead Hardware Engineer
1 month ago
We are seeking a talented and motivated Sr/ Principal Hardware Engineer to join our team full-time at our Bay Area facility.This is an on-site position offering hands-on experience with cutting-edge medical device technology. · ...
Senior/Lead Software Engineer
1 month ago
C3 AI is seeking a full-stack Senior / Lead Software Engineer to join the Developer Experience team. · Lead efforts to define and enforce engineering standards, code quality, and best practices across engineering teams. · Design and build tools and frameworks that improve develop ...
Senior/Lead Software Engineer
1 month ago
C3 AI is seeking a full-stack Senior / Lead Software Engineer to join the Developer Experience team. · ...
Lead Machine Learning Engineer
1 month ago
We are looking for exceptional creative and passionate Lead Machine Learning engineers to join our ML and Big Data Team. · ...
Lead Machine Learning Engineer
1 month ago
Our mission is to build a world-class big data platform to bring value out of data for us and for our customers.We are looking for exceptional creative and passionate Lead Machine Learning engineers to join our ML and Big Data Team. · ...
Senior/Lead Software Engineer
1 week ago
C3 AI seeks a full-stack Senior/Lead Software Engineer to drive engineering excellence across the organization. · ...
Lead Machine Learning Engineer
3 days ago
We are immediately hiring a results-oriented Lead Machine Learning Engineer to join our growing team in Redwood City, CA on a hybrid schedule. · We'd Love for You to Have: Quantitative BS or MS degree (e.g., Physics, Statistics, Mathematics, Economics, or Computer Science) and 4+ ...