Evaluation Engineer - Oakland

Elicit radically increases the amount of good reasoning in the world. · ...

Elicit is an AI research platform that uses language models to help researchers figure out what's true and make better decisions. · ...

Elicit is an AI research platform that uses language models to help researchers figure out what's true and make better decisions. · At Elicit, we're focused on understanding and hill-climbing towards models that help us make better decisions. · Build a comprehensive system that r ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. · The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · ...

About Distyl AI · Distyl AI develops production-grade AI systems to power core operational workflows for Fortune 500 companies. Powered by a strategic partnership with OpenAI, in-house software accelerators, and deep enterprise AI expertise, we deliver working AI systems with ra ...

At Retool, we're on a mission to bring good software to everyone. · We believe that the future of software development lies in abstracting away the tedious and repetitive tasks developers waste time on, · while creating reusable components that act as a force multiplier for futur ...

· About Distyl AI · Distyl AI develops production-grade AI systems to power core operational workflows for Fortune 500 companies. Powered by a strategic partnership with OpenAI, in-house software accelerators, and deep enterprise AI expertise, we deliver working AI systems with ...

About Distyl AI · Distyl is an applied AI technology company partnering with the world's most ambitious institutions to rearchitect critical operations for the frontier of AI. Our customers include the largest companies in telecom, healthcare, insurance, manufacturing, consumer ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · Porti ...

We're on a mission to bring good software to everyone. · We believe that the future of software development lies in abstracting away the tedious and repetitive tasks developers waste time on, · while creating reusable components that act as a force multiplier for future developer ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. · The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · You ...

+Build and maintain infrastructure and tooling for the AI evaluations platform used by internal teams, including automated testing platform for AI voice agents, debugging and observability tools. · +Develop and productionalize evaluation frameworks for individual system component ...

Build and maintain infrastructure and tooling for the AI evaluations platform used by internal teams.Develop and productionalize evaluation frameworks for individual system components such as ASR, LLMs, TTS, knowledge bases. · 5+ years of professional software engineering experie ...

+Join the team bringing advanced autonomy to the built world. · +We're moving AI out of the lab and into the real world. · Our team is composed of industry veterans who helped launch Waymo, scaled Segment to a $3.2B acquisition, and grew Uber Freight to $5B in revenue. · ...

Waymo is looking for a Software Engineer to build the metrics and pipelines that grade its hybrid environment simulator. The ideal candidate will have experience in systems engineering and AI, with proficiency in C++ or Python. · ...

About Anthropic's mission is to create reliable, interpretable and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. · ...

We seek to learn from deployment and broadly distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely.About The RoleIn this role, you'll lead development of the systems we use to evaluate the quality of our AI models and products. · ...

+We are seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. You will curate and build benchmarks for our most advanced AI models. · + · +Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier ...

Meta is seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. As a Research Engineer on ...