Test & Evaluation Engineer (Entry-Level, Associate, and Experienced) - Berkeley

Elicit radically increases the amount of good reasoning in the world. · ...

We need someone to own the technical foundation of our auto-evaluation systems. Our evals are currently much slower than they need to be, and our interfaces aren't optimized for the diverse set of people who need to use them—ML engineers iterating on models, product managers moni ...

Elicit is an AI research platform that uses language models to help researchers figure out what's true and make better decisions. · At Elicit, we're focused on understanding and hill-climbing towards models that help us make better decisions. · Build a comprehensive system that r ...

Elicit is an AI research platform that uses language models to help researchers figure out what's true and make better decisions. · ...

At Retool, we're on a mission to bring good software to everyone. · We believe that the future of software development lies in abstracting away the tedious and repetitive tasks developers waste time on, · while creating reusable components that act as a force multiplier for futur ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. · The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · Porti ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. · The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · You ...

We're on a mission to bring good software to everyone. · We believe that the future of software development lies in abstracting away the tedious and repetitive tasks developers waste time on, · while creating reusable components that act as a force multiplier for future developer ...

Meta is seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. · Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. · ...

+We are seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. You will curate and build benchmarks for our most advanced AI models. · + · +Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier ...

Luma's mission is to build multimodal AI to expand human imagination and capabilities. · Evaluate generative model performance across diverse tasks, prompts, and modalities. · ...

+Job summary · Meta is seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs.+ · +Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development · Develop and implement evaluation envir ...

+Responsibilities: · Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development · Develop and implement evaluation environments, including environments for novel model capabilities and modalities · ...

· ...

We are seeking a candidate to help shape and scale the way we understand, measure and improve model performance. · Evaluate generative model performance across diverse tasks and modalities. · ...

Evaluations are the core of AI progress at MSL determining what capabilities get built which features get prioritized and how fast our models improve. · ...

Build and maintain infrastructure and tooling for the AI evaluations platform used by internal teams.Develop and productionalize evaluation frameworks for individual system components such as ASR, LLMs, TTS, knowledge bases. · 5+ years of professional software engineering experie ...

+Build and maintain infrastructure and tooling for the AI evaluations platform used by internal teams, including automated testing platform for AI voice agents, debugging and observability tools. · +Develop and productionalize evaluation frameworks for individual system component ...

This is where algorithms meet steel-toed boots. You'll collaborate with construction veterans and world-class engineers to solve physical-world problems that simulations can't touch. · Responsibilities · Design and maintain eval systems: Build pipelines for measuring system perfo ...