Qualitative Evaluation Engineer - Palo Alto

We are seeking a candidate to help shape and scale the way we understand, measure and improve model performance. · Evaluate generative model performance across diverse tasks and modalities. · ...

+We are seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. You will curate and build benchmarks for our most advanced AI models. · + · +Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier ...

+Job summary · Meta is seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs.+ · +Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development · Develop and implement evaluation envir ...

Meta is seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. · Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. · ...

Evaluations are the core of AI progress at MSL determining what capabilities get built which features get prioritized and how fast our models improve. · ...

+Responsibilities: · Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development · Develop and implement evaluation environments, including environments for novel model capabilities and modalities · ...

· ...

We are currently seeking a security-focused Embedded Systems Engineer/Evaluator for our Electrical Engineering and Computer Science Practice in Menlo Park, CA. · We will work as part of a team to test and troubleshoot secure identity credentials and other security peripherals suc ...

We are currently seeking a security-focused Embedded Systems Engineer/Evaluator for our Electrical Engineering and Computer Science Practice in Menlo Park, CA. · ...

The GenAI Model Evaluation team is the main line of defense in ensuring customer safety.We are looking for an experienced fullstack developer to take ownership of the tooling we use to determine the best model for release. · Create, maintain and expand internal tools for evaluati ...

We are looking for an experienced Senior AI Data and Validation Engineer to maintain the safety, effectiveness, · & quality of AI-enabled medical devices throughout their product lifecycle.The engineer will contribute to design, · & execution of validation studies ensuring device ...

+Responsable por realizar experimentos en laboratorio secundario para la adquisición de datos. +Desarrolla directrices de etiquetado y prepara los datos para el desarrollo del modelo AI. +Contribuye al diseño, ejecución y análisis de estudios de validación., +Se enfoca en práctic ...

We are looking for experienced data-minded software engineers to help us understand and improve the reliability of Waymo's robotics systems so we can further improve Waymo's safety-first mission. · Develop signals that are precursors to severe reliability issues · Root cause subt ...

We are looking for experienced data-minded software engineers to help us understand and improve the reliability of Waymo's robotics systems so we can further improve Waymo's safety-first mission. ...

Elicit radically increases the amount of good reasoning in the world. · ...

We need someone to own the technical foundation of our auto-evaluation systems. Our evals are currently much slower than they need to be, and our interfaces aren't optimized for the diverse set of people who need to use them—ML engineers iterating on models, product managers moni ...

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. · Implement Evaluation Metri ...

+Job summary · The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. · +ResponsibilitiesDevelop signals to measure the performance and driving qualities of the Waymo driver, u ...

Elicit is an AI research platform that uses language models to help researchers figure out what's true and make better decisions. · ...

We are looking for an experienced and highly skilled Senior AI Data and Validation Engineer responsible for dry and wet lab experiments for AI functionality acquiring datasets, developing labeling guidelines, preparing dataset for AI model development. The engineer will contribut ...