Evaluation Engineer - Oakland

Elicit is an AI research platform that uses language models to help researchers figure out what's true and make better decisions. · At Elicit, we're focused on understanding and hill-climbing towards models that help us make better decisions. · Build a comprehensive system that r ...

We need someone to own the technical foundation of our auto-evaluation systems. Our evals are currently much slower than they need to be, and our interfaces aren't optimized for the diverse set of people who need to use them—ML engineers iterating on models, product managers moni ...

Elicit is an AI research platform that uses language models to help researchers figure out what's true and make better decisions. · ...

At Retool, we're on a mission to bring good software to everyone. · We believe that the future of software development lies in abstracting away the tedious and repetitive tasks developers waste time on, · while creating reusable components that act as a force multiplier for futur ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. · The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · ...

We're on a mission to bring good software to everyone. · We believe that the future of software development lies in abstracting away the tedious and repetitive tasks developers waste time on, · while creating reusable components that act as a force multiplier for future developer ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · Porti ...

We are looking for engineers to join us on a 6-month contract (with the possibility of extension) our Engineering Team. · The primary work is split between engineering work to port external benchmarks to run on internal infrastructure and developing novel model evaluations. · You ...

+Job summary · Join our team bringing advanced autonomy to the built world. · We're deploying autonomous systems on heavy construction machinery across the country, · accelerating project schedules of billion-dollar infrastructure projects and improving safety on job sites. · ++W ...

About Anthropic's mission is to create reliable, interpretable and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. · ...

Waymo is looking for a Software Engineer to build the metrics and pipelines that grade its hybrid environment simulator. The ideal candidate will have experience in systems engineering and AI, with proficiency in C++ or Python. · ...

We seek to learn from deployment and broadly distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely.About The RoleIn this role, you'll lead development of the systems we use to evaluate the quality of our AI models and products. · ...

This is where algorithms meet steel-toed boots. You'll collaborate with construction veterans and world-class engineers to solve physical-world problems that simulations can't touch. · Responsibilities · Design and maintain eval systems: Build pipelines for measuring system perfo ...

Build and maintain infrastructure and tooling for the AI evaluations platform used by internal teams.Develop and productionalize evaluation frameworks for individual system components such as ASR, LLMs, TTS, knowledge bases. · 5+ years of professional software engineering experie ...

Bedrock is bringing autonomy to the construction industry We're a group of veterans from the autonomous vehicle industry who are passionate about bringing the benefits of automation to areas in the construction industry currently underserved by the market. · We're looking for a h ...

We're looking for a highly motivated engineer with experience evaluating complex ML systems deployed in the real world · Translate the infinite nuance of the built world into actionable, AI-native evaluations that accelerate Bedrock Operator adoption.The ideal candidate has hands ...

+We are seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. You will curate and build benchmarks for our most advanced AI models. · + · +Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier ...

We are looking for an experienced metrics engineer to join our Data Insights team. · The successful candidate will have a strong background in quantitative fields such as computer science or mathematics. · Responsibilities include architecting new analytics data collection,workin ...

About The Team · The Applied AI team works across research, engineering, product, and design to bring OpenAI's technology to the world. · ...