Sr. Engineering Manager, AI Evaluation Platform - Seattle

We are seeking machine learning platform engineers at multiple levels (Mid-Level to Principal) to architect and build high-availability services and internal tools that enable self-service evaluation at scale. · You will partner with researchers to operationalize their innovatio ...

We are seeking machine learning platform engineers at multiple levels (Mid-Level to Principal) to architect and build high-availability services and internal tools that enable self-service evaluation at scale. · Design, code, and ship high-quality Python services. · Mentor junior ...

+Job summary · Join Apple to make a real impact in the field of AI evaluation · +Design validity frameworks for AI evaluation · Create calibration and bias detection systems for automated evaluators · Build robust statistical tools for practitioners · ...

We are seeking a Measurement Scientist to ensure that our evaluation methods are not just sophisticated, but scientifically valid and trustworthy . In this role, you will apply psychometric theory , validity frameworks, and statistical rigor to establish measurement standards for ...

We're looking for an Applied Scientist to lead the design and continuous development of automated benchmarking methodologies for AI-powered code assistant tools. · ...

We bring everybody in so we can do our best work. Here you'll do more than join something — you'll add something. · Design scientifically grounded benchmarking methodologies for code assistants. · ...

We are seeking an Engineering Manager to build the next generation of AI evaluation systems. You will partner with researchers to operationalize their innovations, transforming complex workflows into intuitive platforms. · You will build and lead the engineering team responsible ...

We are seeking machine learning platform engineers at multiple levels to architect and build high-availability services and internal tools that enable self-service evaluation at scale. ...

+Applied Scientist · Apple is an equal opportunity employer that is committed to inclusion and diversity. · We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, · national origin, disability or ...

We are seeking a hands-on Engineering Manager to architect high-availability services and internal tools that enable self-service evaluation at scale. · We are looking for a leader who thrives in the ambiguity of new initiatives and is passionate about building scalable infrastru ...

We are seeking an experienced on-device machine learning engineer to join our team building privacy-preserving technologies for measurement and machine learning. · In this role you will: Collaborate with other engineers to design and develop end to end measurement systems with h ...

As a Cloud Developer Relations Engineer, you stand at the intersection of a technology movement shaping our world - between the people who build it and the customers who use it. · ...

As a Cloud Developer Relations Engineer you stand at the intersection of a technology movement shaping our world - between the people who build it and the customers who use it. The Cloud Platform Evaluations Team aims to drive Google Cloud adoption by identifying and advocating i ...

As a Cloud Developer Relations Engineer, you stand at the intersection of a technology movement shaping our world - between the people who build it and the customers who use it. · ...

We are seeking a driven and analytical Software Engineer to join Apple's Generative AI Evaluations team. · In this role, you will help define how we measure, monitor, and improve the performance of AI systems that power next-generation user experiences. · ...

The UberAgentPlatform team is building the platform for AIs that run parts of the businessWe are looking for a strong Software Engineer to be a part of a high-velocityhigh-impact team at the intersection of AI fundamentalsAI infrastructurewith an emphasis on systems designThis in ...

The Uber Agent Platform team is building the platform for AI agents that run parts of the business. · We are looking for a strong Senior Software Engineer to be a part of a high-velocity, high-impact team at the intersection of AI fundamentals, · AI infrastructure with an emphasi ...

Participate in platform definition, architecture evaluation, and analysis for existing and next-generation Cloud AI platforms. Evaluate system architectures, proposed implementations, and scaling and optimization strategies. · Evaluate system architectures, proposed implementatio ...

We are looking for a Software Engineer to design and implement core platform capabilities for AI/ML and AI Agents in SingleStore Cloud. · You'll work on services that enable model/tool orchestration (e.g. MCP style tool discovery and execution), agent workflows, retrieval pipelin ...

Working at Atlassian · Atlassians have flexibility in where they work – whether in an office, from home, or a combination of the two. · ...