Manager, Agent Evaluation - Washington
2 days ago

Job summary
The Agent Evaluation team is responsible for testing whether AI agents return the correct and expected responses.
We build the framework, metrics, and test cases that validate agent behavior, accuracy, and reliability before release. Our goal is to ensure agents perform consistently and meet product and user expectations.
Job description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
Manager, Agent Evaluation
1 day ago
The Agent Evaluation team is responsible for testing whether AI agents return the correct and expected responses. · Lead and grow a team focused on agent and model evaluation · Define the strategy, roadmap, and standards for agent testing and validation · ...
Manager, Agent Evaluation
1 day ago
The Agent Evaluation team is responsible for testing whether AI agents return the correct and expected responses. We build the framework, metrics, and test cases that validate agent behavior, accuracy, and reliability before release. · ...
Senior ML Engineer
2 weeks ago
Design AI systems for the Company. · ...
Senior ML Engineer
1 month ago
Senior Machine Learning Engineer position at Company in Washington. · Train, evaluate, and deploy ML models in Natural Language Processing. · ...
Senior ML Engineer
6 days ago
Senior Machine Learning Engineer to design and build AI systems for the Company. · ...
GenAI and Machine Learning Architect
2 weeks ago
We are seeking a GenAI & MLOps Engineer / Architect (Azure) to lead the design and implementation of cutting-edge AI solutions. · This role focuses on building Azure-based GenAI applications, including RAG pipelines and sophisticated agentic AI systems. ...
GenAI and Machine Learning Architect
2 weeks ago
Our client is seeking a GenAI & MLOps Engineer / Architect (Azure) to lead the design and implementation of cutting-edge AI solutions. · ...
ML Engineer
1 month ago
+This is an opportunity to join our team as an ML Engineer. The successful candidate will design, prototype, research and build AI systems for the Company. · ...
Azure Al foundry Engineer
2 weeks ago
Job summary · Azure Al foundry Engineer/Developer cum lead with python strong. · Qualifications5-10+ years in software engineering with strong Python (async, typing, packaging, testing) and API development. · ...
Azure AI Developer
23 hours ago
The Client is accelerating adoption of advanced AI capabilities. · Build and enhance AI components that incorporate reasoning, automation, search, and orchestration capabilities. · Design RAG and agentic AI pipelines aligned with emerging enterprise patterns. · Support data model ...
AI Software Engineer – Agents
1 month ago
We are seeking an AI Software Engineer – Agents to build and harden the domain-specific agents that power the Agentic Computational Engineering platform. You will design, implement, and maintain AI agents that behave like focused junior engineers – thermal analysts, supply-chain ...
Azure AI Engineer
2 days ago
The Client is accelerating adoption of advanced AI capabilities including agentic automation retrieval augmented generation model lifecycle improvements and analytics modernization. · ...
Senior Gen AI Developer
1 week ago
The Client is accelerating adoption of advanced AI capabilities · ...
Senior AI Engineer
1 day ago
We are looking for an experienced AI Engineer who specializes in building agents and agentic systems. · 4–7 years of hands-on experience in AI/ML engineering. · Successful deployment of at least two production AI agents in the past 12 months (not prototypes). · ...
AI Engineer IV
1 month ago
We're seeking an AI Engineer IV to join our team developing AI/ML solutions for complex business problems from conception to production. · You'll contribute leadership in guiding solutioning of sophisticated multi-agent systems, · implementing cutting-edge retrieval techniques, · ...
Agentic AI Engineer
1 month ago
This role would build intelligent systems that not only generate novel content and data but also exhibit autonomous decision-making and action-taking capabilities. · ...
Strategic Project Lead
1 month ago
You will own the delivery of secure, agentic AI systems in highly regulated environments, from problem definition through production. · This is a builder role focused on shipping real systems under real constraints: security, compliance, and ambiguity. · ...
Gen AI Architect
1 week ago
+Job summary · A AI Developer con experiencia en modernas fuentes de marco artificial. · +ResponsibilitiesDesign and build "ai-powered" solutions on enterprise-approved cloud platforms. · Create multi-agent pipelines using agentic frameworks (e.g., LangChain). · ...
AI Engineer
3 weeks ago
We are seeking a forward thinking AI Engineer to architect and deploy intelligent systems powered by Large Language Models LLMs Retrieval Augmented Generation RAG and advanced chunking strategies This role is ideal for engineers passionate about building scalable production grade ...
AI Developer
1 month ago
+Design, implement, and operate Retrieval-Augmented Generation (RAG) services using Azure AI/Search. · +Build agentic AI solutions using AutoGen, CrewAI, and/or Agno. · Evaluate and fine-tune open-source models balancing quality latency cost safety. · + ...