Manager, Agent Evaluation - Washington

Only for registered members Washington, United States

2 days ago

Default job background
Full time $183,063 - $274,595 (USD)

Job summary

The Agent Evaluation team is responsible for testing whether AI agents return the correct and expected responses.


We build the framework, metrics, and test cases that validate agent behavior, accuracy, and reliability before release. Our goal is to ensure agents perform consistently and meet product and user expectations.


Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.

Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.

Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Get full access

Access all high-level positions and get the job of your dreams.



Similar jobs

  • Only for registered members Washington $183,063 - $274,595 (USD)

    The Agent Evaluation team is responsible for testing whether AI agents return the correct and expected responses. · Lead and grow a team focused on agent and model evaluation · Define the strategy, roadmap, and standards for agent testing and validation · ...

  • Only for registered members Washington, DC

    The Agent Evaluation team is responsible for testing whether AI agents return the correct and expected responses. We build the framework, metrics, and test cases that validate agent behavior, accuracy, and reliability before release. · ...

  • Only for registered members Washington

    Design AI systems for the Company. · ...

  • Only for registered members Washington

    Senior Machine Learning Engineer position at Company in Washington. · Train, evaluate, and deploy ML models in Natural Language Processing. · ...

  • Only for registered members Washington

    Senior Machine Learning Engineer to design and build AI systems for the Company. · ...

  • Only for registered members Washington

    We are seeking a GenAI & MLOps Engineer / Architect (Azure) to lead the design and implementation of cutting-edge AI solutions. · This role focuses on building Azure-based GenAI applications, including RAG pipelines and sophisticated agentic AI systems. ...

  • Only for registered members Washington

    Our client is seeking a GenAI & MLOps Engineer / Architect (Azure) to lead the design and implementation of cutting-edge AI solutions. · ...

  • ML Engineer

    1 month ago

    Only for registered members Washington

    +This is an opportunity to join our team as an ML Engineer. The successful candidate will design, prototype, research and build AI systems for the Company. · ...

  • Only for registered members Washington

    Job summary · Azure Al foundry Engineer/Developer cum lead with python strong. · Qualifications5-10+ years in software engineering with strong Python (async, typing, packaging, testing) and API development. · ...

  • Only for registered members Washington

    The Client is accelerating adoption of advanced AI capabilities. · Build and enhance AI components that incorporate reasoning, automation, search, and orchestration capabilities. · Design RAG and agentic AI pipelines aligned with emerging enterprise patterns. · Support data model ...

  • Only for registered members Washington Full time $120,000 - $180,000 (USD)

    We are seeking an AI Software Engineer – Agents to build and harden the domain-specific agents that power the Agentic Computational Engineering platform. You will design, implement, and maintain AI agents that behave like focused junior engineers – thermal analysts, supply-chain ...

  • Only for registered members Washington

    The Client is accelerating adoption of advanced AI capabilities including agentic automation retrieval augmented generation model lifecycle improvements and analytics modernization. · ...

  • Only for registered members Washington

    The Client is accelerating adoption of advanced AI capabilities · ...

  • Only for registered members Washington, D.C.

    We are looking for an experienced AI Engineer who specializes in building agents and agentic systems. · 4–7 years of hands-on experience in AI/ML engineering. · Successful deployment of at least two production AI agents in the past 12 months (not prototypes). · ...

  • AI Engineer IV

    1 month ago

    Only for registered members Washington

    We're seeking an AI Engineer IV to join our team developing AI/ML solutions for complex business problems from conception to production. · You'll contribute leadership in guiding solutioning of sophisticated multi-agent systems, · implementing cutting-edge retrieval techniques, · ...

  • Only for registered members Washington

    This role would build intelligent systems that not only generate novel content and data but also exhibit autonomous decision-making and action-taking capabilities. · ...

  • Only for registered members Washington

    You will own the delivery of secure, agentic AI systems in highly regulated environments, from problem definition through production. · This is a builder role focused on shipping real systems under real constraints: security, compliance, and ambiguity. · ...

  • Only for registered members Washington

    +Job summary · A AI Developer con experiencia en modernas fuentes de marco artificial. · +ResponsibilitiesDesign and build "ai-powered" solutions on enterprise-approved cloud platforms. · Create multi-agent pipelines using agentic frameworks (e.g., LangChain). · ...

  • AI Engineer

    3 weeks ago

    Only for registered members Washington

    We are seeking a forward thinking AI Engineer to architect and deploy intelligent systems powered by Large Language Models LLMs Retrieval Augmented Generation RAG and advanced chunking strategies This role is ideal for engineers passionate about building scalable production grade ...

  • AI Developer

    1 month ago

    Only for registered members Washington

    +Design, implement, and operate Retrieval-Augmented Generation (RAG) services using Azure AI/Search. · +Build agentic AI solutions using AutoGen, CrewAI, and/or Agno. · Evaluate and fine-tune open-source models balancing quality latency cost safety. · + ...