AI Evaluation Engineer - New York, NY

Only for registered members New York, NY, United States

2 weeks ago

Default job background
$90,000 - $170,000 (USD) per year *
* This salary range is an estimation made by beBee
About Distyl AI · Distyl AI develops production-grade AI systems to power core operational workflows for Fortune 500 companies. Powered by a strategic partnership with OpenAI, in-house software accelerators, and deep enterprise AI expertise, we deliver working AI systems with rap ...
Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.

Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.

Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Get full access

Access all high-level positions and get the job of your dreams.



Similar jobs

  • Work in company

    Evaluations - Platform Engineer

    Only for registered members

    +Job summary · We're looking for a Platform Engineer to define and operationalize quality for agentic systems that power Antimetal's investigation and automation engine. · +QualificationsPrior experience designing evaluation systems where ground truth is noisy, high-volume, and h ...

    New York Full time

    1 month ago

  • Work in company

    Senior Platform Engineer, Evaluations

    Only for registered members

    This is a zero to one opportunity to build the evaluation stack: pipelines, metrics, tooling, and infrastructure from scratch, and shape how teams across platform, product, and research iterate confidently. · ...

    New York

    1 month ago

  • Work in company

    Research Engineer, Model Evaluations

    Only for registered members

    We want AI to be safe and beneficial for our users and for society as a whole.Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. · Design novel evaluation methodologies to ...

    New York $300,000 - $405,000 (USD)

    1 month ago

  • Work in company Remote job

    Software Engineer, Evaluation Frontend

    Only for registered members

    We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, · semantic search,RAG,and agents. · ...

    New York, NY

    2 weeks ago

  • Work in company Remote job

    Senior Research Engineer, Model Evaluation

    Only for registered members

    We are scaling intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. · ...

    New York, NY

    3 weeks ago

  • Work in company

    Senior Software Engineer, AI Evaluation Infra

    Only for registered members

    We are looking for a Senior Infrastructure Engineer (5-10yrs experience) to bridge the gap between internal developer velocity and global product delivery by owning the entire Commit-to-Compute lifecycle.You will build the high-performance CI/CD pipelines and self-service tooling ...

    New York

    1 month ago

  • Work in company

    Staff Machine Learning Engineer – VLM/LLM Evaluation

    Only for registered members

    We are looking for a Staff Machine Learning Engineer to join our Waymo AI Foundations team. · ...

    New York

    1 month ago

  • Work in company

    Senior Machine Learning Engineer – VLM/LLM Evaluation

    Only for registered members

    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver—to improve access to mobili ...

    New York, NY

    1 week ago

  • In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include: · Health, dental, vision, life, disability insurance · Retirement Benefits: 401(k) with company ...

    New York $183,000 - $271,000 (USD)

    5 days ago

  • In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include: · Health, dental, vision, life, disability insurance · Retirement Benefits: 401(k) with company ...

    New York, NY

    4 days ago

  • Work in company

    AI Evaluation

    Only for registered members

    We are looking for AI Evaluation & Data Engineering Specialists to design curate and operationalize datasets and evaluation frameworks for AI product performance assessment.This role involves working with large language models LLMs human raters and automation tools to measure mod ...

    New York

    2 months ago

  • Work in company

    Senior Machine Learning Engineer

    Only for registered members

    This Series A startup is pioneering a new category in AI-native infrastructure automation.Their platform doesn't just surface dashboards, · it actively investigates, · reasons over, · and automates responses across production systems, · giving engineers time back to build rather ...

    New York

    2 weeks ago

  • Work in company

    Research Scientist Manager, AI Assistant Measurement

    Only for registered members

    Meta Superintelligence Labs is seeking a Research Scientist Manager to lead a high-impact team working on the next generation of AI Assistants powered by frontier-scale foundation models. · ...

    New York $219,000 - $301,000 (USD) Full time

    1 month ago

  • Work in company

    Director of Engineering

    Only for registered members

    We're looking for a Director of Engineering to lead our AI Agent Evaluation and Experimentation Platform team.You'll own the end-to-end evaluation and experimentation lifecycle for both agentic systems and traditional ML models. · ...

    New York

    3 weeks ago

  • Work in company

    Research Engineer, CBRN

    Only for registered members

    This role is for a Research Engineer focusing on Chemical, Biological, Radiological and Nuclear (CBRN) AI Responsibility at Google DeepMind. · We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensur ...

    New York $166,000 - $244,000 (USD)

    1 month ago

  • Work in company

    Artificial Intelligence Engineer

    Only for registered members

    We're Hiring: AI/ML Engineer (TAIRC | Remote) · About TAIRC · The AI Research Center (TAIRC) is a nonprofit organization dedicated to advancing trustworthy, safe, · and beneficial artificial intelligence.Through foundational and applied research, · TAGIC develops AI systems, gove ...

    New York

    3 weeks ago

  • Work in company

    Senior Structural Engineer

    Only for registered members

    A respected, multidisciplinary engineering consultancy in New York City is seeking an experienced Senior Structural Engineer (PE Licensed in NY) to join their established Existing Buildings group. This role is ideal for an engineer who thrives on solving complex problems in the b ...

    New York $65,000 - $120,000 (USD) per year

    1 week ago

  • Work in company

    Machine Learning Manager, Gen AI Frameworks Team

    Only for registered members

    Job summary · In this role you will shape the technical foundations that dozens of product and research teams rely on every day, while building and growing a high-performing engineering team that operates at the intersection of infrastructure applied ML developer experience. · ...

    New York Full time

    3 weeks ago

  • Work in company

    Senior Energy Project Engineer

    Only for registered members

    ALTANOVA is now actively hiring a Senior Energy Project Engineer for a full-time position in our New York office. Alternatively located in our Paris, France office or remotely (GMT-5) for highly qualified individuals. · About Altanova · Altanova is a leading multidisciplinary con ...

    New York

    1 week ago

  • Work in company

    Mechanical Engineer

    Only for registered members

    This hourly remote contractor role involves reviewing AI-generated engineering solutions and generating expert Mechanical Engineering content. · Create detailed prompts in various topics to guide AI learning. · Evaluate and rank AI responses to enhance model accuracy. · ...

    New York

    1 month ago