ML Compiler Engineer II - New York

Only for registered members New York, United States

1 day ago

Default job background
$158,100 - $213,800 (USD)
The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. · This stack is designed to optimize application models across diverse domains, including Large Language and Vision, orig ...
Job description


The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack.

This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX.

Your role will involve working closely with our custom-built Machine Learning accelerators, including Inferentia/Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.

Key job responsibilities


As a ML Compiler Engineer II on the Neuron Compiler Automated Reasoning Group, you will develop and maintain tooling for best-in-class technology for raising the bar of the Neuron Compiler's accuracy and reliability.

You will help lead the efforts building fuzzers and specification synthesis tooling for our LLVM-based compiler.

You will work in a team with a science focus, and strive to push what we do to the edge of what is known, to best deliver our customers.

Strong software development skills using C++/Python are critical to this role.

A science background in compiler development is strongly preferred. A background in Machine Learning and AI accelerators is preferred, but not required.


In order to be considered for this role, candidates must be currently located or willing to relocate to Seattle (Preferred), Cupertino, Austin, or Toronto.

Basic Qualifications

3+ years of non-internship professional software development experience
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience programming with at least one software programming language

Preferred Qualifications

3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent


Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers.

If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information.

If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location.

Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.

Learn more about our benefits at

USA, NY, New York - 158, ,800.00 USD annually

Company - Annapurna Labs (U.S.) Inc.


Job ID:
A3186261


Similar jobs

  • Work in company

    Software Engineer, AI Compiler

    Only for registered members

    We're building an AI accelerator from the ground up, and we need a strong ML compiler engineer to be at the heart of hardware-software co-design. · This isn't about inheriting a mature compiler stack - it's about creating one. You'll join at the architecture definition stage, dir ...

    New York City

    3 days ago

  • Work in company

    ML Compiler Engineer II

    Only for registered members

    The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, origin ...

    New York $158,100 - $213,800 (USD) Full time

    1 day ago

  • Work in company

    Software Engineer, AI Compiler

    Only for registered members

    We're building an AI accelerator from the ground up and need a strong ML compiler engineer to be at the heart of hardware-software co-design. · li>Work across the full stack with software systems and hardware teams to ensure correctness performance and deployment readiness for re ...

    New York, NY

    3 days ago

  • Work in company

    ML Compiler Engineer, Compute

    Only for registered members

    We deliver the compute platform responsible for running the autonomous vehicle's software stack. · ...

    New York

    4 weeks ago

  • Work in company

    Senior Software Engineer, Compiler

    Only for registered members

    Job summary · We are looking for an exceptional compiler engineer to work on challenging greenfield projects that accelerate bytecode execution. · ...

    New York Full time

    1 month ago

  • Work in company

    Software Engineer, AI Compiler

    Only for registered members

    We re building an AI accelerator from the ground up and we need a strong ML compiler engineer to be at the heart of hardware software co design This isn t about inheriting a mature compiler stack it s about creating one · ...

    New York $190,000 - $215,000 (USD) Full time

    4 days ago

  • Work in company

    ML Compiler Engineer, Compute

    Only for registered members

    Waymo is an autonomous driving technology company. We deliver the compute platform responsible for running the autonomous vehicle s software stack. ...

    New York, NY

    4 weeks ago

  • Work in company

    Machine Learning Compiler Engineer

    Only for registered members

    As a Qualcomm Machine Learning Engineer, you will create and implement machine learning techniques, frameworks, · Bachelor's degree in Computer Science, Engineering, Information Systems or related field. · ...

    New York, NY

    2 weeks ago

  • Work in company

    Software Engineer

    Only for registered members

    About us FriendliAI is building an AI inference platform · The RoleWe seek Inference Engine Engineer to optimize our core inference engine. · ...

    New York

    3 weeks ago

  • Work in company

    Software Engineer, Systems ML

    Only for registered members

    You will be a member of the MTIA (Meta Training & Inference Accelerator) Software team and part of the bigger industry-leading PyTorch AI framework organization. · You will be working on one of the core areas such as PyTorch framework components, AI compiler and runtime, high-per ...

    New York Full time

    1 month ago

  • Work in company

    Tools and Compilers Research and Development

    Only for registered members

    +We are excited to announce research internships in our Tools and Compilers group. · +Type systems that track locality and uniquenessSuperoptimizationCompiler testing and validation ...

    New York Internship

    1 month ago

  • Work in company

    Software Engineer, Infra PyTorch

    Only for registered members

    This role is about developing the core PyTorch 2.0 technologies. · We are committed to building the PT2 compiler that withstands the test of time while striving to become the #1 ML framework compiler in the industry,Responsibilities:Develop the PT2 compiler (e.g., TorchDynamo, To ...

    New York $58.65 - $181,000 (USD)

    1 week ago

  • Work in company

    Software Engineer, Systems ML

    Only for registered members

    In this role, you will be a member of the MTIA (Meta Training & Inference Accelerator) Software team and part of the bigger industry-leading PyTorch AI framework organization. MTIA Software Team has been developing a comprehensive AI Compiler strategy that delivers a highly flexi ...

    New York $58.65 - $181,000 (USD)

    1 day ago

  • Work in company

    Research Engineer

    Only for registered members

    Aquatic Capital Management is seeking a Research Engineer to join our research team.Your work will blend software engineering and quantitative research, focusing on designing high-performance tooling and infrastructure that accelerate the development of machine learning models us ...

    New York

    2 weeks ago

  • Work in company

    Engineering Manager, SDKs

    Only for registered members

    About Fern · Fern helps software companies build a world-class API experience. Our customers include industry leaders like Nvidia, Square, and Twilio, as well as fast-growing AI companies like ElevenLabs and OpenRouter. · In the next year, the majority of API integrations will be ...

    New York Full time

    1 day ago

  • Work in company

    Software Engineer, Systems ML

    Only for registered members

    As part of the MTIA Software team and part of the bigger industry-leading PyTorch AI framework organization you will develop software stack with one of the core focus areas: AI frameworks compiler stack high performance kernel development and acceleration onto next generation har ...

    New York, NY

    1 week ago

  • Work in company

    Full Stack Engineer

    Only for registered members

    We are building our greenfield backend platform from scratch—scaling build orchestration, secure artifact distribution, and performance analytics. · Build responsive web apps (React,, TypeScript) for developers and enterprise users. · Design & optimize APIs and backend services,, ...

    New York

    1 week ago

  • Work in company

    Tools and Compilers Research and Development

    Only for registered members

    We are excited to announce research internships in our Tools and Compilers group. · We're looking for PhD and masters students with outstanding research experience in programming languages, compilers, verification, and related areas.Type systems that track locality and uniquenes ...

    New York, New York, United States

    1 week ago

  • Work in company

    Tools and Compilers Research and Development

    Only for registered members

    We are excited to announce research internships in our Tools and Compilers group. We're looking for PhD and masters students with outstanding research experience in programming languages, compilers verification related areas. ...

    New York, New York, United States

    1 week ago

  • Work in company

    Software Engineer, Infra PyTorch

    Only for registered members

    This role involves developing the core PyTorch 2.0 technologies and innovating ML compilers. The team is dedicated to making PyTorch run faster and more resource-efficient without sacrificing its flexibility and ease of use. · Develop PT2 compiler e.g TorchDynamo TorchInductor Py ...

    New York, NY

    1 week ago