ML Compiler Engineer II - New York
1 day ago

Job description
The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack.
This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX.
Your role will involve working closely with our custom-built Machine Learning accelerators, including Inferentia/Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.
Key job responsibilities
As a ML Compiler Engineer II on the Neuron Compiler Automated Reasoning Group, you will develop and maintain tooling for best-in-class technology for raising the bar of the Neuron Compiler's accuracy and reliability.
You will work in a team with a science focus, and strive to push what we do to the edge of what is known, to best deliver our customers.
Strong software development skills using C++/Python are critical to this role.A science background in compiler development is strongly preferred. A background in Machine Learning and AI accelerators is preferred, but not required.
In order to be considered for this role, candidates must be currently located or willing to relocate to Seattle (Preferred), Cupertino, Austin, or Toronto.
3+ years of non-internship professional software development experience
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience programming with at least one software programming language
Preferred Qualifications
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information.
If the country/region you're applying in isn't listed, please contact your Recruiting Partner.The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location.
Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.
Learn more about our benefits atUSA, NY, New York - 158, ,800.00 USD annually
Company - Annapurna Labs (U.S.) Inc.
Job ID:
A3186261
Similar jobs
We're building an AI accelerator from the ground up, and we need a strong ML compiler engineer to be at the heart of hardware-software co-design. · This isn't about inheriting a mature compiler stack - it's about creating one. You'll join at the architecture definition stage, dir ...
3 days ago
The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, origin ...
1 day ago
We're building an AI accelerator from the ground up and need a strong ML compiler engineer to be at the heart of hardware-software co-design. · li>Work across the full stack with software systems and hardware teams to ensure correctness performance and deployment readiness for re ...
3 days ago
We deliver the compute platform responsible for running the autonomous vehicle's software stack. · ...
4 weeks ago
Job summary · We are looking for an exceptional compiler engineer to work on challenging greenfield projects that accelerate bytecode execution. · ...
1 month ago
We re building an AI accelerator from the ground up and we need a strong ML compiler engineer to be at the heart of hardware software co design This isn t about inheriting a mature compiler stack it s about creating one · ...
4 days ago
Waymo is an autonomous driving technology company. We deliver the compute platform responsible for running the autonomous vehicle s software stack. ...
4 weeks ago
As a Qualcomm Machine Learning Engineer, you will create and implement machine learning techniques, frameworks, · Bachelor's degree in Computer Science, Engineering, Information Systems or related field. · ...
2 weeks ago
About us FriendliAI is building an AI inference platform · The RoleWe seek Inference Engine Engineer to optimize our core inference engine. · ...
3 weeks ago
You will be a member of the MTIA (Meta Training & Inference Accelerator) Software team and part of the bigger industry-leading PyTorch AI framework organization. · You will be working on one of the core areas such as PyTorch framework components, AI compiler and runtime, high-per ...
1 month ago
+We are excited to announce research internships in our Tools and Compilers group. · +Type systems that track locality and uniquenessSuperoptimizationCompiler testing and validation ...
1 month ago
This role is about developing the core PyTorch 2.0 technologies. · We are committed to building the PT2 compiler that withstands the test of time while striving to become the #1 ML framework compiler in the industry,Responsibilities:Develop the PT2 compiler (e.g., TorchDynamo, To ...
1 week ago
In this role, you will be a member of the MTIA (Meta Training & Inference Accelerator) Software team and part of the bigger industry-leading PyTorch AI framework organization. MTIA Software Team has been developing a comprehensive AI Compiler strategy that delivers a highly flexi ...
1 day ago
Aquatic Capital Management is seeking a Research Engineer to join our research team.Your work will blend software engineering and quantitative research, focusing on designing high-performance tooling and infrastructure that accelerate the development of machine learning models us ...
2 weeks ago
About Fern · Fern helps software companies build a world-class API experience. Our customers include industry leaders like Nvidia, Square, and Twilio, as well as fast-growing AI companies like ElevenLabs and OpenRouter. · In the next year, the majority of API integrations will be ...
1 day ago
As part of the MTIA Software team and part of the bigger industry-leading PyTorch AI framework organization you will develop software stack with one of the core focus areas: AI frameworks compiler stack high performance kernel development and acceleration onto next generation har ...
1 week ago
We are building our greenfield backend platform from scratch—scaling build orchestration, secure artifact distribution, and performance analytics. · Build responsive web apps (React,, TypeScript) for developers and enterprise users. · Design & optimize APIs and backend services,, ...
1 week ago
We are excited to announce research internships in our Tools and Compilers group. · We're looking for PhD and masters students with outstanding research experience in programming languages, compilers, verification, and related areas.Type systems that track locality and uniquenes ...
1 week ago
We are excited to announce research internships in our Tools and Compilers group. We're looking for PhD and masters students with outstanding research experience in programming languages, compilers verification related areas. ...
1 week ago
This role involves developing the core PyTorch 2.0 technologies and innovating ML compilers. The team is dedicated to making PyTorch run faster and more resource-efficient without sacrificing its flexibility and ease of use. · Develop PT2 compiler e.g TorchDynamo TorchInductor Py ...
1 week ago