Senior Software Development Engineer – Distributed Inference - Santa Clara, CA

We are seeking a Senior Member of Technical Staff to join our team as a technical leader in Large Language Model (LLM) inference and kernel optimization for AMD GPUs. · ...

About · NVIDIA Dynamo is an innovative, open-source platform focused on efficient, scalable inference for large language and reasoning models in distributed GPU environments. By bringing to bear sophisticated techniques in serving architecture, GPU resource management, and intell ...

We're forming a team of innovators to roll out and enhance AI inference solutions at scale, demonstrating NVIDIA's GPU technology and Kubernetes. As a Solutions Architect focused on inference, you'll collaborate closely with our engineering, DevOps, and customers to develop enter ...

We are seeking a senior software development engineer to join our LLM inference framework team. As a senior member of the team, you will be responsible for building and optimizing production-grade single-node and distributed inference runtimes for large language models on AMD GPU ...

NVIDIA Dynamo is an innovative platform for efficient inference of large language and reasoning models in distributed GPU environments. · We're searching for engineers to build the next generation of scalable AI systems as a Principal Software Engineer on the Dynamo project. · Ad ...

We're forming a team of innovators to roll out and enhance AI inference solutions at scale, demonstrating NVIDIA's GPU technology and Kubernetes. As a Solutions Architect focused on inference, you'll collaborate closely with our engineering, DevOps, and customers to develop enter ...

We are looking for a versatile Machine Learning Infrastructure Engineer to join XPENG's Fuyao AI Platform team — a core AI infrastructure powering autonomous driving, · robotics, · and intelligent cockpit teams with large-scale data processing, · model training, · and inference a ...

We are seeking a Senior System Software Engineer to own and advance the AI-Perf analysis, NVIDIA's flagship framework for benchmarking, experimentation, and analysis of LLMs, · Generative AI, · and deep learning inference workloads.In this role, · You'll combinesystems research, ...

+We are seeking a Senior System Software Engineer to own and advance the AI-Perf analysis, NVIDIA's flagship framework for benchmarking, experimentation, and analysis of LLMs, Generative AI, and deep learning inference workloads. · +Lead the design, development, and roadmap of AI ...

We push the limits of innovation to solve the world's most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. · The RoleAMD is looking for an AI Cluster Validation Engineer who is passionate ab ...

We are looking for a versatile Machine Learning Infrastructure Engineer to join XPeng's Fuyao AI Platform team — a core AI infrastructure powering autonomous driving, robotics, and intelligent cockpit applications. · Design and optimize large-scale data processing, production and ...

WHAT YOU DO AT AMD CHANGES EVERYTHING · At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progr ...

We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server . We are a fast-paced team building a highly-performant AI inference platform to make design and deployment of new AI models easier and accessible to all users. · ...

NVIDIA is the platform for every new AI-powered application. We seek a Principal Software Engineer - AI Inference to advance open-source LLM serving. This role involves contributing to upstream inference engines like vLLM and SGLang. You will ensure they run outstandingly on NVID ...

We're building a group of innovators to assist enterprises in deploying and accelerating NVIDIA's three computer workloads for Physical AI. · We are seeking a hands-on Solutions Architect with deep expertise in backend infrastructure, inference and cloud-native applications to de ...

++We're building a group of innovators to assist enterprises in deploying and accelerating NVIDIA's three computer workloads for Physical AI. · ++Support customers in building scalable and observable GPU-accelerated pipelines for key robotics workloads using Kubernetes, cloud-nat ...

We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team. · Develop world-class GPU-accelerated AI inference serving software. · Contribute to feature de ...

As a Senior Member of Technical Staff, you will be a technical leader in Large Language Model (LLM) inference and kernel optimization for AMD GPUs. You will play a critical role in advancing high-performance LLM serving by optimizing GPU kernels, inference runtimes, and distribut ...

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology—and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of ...

We are seeking a skilled Software Development Engineer to join our team as we push the limits of innovation to solve real-world challenges.We're looking for someone with strong technical expertise in Python development within Linux environments. · ...