Manager, Large Language Model Inference - Santa Clara, CA
2 weeks ago

Job summary
We're seeking a highly skilled and driven Engineering Manager to take the lead in developing the next generation of LLM/VLM/VLA inference software technologies that will define the future of AI.At NVIDIA, we aren't just powering the AI revolution—we're accelerating it.
The TensorRT inference platform is the backbone of modern AI,
delivering the industry's fastest and most efficient deployment
of cutting-edge deep learning models on every NVIDIA GPU.
- Lead and grow a team responsible for specialized kernel development,
Job description
Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.Get full accessAccess all high-level positions and get the job of your dreams.
Similar jobs
NVIDIA is accelerating the AI revolution by developing cutting-edge deep learning models on every GPU. · We're seeking a highly skilled Engineering Manager to lead in developing the next generation of LLM inference software technologies. · Your work will be collaborative, interfa ...
1 month ago
Senior GenAI Algorithms Engineer — Model Optimizations for Inference
Only for registered members
NVIDIA is at the forefront of the generative AI revolution The Algorithmic Model Optimization Team specifically focuses on optimizing generative AI models such as large language models (LLMs) and diffusion models for maximal inference efficiency using techniques ranging from quan ...
1 month ago
Senior GenAI Algorithms Engineer — Model Optimizations for Inference
Only for registered members
We are seeking a Senior Deep Learning Algorithms Engineer to improve innovative generative AI models like LLMs, VLMs, multimodal and diffusion models. · ...
3 weeks ago
Multimodal Model Training and Inference Optimization Engineer
Only for registered members
The Vision-Applied Research team focuses on applied research in Generative AI and CV/Multimodal Understanding, · and delivering intelligent solutions to ByteDance products. · Optimize large model training pipelines to improve efficiency,speed,and scalability. · Benchmark and prof ...
1 week ago
Senior GenAI Algorithms Engineer — Model Optimizations for Inference
Only for registered members
NVIDIA is at the forefront of the generative AI revolution The Algorithmic Model Optimization Team specifically focuses on optimizing generative AI models such as large language models (LLM) and diffusion models for maximal inference efficiency using techniques ranging from quant ...
1 week ago
Multimodal Model Training and Inference Optimization Engineer
Only for registered members
We are seeking an experienced Multimodal Model Training and Inference Optimization Engineer with expertise in optimizing AI model training and inference, · Optimize large model training pipelines to improve efficiency speed scalability. · Develop distributed training strategies s ...
1 week ago
Multimodal Model Training and Inference Optimization Engineer
Only for registered members
We are seeking an experienced Multimodal Model Training and Inference Optimization Engineer with expertise in optimizing AI model training and inference, · including distributed training/inference and acceleration.The ideal candidate will work at the cutting edge of AI efficiency ...
1 week ago
Multimodal Model Training and Inference Optimization Engineer
Only for registered members
We are seeking an experienced Multimodal Model Training and Inference Optimization Engineer with expertise in optimizing AI model training and inference, including distributed training/inference and acceleration. The ideal candidate will work at the cutting edge of AI efficiency, ...
1 week ago
We are seeking an experienced AI model optimization engineer specializing in large model inference acceleration. · Design and optimize large model inference pipelines for low-latency and high-throughput production deployments · Benchmark and profile deep learning models to identi ...
2 weeks ago
Senior Deep Learning Software Engineer, Inference and Model Optimization
Only for registered members
NVIDIA is at the forefront of generative AI with its Algorithmic Model Optimization Team focusing on optimizing models for inference efficiency using techniques such as neural architecture search pruning sparsity quantization automated deployment strategies. · Train develop deplo ...
1 week ago
Senior Deep Learning Software Engineer, Inference and Model Optimization
Only for registered members
NVIDIA is at the forefront of the generative AI revolution The Algorithmic Model Optimization Team specifically focuses on optimizing generative AI models such as large language models (LLM) and diffusion models for maximal inference efficiency using techniques ranging from neura ...
4 weeks ago
Senior Deep Learning Software Engineer, Inference and Model Optimization
Only for registered members
NVIDIA is at the forefront of the generative AI revolution The Algorithmic Model Optimization Team specifically focuses on optimizing generative AI models such as large language models LLM and diffusion models for maximal inference efficiency using techniques ranging from neural ...
4 weeks ago
Senior Deep Learning Software Engineer, Inference and Model Optimization
Only for registered members
We are now looking for a Senior Deep Learning Software Engineer to develop and scale up our automated inference and deployment solution. · As part of the team, you will be instrumental in pushing the limits of inference efficiency and large-scale, automated deployment. · Increasi ...
3 weeks ago
Senior Deep Learning Software Engineer, Inference and Model Optimization
Only for registered members
The Algorithmic Model Optimization Team specifically focuses on optimizing generative AI models such as large language models (LLM) and diffusion models for maximal inference efficiency using techniques ranging from neural architecture search and pruning to sparsity, quantization ...
3 weeks ago
Sr. Multimodal Model Training and Inference Optimization Engineer
Only for registered members
We are seeking an experienced Multimodal Model Training Optimization Engineer with expertise in optimizing AI model training and inference including distributed traininginference. · Optimize large model training pipelines to improve efficiency speedand scalability. · Benchmarkand ...
1 week ago
Sr. Multimodal Model Training and Inference Optimization Engineer
Only for registered members
We are seeking an experienced Multimodal Model Training and Inference Optimization Engineer with expertise in optimizing AI model training and inference, including distributed training/inference and acceleration.The ideal candidate will work at the cutting edge of AI efficiency, ...
1 week ago
Sr. Multimodal Model Training and Inference Optimization Engineer
Only for registered members
We are seeking an experienced Multimodal Model Training and Inference Optimization Engineer with expertise in optimizing AI model training and inference, including distributed training/inference and acceleration. · The ideal candidate will work at the cutting edge of AI efficienc ...
1 week ago
Sr. Multimodal Model Training and Inference Optimization Engineer
Only for registered members
We are seeking an experienced Multimodal Model Training and Inference Optimization Engineer with expertise in optimizing AI model training and inference. · Optimize large model training pipelines to improve efficiency, speed, and scalability. · Benchmark and profile deep learning ...
1 week ago
Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Only for registered members
The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, · the software development kit used to accelerate deep learning · and GenAI workloads on Amazon's custom machine learning accelerators, · Inferentia and Trainium.We combine · deep hardware knowledge with ML e ...
3 weeks ago
Research Scientist, Latent State Inference for World Models
Only for registered members
We are seeking a forward-thinking Research Scientist to focus on inferring latent state representations from sensor data powering world models and supporting rigorous policy evaluation for autonomous vehicles. · Design and train learning-based systems that transform raw multimoda ...
1 week ago