Senior Principal MLOps Engineer, AI Inference - Boston, MA
2 days ago
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open source LLMs and vLLM to every enterprise.
Responsibilities
- Collaborate with research and product development teams to scale machine learning products for internal and external applications
- Create and manage model training and deployment pipelines
- Actively contribute to managing and releasing upstream and midstream product builds
- Troubleshoot debug upgrade Dev Test pipelines
Job description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
Red Hat is looking for a customer-obsessed developer to join their team as a Forward Deployed Engineer. · ...
1 month ago
The vLLM and LLM-D Engineering team at Red Hat is looking for a customer obsessed developer to join our team as a Forward Deployed Engineer. · In this role, you will not just build software; you will be the bridge between our cutting-edge inference platform (LLM-D, and vLLM) and ...
1 month ago
The vLLM and LLM-D Engineering team at Red Hat is looking for a customer obsessed developer to join our team as a Forward Deployed Engineer. · Orchestrate Distributed Inference: Deploy and configure LLM-D and vLLM on Kubernetes clusters. · Optimize for Production: Go beyond stand ...
1 month ago
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · ...
1 month ago
Principal Machine Learning Engineer, Distributed vLLM Inference
Only for registered members
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · At Red Hat we accelerate AI for the enterprise and brings operational simplicity to GenAI deployments. · As leading developers maintainers of state- ...
1 month ago
Principal Machine Learning Engineer, Distributed vLLM Inference
Only for registered members
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. We accelerate AI for the enterprise and brings operational simplicity to GenAI deployments. · ...
1 day ago
Senior Principal Machine Learning Engineer, vLLM Inference
Only for registered members
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · ...
1 month ago
Principal Machine Learning Engineer, Distributed vLLM Inference
Only for registered members
+ Principal Machine Learning Engineer focused on distributed vLLM infrastructure in the llm-d project · + Develop and maintain distributed inference infrastructure leveraging Kubernetes APIs, operators, and the Gateway Inference Extension API for scalable LLM deployments · + Crea ...
1 month ago
Senior Principal Machine Learning Engineer, vLLM Inference
Only for registered members
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. We accelerate AI for the enterprise and brings operational simplicity to GenAI deployments. · You would be joining the core team behind 2025's most pop ...
1 month ago
Senior Principal Machine Learning Engineer, Distributed vLLM Inference with Kubernetes
Only for registered members
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. As leading developers, maintainers of the vLLM and LLM-D projects, and inventors of state-of-the-art techniques for model quantization and s ...
1 month ago
Senior Principal Machine Learning Engineer, Distributed vLLM Inference with Kubernetes
Only for registered members
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · ...
1 month ago
Senior Principal Machine Learning Engineer, Distributed vLLM Inference with Kubernetes
Only for registered members
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. As leading developers, maintainers of the vLLM and LLM-D projects, and inventors of state-of-the-art techniques for model quantization and sparsificati ...
1 month ago
Red Hat is seeking a Principal Machine Learning Engineer to join our AI Inference team. · ...
3 weeks ago
We're an AI for autonomous system design and operations. · We design and deliver system optimizations 10-100x faster than experts, · reducing weeks of effort to mere hours. · The technology is based on a decade's worth of know-how and insights from award-winning research in the N ...
3 weeks ago
+Our client is building AI-native systems at the intersection of machine learning, scientific computing, and materials innovation. · +Own and operate a production-grade GPU platform · Design and operate hardened, multi-tenant ML systems on AWS · +,8+ ...
1 month ago
We are seeking a Senior MLOps Engineer to own and operate a production-grade GPU platform supporting large-scale model training and low-latency inference for computational chemistry and LLM workloads serving thousands of users. · ...
1 month ago
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · As l ...
4 weeks ago
+At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · +The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · As ...
4 weeks ago
We are seeking a Principal-level AI Infrastructure Engineer to review our current architecture, · design a next-generation system capable of scaling up to 100x, · and guide implementation of that architecture. · This is an engineering and systems role — not a management position. ...
23 hours ago
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · ...
4 weeks ago