Principal Machine Learning Engineer, Distributed vLLM Inference - Boston, MA
1 month ago
+ Develop and maintain distributed inference infrastructure leveraging Kubernetes APIs, operators, and the Gateway Inference Extension API for scalable LLM deployments
+ Create system components in Go and/or Rust to integrate with the vLLM project and manage distributed inference workloads
+, Benefits include comprehensive medical, dental, vision coverage flexible spending account healthcare dependent care health savings account high deductible medical plan retirement 401(k) employer match paid time off holidays paid parental leave plans new parents leave benefits disability paid family medical leave military leave additional benefits employee stock purchase plan family planning reimbursement tuition reimbursement transportation expense account employee assistance program
Job description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. We accelerate AI for the enterprise and brings operational simplicity to GenAI deployments. · You would be joining the core team behind 2025's most pop ...
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · At Red Hat we accelerate AI for the enterprise and brings operational simplicity to GenAI deployments. · As leading developers maintainers of state- ...
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · ...
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · ...
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. As leading developers, maintainers of the vLLM and LLM-D projects, and inventors of state-of-the-art techniques for model quantization and s ...
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · ...
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. As leading developers, maintainers of the vLLM and LLM-D projects, and inventors of state-of-the-art techniques for model quantization and sparsificati ...
Principal Machine Learning Engineer
3 weeks ago
Red Hat is seeking a Principal Machine Learning Engineer to join our AI Inference team. · ...
Forward Deployed Engineer, AI Inference
1 month ago
The vLLM and LLM-D Engineering team at Red Hat is looking for a customer obsessed developer to join our team as a Forward Deployed Engineer. · In this role, you will not just build software; you will be the bridge between our cutting-edge inference platform (LLM-D, and vLLM) and ...
Forward Deployed Engineer, AI Inference
1 month ago
Red Hat is looking for a customer-obsessed developer to join their team as a Forward Deployed Engineer. · ...
Senior Machine Learning Engineer
3 weeks ago
+At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · +The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · As ...
Machine Learning Engineer
3 weeks ago
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · As l ...
Principal Machine Learning Engineer
3 weeks ago
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments.As lead ...
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · ...
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · You ...
Machine Learning Engineer
3 weeks ago
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · ...
At Red Hat we believe the future of AI is open. The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · We provide a stable platform for enterprises to build optimize scale LLM deployments. · ...
+Job summary · At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise.The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deploym ...
Senior Machine Learning Engineer
3 weeks ago
We believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · The Red Hat AI Inference Engineering team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. · As leading deve ...
At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. · This role will involve architecting new features for Red Hat AI Inference. · ...