Software Engineering – Inference Engineer - San Francisco

Mirai builds on-device inference layer for AI. · We enable model makers to run AI models directly on edge devices,Our stack spans low-level GPU kernels to high-level model conversion tools. · We're looking for engineers who bridge ML research and high-performance inference,You'll ...

About Us Most AI is frozen in place - it doesn't adapt to the world. We think that's backwards. · ...

We are looking for an Inference Engineering Manager to lead our AI Inference team. This is a unique opportunity to build and scale the infrastructure that powers Perplexity's products and APIs serving millions of users with state-of-the-art AI capabilities. · ...

We are looking for an AI Inference engineer to join our growing team. · Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes.Responsibilities · Develop APIs for AI inference that will be used by both internal and external customers · Benchmark and address bot ...

We are looking for an Inference Engineering Manager to lead our AI Inference team. This is a unique opportunity to build and scale the infrastructure that powers Perplexity's products and APIs, · serving millions of users with state-of-the-art AI capabilities.Lead and grow a high ...

We are looking for an AI Inference engineer to join our growing team. · ...

We're looking for a software engineer to help us serve OpenAI's multimodal models at scale. · This work is inherently cross-functional: you'll collaborate directly with researchers training these models and with product teams defining new modalities of interaction. · ...

We are looking for an Inference Engineering Manager to lead our AI Inference team. · This is a unique opportunity to build and scale the infrastructure that powers Perplexity's products and APIs, · serving millions of users with state-of-the-art AI capabilities. · ...

We are looking for an Inference Engineering Manager to lead our AI Inference team. This is a unique opportunity to build and scale the infrastructure that powers Perplexity's products and APIs, serving millions of users with state-of-the-art AI capabilities. · ...

We're looking for a software engineer to help us serve OpenAI's multimodal models at scale. · You'll be part of a small team responsible for building reliable, · high-performance infrastructure for serving real-time audio, · image and other MM workloads in production. ...

Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale. · ...

+ GPU inference optimization vLLM SGLang or TensorRT-LLM experience Distributed compute with GPUs is a super plus Deploy and tune models with optimizations like KV caching paged attention sequence packing etc Conducting model performance reviews Improve scheduler batcher autoscal ...

We are looking for an Inference Engineer to join our core team. · We understand that inference is a systems problem not just a model problem. · You will own how models are served in production making inferences fast stable observable and cost efficient under unpredictable workloa ...

We are looking for a Software Engineering – Inference Engineer to join our core team.Virtue AI sets the standard for advanced AI security platforms. · Serve and optimize LLM, embedding, and other ML models' inference across multiple model familiesDesign and operate inference APIs ...

We're looking for a Founding Engineer with deep expertise in high-performance ML engineering. · Drive our frontier position on real-time model performance for diffusion models · ...

We build and operate large-scale LLM inference and training infrastructure serving millions of users. · ...

We're building the systems that make inference deployment continuous and unattended.About The RoleOur mandate is to make inference deployment boring and unattended. · ...

Job summary · Want to push GPU performance to its limits — not in theory, but in production systems handling real-time speech and multimodal workloads? · This team is building low-latency AI systems where milliseconds actually matter.The target isn't "faster than baseline." It's ...

We are looking for an engineer who wants to take the world's largest and most capable AI models and optimize them for use in a high-volume, low-latency, and high-availability production and research environment. · ...

We are building low-latency AI systems where milliseconds actually matter. · ...