Sr. Engineering Manager, AI/ML Serving Platform - San Francisco, CA, US; Remote, US

Sr. Engineering Manager, AI/ML Serving Platform · The AI/ML Serving Platform team provides foundational tools and infrastructure used by hundreds of AI/ML engineers across Pinterest, including recommendations, ads, visual search, growth/notifications, trust and safety. We aim to ...

Job description

Sr. Engineering Manager, AI/ML Serving Platform

The AI/ML Serving Platform team provides foundational tools and infrastructure used by hundreds of AI/ML engineers across Pinterest, including recommendations, ads, visual search, growth/notifications, trust and safety. We aim to ensure that AI/ML systems are efficient, healthy (production-grade quality) and fast (for modelers to iterate upon).

Pinterest is seeking a Sr. Engineering Manager to lead the team that builds the serving and deployment infrastructure for all AI/ML models at Pinterest. Systems include:

• Ultra-high-performance C++ model inference engine for production recommendations and content ranking systems. TorchScript + CUDA Graph models on GPU inference, serving 500+M inferences/second.
• Production GenAI & LLM model inference stack for emerging use cases.
• Model routing, deployment, monitoring. Kubernetes-based provisioning.
• Feature fetching, caching, and logging

What you'll do

• Lead the team to deliver continual improvements in advanced model architectures, cost-efficient resource utilization, and AI/ML developer productivity.
• Set technical direction for the team based on company and org priorities
• Coach and develop talent on the team.

What we're looking for:

• Experience managing platform engineering teams with many cross-organizational customers
• Experience leading the development of large-scale distributed serving systems
• Experience with AI/ML inference technologies (e.g. PyTorch, TensorFlow) for online serving at Web scale
• Bachelor's degree in Computer Science, a related field or equivalent experience.

In-Office Requirement Statement:

• We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection.
• This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. 

Relocation Statement:

• This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.

#LI-REMOTE

#LI-AH2