AI Platform Engineer II - Boston, MA
1 day ago

Job description
AI Platform Engineer
At Klaviyo, we believe the future of software lies not in productivity tools for human users but in software that can run and optimize itself based on outcome or reward metrics. We've built the infrastructure and application that serve as the interface between businesses and consumers. We now have over 167,000 customers, billions of consumer profiles, and hundreds of billions of customer messages and follow-on conversion data. We have a big opportunity to build state-of-the-art AI and machine learning technologies at Klaviyo to power our products and develop AI agents that can automatically create and execute marketing or customer experiences, strategies, and campaigns for any business.
As a AI Platform Engineer, you'll play a key role in designing and scaling the backend systems that power our AI products and agent solutions. This backend-heavy role gives you opportunities to influence architecture, async processing, and distributed systems. You'll collaborate closely with product managers, ML engineers, and data scientists to deliver real-world impact at scale.
This role is hybrid and based in Boston.
What You'll Do
- Design and build backend systems to scale AI solutions for 167K+ customers.
- Contribute to our agentic architecture to support performant AI agents.
- Build tools to tune LLM-based features, deploy agents, MCP and RAG in production, and evaluate performance using tools like Arize, OpenAI, Bedrock, LangChain, vLLM and Ray.
- Develop reliable, scalable data pipelines and APIs for AI systems.
- Foster a culture of ownership, experimentation, and customer-first thinking.
Who You Are
We encourage candidates to apply even if they do not meet all the qualifications listed. AI Ops is a rapidly evolving space and we are all constantly learning
- 3+ years of experience as a backend software engineer, building scalable, distributed systems.
- Experience working in production environments.
- Hands-on experience with generative AI and agentic AI applications in production.
- Proficient in Python (or similar).
- Comfortable collaborating with cross-functional technical partners.
- Curious, proactive, and eager to learn.
Nice to Have
- Experience with big data tools (e.g., Apache Spark, Ray).
- Familiarity with cloud infrastructure (AWS, Terraform, Kubernetes).
- Knowledge of ML frameworks (Huggingface, PyTorch, TensorFlow, Keras).
We use Covey as part of our hiring and / or promotional process. For jobs or candidates in NYC, certain features may qualify it as an AEDT. As part of the evaluation process we provide Covey with job requirements and candidate submitted applications. We began using Covey Scout for Inbound on April 3, 2025.
Please see the independent bias audit report covering our use of Covey here
Similar jobs
This Data Platform Engineer will design and implement efficient procedures and pipelines for software development and infrastructure deployment. · Implement continuous integration, continuous development, and constant deployment pipeline (CI/CD Pipeline) for data infrastructure u ...
1 month ago
The Data Platform Engineer will design and implement efficient procedures and pipelines for software development and infrastructure deployment, manage and deploy various key data systems and services. · Implement continuous integration, continuous development, and constant deploy ...
1 month ago
We're working with a top-tier quantitative investment firm that operates fully automated trading strategies across global markets. Technology is not a support function here - it is the business.The Opportunity · They're looking to hire a Platform Engineer to help build, scale, an ...
1 month ago
We're working with a top-tier quantitative investment firm that operates fully automated trading strategies across global markets. Technology is not a support function here - it · is · the business. · ...
1 month ago
We are looking for a · Platform Engineer with deep experience in Linux systems, · cloud infrastructure, and container orchestration. · ...
3 days ago
We are changing the way we unlock value and secure the enterprise through technology, and we want you to be part of it We are growing our cybersecurity program with the vision to deliver quality software that adds value to our customers, faster and securely, at scale. · Maintaini ...
1 week ago
As a Platform Engineer at Harvard University, you will play a key role in designing, operating, and managing Linux- and Unix-based infrastructure platforms that provide secure services across Harvard Medical School. · A minimum of five years' post-secondary education or relevant ...
1 month ago
We are dedicated to creating a diverse and welcoming environment where everyone can thrive. · Harvard Medical School's mission is to nurture a diverse, inclusive community dedicated to alleviating suffering and improving health and wellbeing for all through excellence in teaching ...
1 month ago
We are looking for a Platform / DevOps Engineer to design, build and operate the core infrastructure for a research compute datacenter. · ...
4 weeks ago
We are seeking a Senior Platform Engineer to develop and care for the platform and cloud infrastructure that are the backbone of our solutions. · ...
1 month ago
We are seeking a Senior Platform Engineer to develop and care for the platform and cloud infrastructure that are the backbone of our solutions. This role focuses on building robust, scalable, and efficient platforms that enable teams to develop, test, and deploy applications seam ...
1 month ago
Platform Engineer – Scientific Computing Platforms
Only for registered members
Job summary · The Israeli Quantum Computing Center (IQCC) is a cutting-edge national facility providing world-class infrastructure supporting quantum computing research and development for both academia and industry. · ResponsibilitiesDesign, maintain, and operate bare-metal Kube ...
4 weeks ago
We are seeking Platform Engineers who are passionate about creating and supporting DevOps tools with emerging technologies to join our team. · Work with product owners to understand desired application capabilities and testing scenarios · Continuously improve software engineering ...
1 month ago
This Senior Salesforce Platform Engineer should have at least 7-10 years of experience integrating Salesforce CRM systems into enterprise-grade mobile applications. · ...
1 month ago
We are seeking a motivated Engineer – Developer Platform to join Motional's Developer Platform team.In this role, you will help enable rapid and safe software delivery by building and maintaining a unified, efficient, and reliable platform used by engineering teams across the com ...
1 week ago
The Services Platform and our Management Interface (TMI) team empowers other engineering teams to focus less on boilerplate and infrastructure and more on building business value. We build and support tools and patterns that are considered best practices. · We operate like a prod ...
1 week ago
The Data Platform Engineering team supports CI/CD and infrastructure for our integrated Data Fabric platform. · Implement continuous integration, continuous development, and constant deployment pipeline (CI/CD Pipeline) for data infrastructure using Terraform and GitHub Actions. ...
3 days ago
The Data Platform Engineering team supports CI/CD and infrastructure for our integrated Data Fabric platform. This role requires a motivated individual with strong technical ability, data capability, excellent communication, and collaboration skills including the ability to devel ...
4 days ago
+This role is for a Senior AI Platform Engineer working with a leading scientific data and AI organization. You'll build and scale cloud-native AI/ML infrastructure using AWS, Databricks, and modern MLOps tooling. · +7+ years in software/infrastructure engineering · Strong AWS an ...
6 days ago
We are seeking a Senior Platform Engineer to join our Development Security Operations (DevSecOps) team within the Platform Engineering organization. · This position is ideal for engineers who are passionate about security, enjoy solving technical challenges collaboratively, and t ...
1 week ago
We are catalyzing the Scientific AI revolution by designing and industrializing AI-native scientific data sets... Architect and evolve our cloud-native platform infrastructure... · ...
1 week ago