Senior ML Ops Engineer - New York City Metropolitan Area
2 days ago

Job description
Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | NYC (Hybrid)
A venture-backed AI startup is expanding its engineering team and hiring a Senior MLOps Engineer to build and scale production-grade AI systems for healthcare automation.
This role is focused on building secure, scalable AI infrastructure that supports real enterprise deployment.
Responsibilities:
- Deploy NLP, OCR, and multimodal AI models in secure cloud environments
- Design scalable ML pipelines with strong observability, reliability, and performance
- Build data schemas and ETL workflows for annotations, training, tuning, and benchmarking
- Establish best practices in experiment tracking, model versioning, and reproducibility
- Write high-quality, maintainable production code
- Build internal AI tools to support engineering and product teams
- Identify and mitigate technical risks early in the release cycle
Requirements:
- 8–10+ years total engineering experience
- 4+ years in MLOps, SRE, DevOps, ML Platform, or similar
- Strong background in AI data modeling, versioning, and annotation workflows
- Recent experience delivering scalable enterprise AI products
- Familiarity with MLflow, LangChain, LangFuse, W&B, CrewAI, or similar frameworks
- Understanding of monitoring, experiment comparison, and evaluation frameworks
- Experience with multiple database technologies
- Strong communication skills and comfort in cross-functional environments
- Preference for candidates with a mix of startup and tech-company experience
- Heavy big-bank or Fortune 500 backgrounds are less aligned
Why This Role:
- High-impact AI work in a complex, meaningful domain
- Early-stage ownership with influence over AI architecture and engineering culture
- Competitive compensation, equity, benefits, and flexible time off
- Flat structure and direct access to leadership
Location:
NYC area (hybrid). Local candidates preferred.
Similar jobs
We are seeking a skilled IT Operations Engineer to join our dynamic IT security team in either London or New York. · ...
1 week ago
We're looking for a Senior DevOps Engineer to help maintain and grow our tech platform that accelerates application engineers' productivity and operational excellence.About Wonder! · ...
1 month ago
This is a hybrid of Executive Operations + AI Automation Engineering. · ...
1 month ago
We are on the hunt for a seasoned professional to lead the charge in transforming our audience segmentation capabilities. · Craft sophisticated audience signals. · Develop intricate segments within Salesforce Data Cloud. · ...
5 days ago
This is a 12 month contract working for a well known software application (you've seen it in the app store). As an AI Automation & Services Engineer, you will independently lead automation initiatives across the employee experience lifecycle. · Lead end-to-end implementation of n ...
1 month ago
We are looking for an Applied AI Engineer to own the applied AI systems that power our marketplace end-to-end: candidate-job matching, submission scoring, cross-matching, and internal workflow automation. · Build and refine our candidate-job matching and scoring systems to increa ...
1 month ago
+Job summary · We're hiring a founding operator with real engineering/building ability to turn post-sales into a self-serve onboarding engine — aiming for 10x–100x CS capacity without hiring a huge team. · +ResponsibilitiesA self-serve onboarding journey (templates, guided setup, ...
3 weeks ago
Job summary · This is an opportunity for someone with solid infrastructure management experience but ready for more ownership—someone eager to apply their skills and be a leader in a fast-paced environment where daily deployments and continuous iteration are the norm.Responsibili ...
4 weeks ago
We're looking for a scrappy associate software engineer to join our partners small, tight-knit team of 6 in NYC already seeing strong revenue traction. · ...
1 month ago
We are seeking a DevOps Tech Lead – Infrastructure to partner closely with the engineering team and own the end-to-end infrastructure lifecycle. · ...
1 month ago
A New York–based hedge fund seeking a Trade Operations Engineer to join our front-office–aligned operations and technology team. This role sits at the intersection of trading, operations, and engineering with direct responsibility for ensuring accurate efficient and scalable trad ...
3 weeks ago
Lead AI Platform Engineer to own the transition of existing AI proof-of-concepts into secure, scalable, and production-grade platforms responsible for defining standards building core platform capabilities and ensuring AI solutions are reliable observable and extensible across th ...
1 month ago
+Job summary+Setpoint provides critical operational infrastructure for relationships between the world's largest banks credit funds and capital markets counterparties. We're building trust in this system of credit. · + ...
1 month ago
The Video Operations Specialist will lead the implementation,maintenance,and support of video conferencing and audiovisual collaboration solutions in corporate environments. · Manage and support AV systems in meeting rooms and collaboration spaces. · Provide support for video con ...
1 week ago
About Clay · Our mission is to help organizations turn any growth idea into reality. · We see growth as a creative practice, not a formula. Finding and reaching your best-fit customers takes unique ideas and constant iteration. As AI makes execution faster and tactics easier to c ...
1 month ago
We're looking for someone to build the systems that move deals forward. · This role is all about the heart of the funnel: pipeline management, opportunity workflows, deal acceleration, and post-sale handoffs. You'll work closely with go-to-market leaders to turn high-level goals ...
1 month ago
We're building the data platform that powers the future of machine learning applications. · Identify, engage, and recruit top talent for various sales and marketing roles within the company. · Collaborate with hiring managers to understand role requirements and develop targeted s ...
1 month ago
About Turing Robotics: · Turing Robotics is accelerating the development of frontier physical AI models. We are building diverse datasets of human activity. To do this, we deploy advanced wearable hardware to capture high-fidelity, multimodal data in real-world environments like ...
2 days ago
We're looking for someone to build the systems that move deals forward. · This role is all about the heart of the funnel: pipeline management, opportunity workflows, deal acceleration, and post-sale handoffs. ...
4 weeks ago
We're hiring a Go-To-Market Engineer for our Sales-Led team This role combines technical expertise with a passion for helping Enterprise customers unlock Clay's full potential through a high-touch, consultative approach. · ...
1 month ago