Machine Learning Operations Manager

Cambridge, MA

Robotics and AI Institute

Welcome. At the Robotics and AI Institute (RAI Institute), our mission is to solve the most important and fundamental challenges in robotics and AI.

View all jobs at Robotics and AI Institute

Apply now Apply later

Our mission is to solve the most important and fundamental challenges in AI and Robotics to enable future generations of intelligent machines that will help us all live better lives.
Who we are looking for:We are seeking a Machine Learning Operations (ML-OPs) Manager who is both technically adept and an effective leader. In this role, you will lead a small team of engineers while also being hands-on in designing, building, and maintaining infrastructure that supports the entire lifecycle of Machine Learning (ML) projects. If you have a passion for building scalable ML infrastructure, mentoring engineers, and collaborating with world-class researchers, this is the role for you!

What You Will Do

  • Technical Leadership & Strategy: Drive the design, development, and maintenance of company-wide MLOps platforms and tools, leveraging Kubernetes infrastructure for ML and data processing applications.
  • Team Management & Mentorship: Manage and mentor a small team of engineers, providing technical guidance, setting priorities, and fostering a collaborative team culture
  • Scalability & Performance: Enable self-service access to ML-compute resources across on-prem and cloud environments, ensuring workload scalability, fault tolerance, and efficient job scheduling
  • Monitoring & Observability: Enhance system observability through integrations with tools and services such as FluentD, Prometheus, Grafana, and DataDog to improve reliability and debugging
  • Experiment & Model Lifecycle Management: Integrate ML applications with experiment tracking and model management services such as Weights and Biases
  • Best Practices & Collaboration: Champion engineering best practices, drive improvements in CI/CD, infrastructure automation, and reproducibility. Work closely with ML Engineers, Data Engineers, DevOps teams, and researchers to accelerate research and deployment.

What You Will Bring

  • BS or MS in Computer Science, Engineering, or equivalent
  • 5+ years of experience in an ML-Ops, DevOps, ML Engineering, or software engineering role
  • 2+ years of experience managing or mentoring engineers (can be formal management or technical leadership)
  • Strong, hands-on experience with Kubernetes for ML applications
  • Experience developing ML-Ops platforms (covering data/artifact management, reproducibility, fault tolerance, experiment tracking, and model serving)
  • Proficiency in Python, Docker, and environment management tools (pip, poetry, uv, or similar)Familiarity with CI/CD tools (GitHub Actions, ArgoCD) and Infrastructure as Code (Terraform)

Skills We Value

  • Experience with job scheduling mechanisms like Kueue
  • Hands-on experience with workflow orchestration tools (Airflow, Metaflow, Argo Workflows)
  • Experience managing cloud infrastructure (GCP, AWS) and hybrid-cloud environments
  • Knowledge of scalable AI/ML platforms like Ray or PyTorch Lightning
  • Experience with logging & monitoring tools (FluentD, Prometheus, Grafana, DataDog or similar 
  • Exposure to ML model serving frameworks (TorchServe, ONNX Runtime, or similar)
  • Previous experience collaborating with research teams in academic or industrial settings
We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Airflow AWS CI/CD Computer Science DevOps Docker Engineering GCP GitHub Grafana Industrial Kubernetes Machine Learning ML infrastructure MLOps ONNX Python PyTorch Research Robotics Terraform

Perks/benefits: Career development

Region: North America
Country: United States

More jobs like this