Engineering Manager, Model Serving
Tasks
- Build automation and tooling for operations
- Ensure availability and performance SLAs for inference and training
- Lead incident response and reliability improvements
- Mentor team members and support hiring
- Partner with teams to improve system reliability and efficiency
Perks/Benefits
Skills/Tech-stack
Automation | Configuration Management | Deployment Architecture | Incident Management | Inference frameworks | Kubernetes | ML Serving | ML inference | ML inference frameworks | ML serving systems | Monitoring | Multi-tenant | Multi-tenant SaaS | Multi-tenant SaaS platforms | SaaS platforms | Serving systems | System Reliability
Education
N/A
Regions
Countries
States
Related jobs
-
Infrastructure Software Engineer, Energy Storage USD 180K-237KDeployment Automation | Distributed Systems | Kubernetes | Network Security | Operating SystemsMid-level Full TimeSan Francisco, California, United States6h ago
-
Senior-level Full TimeNew York City, New York8h ago
-
Senior-level Full TimeNew York8h ago
-
Agile | Algorithms | CI/CD | Data Engineering | Data Structures401k plan | Accident insurance | Dependent care FSA plan | HSA and FSA | Hospital indemnity insuranceSenior-level Full TimeAustin, Texas or Remote R8h ago
-
GCP Associate Data Engineer USD 43K-105KAI machine learning | Airflow | Apache Beam | BigQuery | CI/CD401k retirement savings | Company holidays | Disability insurance | Employee assistance program | Life insuranceMid-level Full TimeBridgewater, NJ, US11h ago
-
AWS | Ansible | Azure | Ceph | DockerEquity | Health insurance | Remote work flexibilityMid-level Full TimeSan Francisco12h ago
-
Research Engineer, FlexOlmo USD 128K-193KAWS | Cloud Computing | Containerization | Continual Learning | Data Preprocessing401k plan | Annual bonuses | Commuting assistance | Employee assistance program | Family leaveMid-level Full TimeSeattle, WA13h ago
-
Senior AI/ML Engineer USD 192K-240KAWS | Agentic Orchestration | Automated Labeling | Automated Labeling Pipelines | AzureHybrid work scheduleSenior-level Full TimeRedwood City, CA (Hybrid); San Francisco, … R13h ago
-
Staff Software Engineer - GenAI USD 146K-233KAPI Design | API Integration | Agentic AI | Agile | Angular401k | Dental insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeFoster City, CA, United States14h ago
-
Data Engineer USD 160K-220KAirflow | Amazon S3 | Apache Beam | Apache Flink | Apache SparkCo-working stipend | Full health and dental benefits | Mental health budget | Open, inclusive culture | Parental leave top-upMid-level Full TimeNew York15h ago
-
Senior Software Engineer, Computer Vision USD 175K-215KAWS | Biometrics | C++ | Computer Vision | Docker401k with employer match | Annual wellness stipend | CLEAR Plus membership | Catered lunches | Family building benefitsSenior-level Full TimeNew York, NY, United States16h ago
-
Data Scientist III - AI & Machine Learning USD 126K-149KAI Pipelines | Airflow | Apache Spark | Bayesian Inference | Bias Variance401k matching | Equity options grant | Flexible time off | Get Out Get Active funds | Health benefitsSenior-level Full TimeMissoula, Montana, United States R16h ago
-
GenAI Applications Program Analyst - Senior SWE USD 123K-190KAgile | Angular | C# | C++ | Conversational AI401k | Dental insurance | FSA | HSA | Life insuranceSenior-level Full TimeFoster City, CA, United States17h ago
-
Staff Data Platform Software Engineer, Graph — Veza USD 176K-308KAWS | Auditing | Azure | Caching | Cloud platform401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States17h ago
-
Infrastructure Engineer - Storage USD 100K-120KAnsible | Azure | Azure Blob | Azure Blob Storage | Azure Files401k plan | Bereavement | Disability insurance | Employee assistance program | Employee discount programMid-level Full TimeSt. Louis, MO, United States18h ago
-
Principal Engineer, Applied AI USD 155K-220KAutomated testing | Automation | Deployment | DevOps | Developer experienceSenior-level Full TimeDraper, UT (Hybrid) R18h ago
-
Staff Data Platform Software Engineer, Graph — Veza USD 176K-308KAWS | Azure | Caching | Cloud platform | Container Orchestration401k plan with company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States18h ago
-
Software Engineer II, Demo Engineering USD 117K-147KAWS | CI/CD | Cloud platform | Docker | GitCommunity guilds | Employee stock purchase plan | Mental health benefits | Mentor/Buddy programMid-level Full TimeNew York, New York, USA19h ago
-
Senior Infrastructure Kafka Engineer USD 125K-186KAWS | Alerting | Apache Kafka | Bash | Confluent KafkaContract-to-hire | Hybrid work model | Remote work optionSenior-level Full TimePhoenix, AZ19h ago
-
Senior-level ContractJersey City, United States21h ago
-
AI Software Engineer - Minneapolis USD 80K-120KAI coding | AI coding assistant | Agents | Automation | C#Collaborative environment | Comprehensive benefits package | Employee ownership | Flexible workplace | Innovative cultureEntry-level Full TimeSt. Louis Park, Minnesota, United States R21h ago
-
Partner Engineer, Generative AI USD 173K-247KAWS | Agent Orchestration | Azure | Bias Mitigation | C plus plusSenior-level Full TimeMenlo Park, CA1d ago
-
Senior Strategist, Kids and Learning Trust and Safety USD 132K-189KAutomation | Classification | Data Analysis | Data sets | DebuggingSenior-level Full TimeSeattle, WA, USA; Austin, TX, USA1d ago
-
Forward Deployment Engineer (Inference & RL POC) USD 150K-230KDeepSpeed | Distributed Systems | Fine Tuning | GPU Performance | GPU UtilizationFrequent customer interaction | Hybrid workMid-level Full TimeMountain View, California, United States1d ago
-
Machine Learning Engineer USD 110K-150KAirflow | Bayesian Methods | CI/CD | Causal Inference | DBT401k matching | Disability coverage | Health, dental, vision insurance | Paid Holidays | Paid parental leaveMid-level Full TimeNew York, NY, US1d ago