Engineering Manager, Model Serving
Tasks
- Build automation and tooling for operations
- Ensure availability and performance SLAs for inference and training
- Lead incident response and reliability improvements
- Mentor team members and support hiring
- Partner with teams to improve system reliability and efficiency
Perks/Benefits
Skills/Tech-stack
Automation | Configuration Management | Deployment Architecture | Incident Management | Inference frameworks | Kubernetes | ML Serving | ML inference | ML inference frameworks | ML serving systems | Monitoring | Multi-tenant | Multi-tenant SaaS | Multi-tenant SaaS platforms | SaaS platforms | Serving systems | System Reliability
Education
N/A
Regions
Countries
States
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R17d ago
-
Engineering Manager, Machine Learning (Caper) USD 201K-253KBigQuery | CI/CD | Computer Vision | Deep learning | DockerRemote workSenior-level Full TimeUnited States - Remote R7h ago
-
Senior Generative AI Consultant USD 136K-136KAWS | Azure | CI/CD | Cloud platform | Deep learning401k matching | Dental insurance | Flexible spending account | Gym reimbursement | HealthcareSenior-level Full TimeSan Francisco, CA, United States8h ago
-
Senior Software Engineer (San Francisco, CA) USD 157K-222KAWS EC2 | AWS ECS | AWS EMR | AWS Fargate | AWS GlueSenior-level Full TimeSan Francisco, CA9h ago
-
Corporate AI Engineer USD 75K-230KAnthropic | Data integration | Embeddings | Enterprise SaaS | Generative AI401k match | Business travel accident insurance | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R10h ago
-
Senior Software Engineer II - Authoring Apps USD 196K-270KAWS | Kubernetes | Node.js | Python | React401k contribution | Healthcare | Home office stipend | Paid parental leave | Remote workMid-level Full TimeUS - Remote R10h ago
-
Senior-level Full TimeUnited States R10h ago
-
Staff Database Engineer USD 192K-260KCause analysis | Database operations | Database performance | Database performance tuning | IndexingSenior-level Full TimeMountain View, California; New York City, …10h ago
-
Staff Database Engineer USD 182K-247KAutomation | Cause analysis | Database performance | Database performance tuning | Database troubleshootingSenior-level Full TimeBellevue, Washington; Seattle, Washington10h ago
-
Staff AI Engineer USD 220K-275KAPI Integration | Agentic Workflows | Context Management | Cost Optimization | Data PipelinesSenior-level Full TimeRemote - United States R10h ago
-
Senior-level Full TimeLos Angeles10h ago
-
Senior Developer USD 145K-150KAPI | AWS ECS | AWS EKS | AWS Fargate | Amazon S3Agile team collaboration | Remote workSenior-level Full TimeFairfax, VA, United States13h ago
-
Staff Data Engineer USD 146K-233KAWS | Apache Iceberg | Apache Spark | Automated testing | Azure401k | Dental insurance | FSA/HSA | Health insurance | Life insuranceSenior-level Full TimeFoster City, CA, United States14h ago
-
Ansible | Azure | Azure Foundry | Azure Monitor | CI/CDMid-level Full TimeHuntsville, AL15h ago
-
Lead Data Engineer (P1952) USD 121K-201KAgile | Azure | Data Warehousing | Databricks | ETL401k matching | Dental insurance | Health insurance | Health savings account | Life and disability insuranceSenior-level Full TimeCincinnati, OH; Chicago, IL16h ago
-
Technical Lead Embedded Software Engineering USD 150K-175KARM | Agile | Build systems | C# | C++401k match | Health insurance | Minimal travel | Paid time offSenior-level Full TimeWaltham, MA, United States16h ago
-
Software Engineer - Observability Product USD 190K-220KAmazon Web Services | CI/CD | Development Lifecycle | Distributed Systems | GraphQLCoworking or office space coverage | Remote work stipendMid-level Full TimeRemote with offices in San Francisco, … R16h ago
-
Staff Machine Learning Engineer - VoIP Infrastructure USD 173K-303KAnsible | Configuration Management | DevOps | Distributed Systems | FreeSWITCH401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, California, United States16h ago
-
Senior Full-Stack Data Engineer (Remote) USD 110K-130KAI code assistance | Automated testing | Azure DevOps | CI/CD | Code assistanceFull-time | Fully remote | Long-term | No timezone shiftingSenior-level Full TimeFlorida, Aventura, United States of America R17h ago
-
Staff Software Engineer, ML Infrastructure, Applied AI USD 207K-300KC++ | Code review | Data Processing | Debugging | Design reviewSenior-level Full TimeSunnyvale, CA, USA19h ago
-
Cloud Architecture | Diagnostics | EKS | Enterprise Infrastructure | FirewallMid-level Contract TemporaryNew York, USA19h ago
-
ML Infrastructure Engineer USD 150K-230KAirflow | Apache Spark | Argo | Data Pipelines | DatabricksEntry-level Full TimeOakland, CA1d ago
-
Mid-level Full TimeIndianapolis, IN1d ago
-
Senior-level Full TimeTampa, FL1d ago
-
AI/ML Engineer with AWS SageMaker USD 103K-145KAWS Glue | AWS IAM | AWS Lambda | Amazon CloudWatch | Amazon ECSCompany-Paid Holidays | Dental insurance | Disability insurance | Employee assistance program | Life insuranceSenior-level Full TimeAtlanta, GA, US1d ago