Engineering Manager, Model Serving
Tasks
- Build automation and tooling for operations
- Ensure availability and performance SLAs for inference and training
- Lead incident response and reliability improvements
- Mentor team members and support hiring
- Partner with teams to improve system reliability and efficiency
Perks/Benefits
Skills/Tech-stack
Automation | Configuration Management | Deployment Architecture | Incident Management | Inference frameworks | Kubernetes | ML Serving | ML inference | ML inference frameworks | ML serving systems | Monitoring | Multi-tenant | Multi-tenant SaaS | Multi-tenant SaaS platforms | SaaS platforms | Serving systems | System Reliability
Education
N/A
Regions
Countries
States
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R17d ago
-
Senior Software Engineer - Data Lake & BI USD 162K-242KApache Iceberg | Apache Spark | Avro | C++ | CI/CD401k match | Disability insurance | Employee stock purchase program | Flexible PTO | Flexible spending accountSenior-level Full TimeSunnyvale, CA / Bellevue, WA8h ago
-
Engineering Manager, Machine Learning (Caper) USD 201K-253KBigQuery | CI/CD | Computer Vision | Deep learning | DockerRemote workSenior-level Full TimeUnited States - Remote R9h ago
-
Senior Generative AI Consultant USD 136K-136KAWS | Azure | CI/CD | Cloud platform | Deep learning401k matching | Dental insurance | Flexible spending account | Gym reimbursement | HealthcareSenior-level Full TimeSan Francisco, CA, United States10h ago
-
Senior Software Engineer (San Francisco, CA) USD 157K-222KAWS EC2 | AWS ECS | AWS EMR | AWS Fargate | AWS GlueSenior-level Full TimeSan Francisco, CA10h ago
-
Corporate AI Engineer USD 75K-230KAnthropic | Data integration | Embeddings | Enterprise SaaS | Generative AI401k match | Business travel accident insurance | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R12h ago
-
Senior Software Engineer II - Authoring Apps USD 196K-270KAWS | Kubernetes | Node.js | Python | React401k contribution | Healthcare | Home office stipend | Paid parental leave | Remote workMid-level Full TimeUS - Remote R12h ago
-
Senior-level Full TimeUnited States R12h ago
-
Staff Database Engineer USD 192K-260KCause analysis | Database operations | Database performance | Database performance tuning | IndexingSenior-level Full TimeMountain View, California; New York City, …12h ago
-
Staff Database Engineer USD 182K-247KAutomation | Cause analysis | Database performance | Database performance tuning | Database troubleshootingSenior-level Full TimeBellevue, Washington; Seattle, Washington12h ago
-
Staff AI Engineer USD 220K-275KAPI Integration | Agentic Workflows | Context Management | Cost Optimization | Data PipelinesSenior-level Full TimeRemote - United States R12h ago
-
Senior-level Full TimeLos Angeles12h ago
-
API Design | AWS Lambda | Application Architecture | Code review | DebuggingSenior-level Full TimeUS-CA-Menlo Park14h ago
-
Senior Developer USD 145K-150KAPI | AWS ECS | AWS EKS | AWS Fargate | Amazon S3Agile team collaboration | Remote workSenior-level Full TimeFairfax, VA, United States15h ago
-
Staff Data Engineer USD 146K-233KAWS | Apache Iceberg | Apache Spark | Automated testing | Azure401k | Dental insurance | FSA/HSA | Health insurance | Life insuranceSenior-level Full TimeFoster City, CA, United States16h ago
-
Ansible | Azure | Azure Foundry | Azure Monitor | CI/CDMid-level Full TimeHuntsville, AL16h ago
-
Lead Data Engineer (P1952) USD 121K-201KAgile | Azure | Data Warehousing | Databricks | ETL401k matching | Dental insurance | Health insurance | Health savings account | Life and disability insuranceSenior-level Full TimeCincinnati, OH; Chicago, IL18h ago
-
Technical Lead Embedded Software Engineering USD 150K-175KARM | Agile | Build systems | C# | C++401k match | Health insurance | Minimal travel | Paid time offSenior-level Full TimeWaltham, MA, United States18h ago
-
Software Engineer - Observability Product USD 190K-220KAmazon Web Services | CI/CD | Development Lifecycle | Distributed Systems | GraphQLCoworking or office space coverage | Remote work stipendMid-level Full TimeRemote with offices in San Francisco, … R18h ago
-
Staff Machine Learning Engineer - VoIP Infrastructure USD 173K-303KAnsible | Configuration Management | DevOps | Distributed Systems | FreeSWITCH401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, California, United States18h ago
-
Senior Full-Stack Data Engineer (Remote) USD 110K-130KAI code assistance | Automated testing | Azure DevOps | CI/CD | Code assistanceFull-time | Fully remote | Long-term | No timezone shiftingSenior-level Full TimeFlorida, Aventura, United States of America R18h ago
-
Staff Software Engineer, ML Infrastructure, Applied AI USD 207K-300KC++ | Code review | Data Processing | Debugging | Design reviewSenior-level Full TimeSunnyvale, CA, USA21h ago
-
Cloud Architecture | Diagnostics | EKS | Enterprise Infrastructure | FirewallMid-level Contract TemporaryNew York, USA21h ago
-
ML Infrastructure Engineer USD 150K-230KAirflow | Apache Spark | Argo | Data Pipelines | DatabricksEntry-level Full TimeOakland, CA1d ago
-
Mid-level Full TimeIndianapolis, IN1d ago