Staff Engineer - ML Infra / MLOps
Palo Alto, California, United States
USD 218K-285K Senior-level Full Time
Tasks
- Architect ML infrastructure foundation
- Architect scalable reliable ML serving
- Build developer experience for data scientists and researchers
- Control cloud costs for training and inference
- Deploy models using blue green and canary strategies
- Drive systemic permanent fixes
- Evaluate and select inference runtimes and feature stores
- Implement infrastructure as code for ML systems
- Implement monitoring alerting and automated recovery
- Lead root cause analyses for production failures
- Manage model versioning and experiment tracking
- Optimize GPU utilization and batching strategies
- Provide technical mentorship through design and code reviews
- Set engineering standards for CI CD for ML
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon SageMaker | Apache Flink | Apache Kafka | Apache Spark | Batching | Blue-Green Deployment | Blue/green | CI/CD | Canary Deployment | Docker | EKS | Experiment tracking | Feature Store | GPU Utilization | Inference Runtime | Infrastructure as Code | Kubeflow | Kubernetes | MLOps | Machine Learning | Model Deployment | Model versioning | Pulumi | PyTorch | TensorFlow | Terraform | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R27d ago
-
Machine Learning Engineer (all genders) EUR 63K-69KDeep learning | Machine Learning | NumPy | Pandas | PyTorchCorporate benefits discounts | Health and wellbeing | Hybrid work flexibility | Inclusive work environment | Job ticketsEntry-level Full TimeFrankfurt a.M., Hessen, DE3h ago
-
Machine Learning Engineer (alle Geschlechter) EUR 63K-69KData Analysis | Data Pipelines | Deep learning | Machine Learning | Model DevelopmentCoaching and mentoring | Company Childcare Support | Family support programs | Flexible working hours | Health checksEntry-level Full TimeFrankfurt a.M., Hessen, DE3h ago
-
Sr. Manager, Analytics Engineering & BI Architecture USD 137K-206KAWS | Access Control | Azure DevOps | CI/CD | CloudFormationHealth insurance | Hybrid work schedule | Paid time off | Retirement contributionsSenior-level Full TimeBoston, Massachusetts, US, 022106h ago
-
Forward Deployed Engineer - Labrynth USD 150K-230KAI evals | API Gateway | API Integration | AWS IAM | Amazon BedrockCompetitive compensation | Direct customer exposure | High-impact work | Remote-firstSenior-level Full TimeUnited States9h ago
-
Forward Deployed Engineer (FDE) - Public Sector USD 152K-210KAWS | Apache Spark | Azure | Big Data | CI/CDTravel 20%Mid-level Full TimeUnited States10h ago
-
Agentic AI Engineer USD 94K-149KCI/CD | Distributed tracing | Docker | Elasticsearch Relevance Engine | IAMFlexible work schedules | Generous vacation days | Health coverage | Parental leave | Volunteer time offSenior-level Full TimeUnited States10h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsSenior-level Full TimeFremont, California R12h ago
-
Staff AI Data Platform Engineer USD 138K-173KAPI Gateway | AWS | Access Control | Data Lineage | Data QualityEducational reimbursement | Employee insurance plan | Unlimited vacation | Wellness reimbursementSenior-level Full TimeSan Ramon, CA; Reno, NV13h ago
-
Senior Software Engineer - Machine Learning USD 134K-182KApache Flink | Apache Kafka | Big Data | Data Engineering | Deep learning401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeFrisco, TX 75034, United States13h ago
-
Senior Embedded Firmware Engineer USD 140K-225KBootloader | C# | C++ | Device Drivers | Embedded LinuxDental insurance | Employee assistance program | Flexible Paid Vacation | Flexible paid sick leave | Flexible spending accountSenior-level Full TimeSan Francisco, CA13h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgo CD | ArgoCD | Block Storage | CSI | Cluster APISenior-level Full TimeBoston, MA, United States R13h ago
-
Applied AI Lead USD 140K-180KAPI Integration | Agents | Artificial Intelligence | Assistants | Context engineeringEquity package | Health coverage | Remote-first workplace | Unlimited PTOSenior-level Full TimeRemote - United States or Canada R13h ago
-
Principal Applied AI Engineer USD 185K-245KAgent Frameworks | Agent SDK | Anthropic Agent SDK | Context engineering | EvalsSenior-level Full TimeRedesign Health R13h ago
-
API Design | Agentic AI | Cloud Computing | Data Infrastructure | Deployment401k match | Career advancement | Dental insurance | Flexible time off policy | Life insuranceSenior-level Full TimeDallas, Texas, United States; United States R14h ago
-
Staff Machine Learning Engineer, Foundation - Seattle USD 208K-298KAWS | Accelerate | Azure | C++ | DeepSpeedExperience bonus | Hybrid work model | QGroup communities | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States14h ago
-
Active Learning | DPO | Data Privacy | Deep learning | Few-Shot Learning401k match | Family leave | Flexible time away | Health plansSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
API Design | Bottleneck analysis | Debugging | Distributed Systems | Generative AI401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Staff Machine Learning Engineer, Agentic App Platform USD 176K-308KAPI Design | Debugging | Distributed Systems | Generative AI | Language Models401k plan with company match | ESPP | Family leave | Flexible time away | Health plansSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Staff Machine Learning Engineer, Agentic Application USD 176K-308KAgentic AI | Conversational UI | Generative AI | Language Models | Language Processing401k match | Employee stock purchase plan | Family leave | Flexible spending accounts | Flexible time away programSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Agentic AI | Conversational UI | Generative AI | LLM Applications | Language Models401k match | Employee stock purchase plan | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Machine Learning Engineer, Agentic Application USD 139K-216KAPI Design | Distributed Systems | Generative AI | Language Models | Language Processing401k match | ESPP | Family leave | Flexible spending account | Flexible time offEntry-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Staff Machine Learning Engineer, Agentic Application USD 176K-308KAgentic AI | Generative AI | Interface Design | Language Model | Language Processing401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
C++ | DistributedTraining | ETL | Go | Huggingface401k matching | ESPP | Family leave | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
C++ | Distributed Training | ETL Pipelines | Go | Hugging Face401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States14h ago