MLOps Engineer
Tasks
- Build autoscaling and capacity management
- Build inference platform components
- Collaborate with ML and product teams for model rollouts
- Design model serving platforms
- Develop deployment workflows canary shadow testing automated rollback
- Document operational procedures performance characteristics tuning guidance
- Drive end-to-end observability
- Implement caching prompt deduplication response reuse
- Implement multi tenant routing rate limiting quality of service
- Implement security controls request signing content filtering abuse detection
- Integrate model serving with API gateways identity systems observability
- Operate incident response and reliability improvements
- Optimize inference performance
- Tune GPU utilization memory management KV cache
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | Abuse detection | Automated rollback | Autoscaling | C++ | Caching | Canary Releases | Capacity Planning | Cloud Platforms | Content Filtering | Distributed Systems | GPU Architecture | Go | Identity Management | Incident Response | KV cache | Kubernetes | LLM serving | Machine Learning | Memory Management | Metrics | Observability | Performance Engineering | Python | Quality of Service | Rate Limiting | Request Routing | Request Signing | Rust | Security controls | Shadow testing | Structured Logging | TensorRT-LLM | Tracing | VLLM
Education
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R10d ago
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R9h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R23h ago
-
Mid-level Full TimeUnited States - Remote R23h ago
-
AI Engineer - Application Development USD 75K-158KAPI Integration | AWS | Agno | Amazon Bedrock | AzureFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R23h ago
-
Embedded AI Engineer USD 100K-150KC++ | Core ML | Edge AI | Edge inference | Energy EfficiencyCareer growthSenior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | Energy Efficiency | Federated Learning | Hybrid Cloud100 percent remote | Diversity and inclusion | Long-term career growthSenior-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Computer Vision | Data Quality | Data labeling100 percent remote work | Benefits packageMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Baseline Models | Computer Vision | Data QualityFull-time benefits | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Lead Full Stack Engineer, AI Solutions USD 129K-177KAgentic AI | Angular | Artificial Intelligence | Automated testing | Azure401k retirement savings | Hybrid work option | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeWork at Home - Kentucky, United … R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyFull-time benefits | No third party employment | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Data Platform Architect USD 100K-150KAccess Control | Access Management | Alation | Amazon Redshift | Apache FlinkFull time W2 employment benefits | Long-term career growth | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Generative AI Specialist USD 100K-150KAgent Frameworks | Agentic Workflows | Embeddings | Evaluation | Language ModelsCareer growth | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
LLM Engineer USD 100K-150KAdapter Layers | Attention Optimization | Benchmarks | DPO | Data GenerationRemote workMid-level Full TimeUnited States - Remote R23h ago
-
LLM Engineer USD 100KAdapters | Benchmarking | DPO | Dataset curation | Distributed TrainingRemote workMid-level Full TimeUnited States - Remote R23h ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Benchmarking | DPO | DeepSpeed ZeRO | Evaluation methodologyMid-level Full TimeUnited States - Remote R23h ago
-
Mid-level Full TimeUnited States - Remote R23h ago
-
Machine Learning Research Engineer USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data labelingRemote work opportunity | W2 employmentSenior-level Full TimeUnited States - Remote R23h ago