ML Platform Engineer
Tasks
- Build autoscaling and capacity management
- Collaborate on model releases and rollouts
- Design model serving platforms
- Develop deployment workflows with canary releases and rollback
- Document operational procedures and tuning guidance
- Drive end-to-end observability
- Implement caching and response reuse
- Implement routing rate limiting and quality of service
- Implement security controls for serving
- Integrate model serving with API gateways identity and observability
- Operate incident response for high availability AI services
- Optimize inference performance
- Translate AI serving research into production
- Tune GPU utilization and memory management
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | Abuse detection | Autoscaling | C++ | Caching | Canary Releases | Content Filtering | Distributed Systems | FinOps | GPU Utilization | Go | Incident Response | KV cache | Kubernetes | LLM Inference | Memory Management | Metrics | Observability | Python | Quality of Service | Rate Limiting | Request Signing | Rust | Secure request signing | Shadow testing | Structured Logging | TensorRT-LLM | Tracing
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R11h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
AI Engineer - Application Development USD 75K-158KAPI Integration | AWS | Agno | Amazon Bedrock | AzureFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R1d ago
-
Embedded AI Engineer USD 100K-150KC++ | Core ML | Edge AI | Edge inference | Energy EfficiencyCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | Energy Efficiency | Federated Learning | Hybrid Cloud100 percent remote | Diversity and inclusion | Long-term career growthSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Computer Vision | Data Quality | Data labeling100 percent remote work | Benefits packageMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Baseline Models | Computer Vision | Data QualityFull-time benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Lead Full Stack Engineer, AI Solutions USD 129K-177KAgentic AI | Angular | Artificial Intelligence | Automated testing | Azure401k retirement savings | Hybrid work option | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeWork at Home - Kentucky, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyFull-time benefits | No third party employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Generative AI Specialist USD 100K-150KAgent Frameworks | Agentic Workflows | Embeddings | Evaluation | Language ModelsCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter Layers | Attention Optimization | Benchmarks | DPO | Data GenerationRemote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100KAdapters | Benchmarking | DPO | Dataset curation | Distributed TrainingRemote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Benchmarking | DPO | DeepSpeed ZeRO | Evaluation methodologyMid-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Research Engineer USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data labelingRemote work opportunity | W2 employmentSenior-level Full TimeUnited States - Remote R1d ago
-
API Integration | AWS | Access Control | Autogen | Azure401k contribution | Comprehensive benefits package | Drug test requirement | Equity stock purchase | Hybrid office attendance four days per weekSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago