ML Platform Engineer
Tasks
- Build autoscaling and capacity management
- Create deployment workflows with canary releases and automated rollback
- Design model serving platforms
- Develop end to end observability
- Drive incident response and reliability improvements
- Implement caching and response reuse
- Implement routing rate limiting and quality of service
- Implement security controls at serving layer
- Integrate model serving with API gateways identity and observability
- Optimize inference performance
- Support new model releases and capability rollouts
- Tune GPU utilization and memory management
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | Abuse detection | Automated rollback | Autoscaling | C++ | Caching | Canary Releases | Capacity Planning | Content Filtering | Continuous batching | Distributed Systems | GPU Architecture | GPU Utilization | Go | Incident Response | KV cache | Kubernetes | Low Latency | Low-Latency Services | Memory Management | Metrics | Multi-tenant | Observability | Pagination attention | Performance Engineering | Python | Rate Limiting | Request Signing | Rust | Security | Shadow testing | Speculative decoding | Structured Logging | TensorRT-LLM | Tracing | VLLM
Education
Roles
Related jobs
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R11h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
AI Engineer - Application Development USD 75K-158KAPI Integration | AWS | Agno | Amazon Bedrock | AzureFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R1d ago
-
Embedded AI Engineer USD 100K-150KC++ | Core ML | Edge AI | Edge inference | Energy EfficiencyCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | Energy Efficiency | Federated Learning | Hybrid Cloud100 percent remote | Diversity and inclusion | Long-term career growthSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Computer Vision | Data Quality | Data labeling100 percent remote work | Benefits packageMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Baseline Models | Computer Vision | Data QualityFull-time benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Lead Full Stack Engineer, AI Solutions USD 129K-177KAgentic AI | Angular | Artificial Intelligence | Automated testing | Azure401k retirement savings | Hybrid work option | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeWork at Home - Kentucky, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyFull-time benefits | No third party employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Control | Access Management | Alation | Amazon Redshift | Apache FlinkFull time W2 employment benefits | Long-term career growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Generative AI Specialist USD 100K-150KAgent Frameworks | Agentic Workflows | Embeddings | Evaluation | Language ModelsCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter Layers | Attention Optimization | Benchmarks | DPO | Data GenerationRemote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100KAdapters | Benchmarking | DPO | Dataset curation | Distributed TrainingRemote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Benchmarking | DPO | DeepSpeed ZeRO | Evaluation methodologyMid-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Research Engineer USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data labelingRemote work opportunity | W2 employmentSenior-level Full TimeUnited States - Remote R1d ago
-
API Integration | AWS | Access Control | Autogen | Azure401k contribution | Comprehensive benefits package | Drug test requirement | Equity stock purchase | Hybrid office attendance four days per weekSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago