ML Platform Engineer
Tasks
- Build autoscaling and capacity management
- Collaborate with ML and product teams for model releases
- Design model serving platforms
- Develop deployment workflows canary releases shadow testing automated rollback
- Document operational procedures and performance characteristics
- Drive end-to-end observability
- Implement caching prompt deduplication response reuse
- Implement routing rate limiting quality of service
- Implement security controls request signing content filtering abuse detection
- Integrate model serving with API gateways identity systems observability platforms
- Operate incident response for high availability AI services
- Optimize inference performance
- Support production rollout of AI serving improvements
- Tune GPU utilization and memory management
Perks/Benefits
Skills/Tech-stack
API Gateway | Automated rollback | Autoscaling | C++ | Caching | Canary Releases | Continuous batching | Distributed Systems | FinOps | GPU Architecture | Go | Identity Management | Incident Response | KV cache | Kubernetes | LLM | Memory Management | Metrics | Model Compression | Model Distillation | Multi-tenant | Multi-tenant routing | Observability | Python | Quality of Service | Quantization | Rate Limiting | Request Multiplexing | Rust | Shadow testing | Speculative decoding | Structured Logging | Tenant Routing | TensorRT-LLM | Tracing
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R1d ago
-
Ansible | C# | C++ | CMake | CUDAMentorship | Remote work | Training workshopsMid-level Full TimeBaltimore, MD, United States R10h ago
-
Senior Software Engineer, Data Insights USD 196K-243KAWS VPC | Amazon EKS | Analytics infrastructure | Apache Superset | Data EngineeringSenior-level Full TimeSan Mateo, CA, United States R16h ago
-
Senior Software Engineer, Unsecured Installments USD 160K-223KA/B | A/B Testing | Accessibility | B testing | CI/CD401k match | Dental insurance | Disability insurance | Health insurance | Health savings accountSenior-level Full TimeUnited States | Remote R19h ago
-
Software Engineer, Unsecured Installments USD 136K-196KCI/CD | Cypress | GraphQL | Java | JavaScript401k | Company holidays | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeUnited States | Remote R19h ago
-
Machine Learning Engineer USD 120K-150KBERT | CI/CD | Document parsing | Embeddings | Fine Tuning401k matching | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountMid-level Full TimeRemote (United States) R20h ago
-
AI Engineer - AI/ML USD 98K-176KAWS | Access Control | Agentic Workflows | Agile | AuditabilityCareer development | Comprehensive benefits | Inclusion culture | TelecommuteMid-level Full TimeMinnetonka, Minnesota, UNITED STATES; REMOTE R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingMid-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hudi | Apache Spark | Data GovernanceBenefits | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Mid-level Full TimeUnited States - Remote R23h ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Attention Optimization | Dataset curation | Direct Preference Optimization | Evaluation methodology100% remote | Benefits package | Full-time W2 employment | Long term multi year engagementMid-level Full TimeUnited States - Remote R23h ago
-
Prompt Engineer USD 100K-150KAgentic Workflows | Chunking | Embeddings | Evaluation | IndexingBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Computer Vision | Concurrent programming | Critical softwareMid-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Applied AI Engineer - Federal (TS Required) USD 170K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25 percent | Federal clearance supportMid-level Full TimeUnited States (Remote); Washington, D.C. (Remote) R23h ago
-
Senior Software Engineer, Data Platforms USD 185K-215KAWS | BigQuery | Data Ingestion | Data Processing | Distributed Systems401k matching | Annual company offsite event | Career growth opportunities | Commuter benefits | Health benefits optionsSenior-level Full TimePalo Alto, CA R1d ago
-
Agentic AI Engineer – Google ADK/GCP USD 130K-191KAPI Development | Agent memory | Agent systems | CI/CD | Cloud RunFinancial and income protection benefits | Medical/Dental/Vision | Paid time off (PTO) | Tax-advantaged health care accounts | Wellness time offSenior-level Full TimeAustin, TX R1d ago
-
Staff Software Engineer - Data Platform USD 166K-232KAirflow | Automated testing | BigQuery | CI/CD | Cloud platformDental insurance | Flexible time off | In-office workspace | LinkedIn Learning access | Medical insuranceSenior-level Full TimeUnited States (Remote) R1d ago
-
Data Engineer USD 77K-90KAPI Integration | Automation | Batch Processing | CI/CD | CSV401k | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeRemote, USA, United States R1d ago
-
Software Engineer, AI Developer Experience USD 160K-200KAutomation | Cloud automation | Command Line | Command-line Interface | Data Analysis401k | In-home office setup | Internet stipend | Learning & development support | Medical, dental & vision coverageSenior-level Full TimeUnited States - Remote Opportunity R1d ago
-
Data Scientist USD 110K-130KAWS SageMaker | Automated retraining | Drift Detection | Experiment tracking | Feature Engineering401k company match | Company holidays | Dental insurance | Flexible working hours | Fully remoteMid-level Full TimeAlaska, Arizona, California, Colorado, Connecticut, Delaware, … R1d ago
-
Data Modeling, Fraud Analytics Consulting (Remote) USD 104K-174KAWS | Data Analysis | Data Modeling | Fraud Detection | Machine LearningPeriodic travel | Remote work | Variable pay opportunityMid-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
AI/ML Engineer USD 137K-197KCrewAI | Distillation | Docker | Edge AI | Explainable AI401k matching | Commuter benefits | Education reimbursement | Holiday leave | Life insuranceSenior-level Full TimeWashington, DC or Fully Remote R1d ago
-
Senior AI Software Engineer USD 145K-200KAWS | Asynchronous programming | Asyncio | Azure | CI/CD401k matching | Commuter benefits plan | Education reimbursement | Holiday leave | Life insuranceSenior-level Full TimeWashington, DC or Fully Remote R1d ago