ML Platform Engineer
Tasks
- Build autoscaling and capacity management
- Collaborate with ML and product teams
- Design model serving platforms
- Develop deployment workflows for safe releases
- Document operational procedures and performance tuning
- Implement caching and response reuse
- Implement multi tenant quality of service
- Implement request routing and batching
- Implement security controls at serving layer
- Integrate API gateways and observability
- Operate model inference services
- Optimize inference performance
- Perform incident response for high availability services
- Tune GPU utilization and memory management
Perks/Benefits
Skills/Tech-stack
Abuse detection | Automated rollback | Autoscaling | C++ | Caching | Canary Releases | Content Filtering | Continuous batching | Distributed Systems | GPU Utilization | Go | Inference Optimization | KV cache | Kubernetes | LLM Inference | Memory Management | Metrics | Observability | Python | Quality of Service | Rate Limiting | Request Multiplexing | Request Signing | Rust | Shadow testing | Structured Logging | TensorRT-LLM | Tracing
Education
Regions
Countries
States
Related jobs
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R1d ago
-
Senior Machine Learning Engineer, Search USD 361K-510KA/B | A/B Testing | Apache Airflow | Apache Spark | B testingCommuter benefits | Disability benefits | Equity awards | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R1d ago
-
Applied AI Architect, Strategic Enterprise Tech USD 240K-315KAPI Integration | Cloud Architecture | Data Science | Enterprise Integration | LLMFlexible work | Generous vacation | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Senior Staff Data Platform Engineer - Data Access Team USD 201K-352KAlgorithms | CI/CD | Data Structures | Design Patterns | Distributed Systems401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Data Engineer – Databricks USD 152K-200KAWS | Apache Airflow | Azure | Azure Data | Azure Data FactoryContract-to-hire | Hybrid work onsite 3 days per weekSenior-level Contract Full TimeBeaverton, OR, United States R1d ago
-
Lead AI Engineer USD 120K-175KAWS | Agentic AI | Artificial Intelligence | Benchmarking | Data Preparation401k match | Background check required | Certification reimbursement | Health insurance | Maternity & paternity leaveSenior-level Full TimeSchenectady, New York, United States, Remote R1d ago
-
Senior Software Engineer - Machine Learning Platform USD 166K-230KAPIs | AWS | Automation | Backtesting | DBT401k matching | Annual productivity allowance | Employee assistance program | Employee stock purchase plan | Health, dental, and vision insuranceSenior-level Full TimeUnited States | Remote R1d ago
-
Senior Machine Learning Engineer, Agent Eval Platform USD 176K-308KData labeling | Distillation | Evaluation | Fine Tuning | Information RetrievalInclusive work environment | Remote work flexibilitySenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Data Scientist - Foward Deployed Engineer USD 160K-170KAPIs | Agentic Workflows | Anomaly Detection | Context engineering | Experimentation401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractPalo Alto, California, USA R1d ago
-
Data Engineer II USD 78K-117KCI/CD | Cortex AI | Data Lake | Data Warehouse | ETL401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level Full TimeBaltimore, Maryland, USA R1d ago
-
Senior Machine Learning Engineer USD 176K-308KAlgorithms | Artificial Intelligence | Code Tuning | Code profiling | Design PatternsFlexible work persona | Remote work flexibilitySenior-level Full TimeWest Palm Beach, Florida, United States R1d ago
-
Data Engineer USD 101K-130KBI | DBT | Data Modeling | Data Monitoring | Data QualityHybrid work | On site 3 to 4 days per week | Self service analytics enablementMid-level Full TimeDallas, TX R1d ago
-
Fullstack AI Engineer USD 117K-147KAWS | Anthropic | CI/CD | Go | JavaScriptDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalMid-level Full TimeUnited States (Remote-First) R1d ago
-
Staff+ Software Engineer, RL Data Platform USD 320K-405KAPI | Crowdsourcing | Data Modeling | Data pipeline | LLMFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Staff+ Research Engineer, RL Data Platform USD 500K-850KData pipeline | LLM Evaluation | Latency optimization | Machine Learning | MonitoringFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Staff Data Engineer USD 134K-175KAWS EMR | AWS Glue | AWS S3 | Agile | Apache Airflow401k matching | Dental insurance | Disability insurance | Employee assistance program | Employee referral programSenior-level Full TimeDenver, CO, USA R1d ago
-
Sr. Data Engineer (Hybrid - Addison, TX) USD 120K-150KAzure | Azure Data | Azure Data Factory | Data Cleansing | Data FactoryHybrid work schedule | Knowledge sharing culture | Onsite commute requirement 3 days per weekSenior-level Full TimeAddison, TX, United States R1d ago
-
BeeGFS | CI/CD | CUDA | Caching | CephSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R2d ago
-
Data Engineer II USD 150K-225KAmazon EKS | Amazon MSK | Amazon Web Services | Apache Flink | Apache Kafka401k match | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA R2d ago
-
APIs | Access Control | Agentic Workflows | Cloud Computing | Context engineeringTravel opportunitiesSenior-level Full TimeUSA - Remote R2d ago
-
Sr. Software Engineer USD 150K-190KAI workflows | API | AWS | Agentic Workflows | Coordinate systems401k match | Dental insurance | Family plan benefits | Flexible time off | Hybrid work modelSenior-level Full TimeAtlanta, GA R2d ago
-
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency401k match | ESPP | Family leave | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R2d ago
-
Senior Manager, AI Software Engineering USD 199K-235KAWS | Agile | Automated testing | CI/CD | Cloud Native401k match | Flexible time off | Hybrid work model | Medical insuranceSenior-level Full TimeNew York, NY R2d ago
-
API Integration | Access Control | Agent Packs | Agentic Workflows | Anthropic APICustomer facing delivery opportunities | Remote work | Travel 25 percentSenior-level Full TimeUSA - Remote R2d ago
-
Data and Analytics - AI Engineer II USD 100K-143KAI Foundry | AIOps | APIs | Azure | Azure AICollaborative team culture | Hybrid work environment | Professional developmentMid-level Full TimeOmaha, NE, 68102, USA R2d ago