ML Platform Engineer
Tasks
- Build autoscaling and capacity management
- Design model serving platforms
- Develop deployment workflows with canary and rollback
- Document operational procedures and tuning guidance
- Drive end to end observability and error tracking
- Handle incident response and reliability improvements
- Implement caching and response reuse
- Implement multi tenant routing and rate limiting
- Implement security controls at serving layer
- Integrate observability and API gateway
- Operate high performance ML inference platforms
- Optimize inference performance
- Support model releases and capability rollouts
- Tune GPU utilization and memory management
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | Abuse detection | Automated rollback | Autoscaling | C++ | Caching | Canary Releases | Capacity Planning | Content Filtering | Continuous batching | Distributed Systems | GPU Architecture | Go | Incident Response | KV cache | Kubernetes | LLM Inference | Memory Management | Metrics | Observability | Performance Engineering | Python | Rate Limiting | Request Multiplexing | Request Signing | Rust | Shadow testing | Speculative decoding | Structured Logging | TensorRT-LLM | Tracing
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R15d ago
-
Senior DataOps Engineer USD 150K-180K800-171 | AWS CloudFormation | AWS Glue | AWS GovCloud | AWS IAMRemote position | US government clearance requiredSenior-level Full TimeRemote - United States R10h ago
-
Staff Data Engineer USD 237K-270KAmazon EMR | Amazon Redshift | Apache Airflow | Apache Flink | Apache SparkFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R11h ago
-
Senior DataOps Engineer ( Remote US) USD 113K-163KAWS | AWS CloudFormation | Amazon EMR | Ansible | Apache Airflow401K employee contribution | Employee assistance program | Flexible Time Away From Work | Health & medical benefits | Learning platformSenior-level Full TimeRemote US R11h ago
-
Senior Software Engineer II - Ingestion AI Engineer USD 105K-155KAWS | Agile | Alerting | Azure | Causal InferenceMid-level Full TimeRemote, United States R12h ago
-
Senior Software Engineer, Data Engineering Platform USD 186K-218KAPIs | Bitcoin | Blockchain Protocols | Blockchain infrastructure | Crypto infrastructureSenior-level Full TimeRemote - USA R12h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgoCD | CSI | Cluster API | Flux | GPUDirect StorageCompany outings happy hours | Conferences and working groups | Hackathons and tech talks | Professional development and trainingSenior-level Full TimeRemote, USA, United States R12h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-250KAir-gapped | Alerting | Argo CD | ArgoCD | Bare MetalAttend conferences and working groups | Professional development and trainingExecutive-level Full TimeRemote, USA, United States R14h ago
-
Explosives Research Experiment Lead USD 146K-222KAerospace Engineering | Bench testing | C++ | Computational modeling | Computer Aided Design401k | Education reimbursement | Flexible schedule | Hybrid work schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R1d ago
-
AI Engineer - ICAM USD 146K-197KAccess Management | Agile | Artificial Intelligence | Generative AI | Hugging Face100 percent remote workMid-level Full TimeUSA MD Home Office (MDHOME), United … R1d ago
-
APIs | AWS | CData | Change Data Capture | Cloud Native401k retirement plan | Adoption Assistance | Dental coverage | Education assistance | Employee Learning and DevelopmentSenior-level Full TimeNEO - Tamer Rashid Building OA, … R1d ago
-
Software Engineer, VP USD 169K-205KAPI Gateway | AWS Lambda | Agile | Amazon Bedrock | Amazon EC2Educational assistance | Health and wellness benefits | Paid Holidays | Paid maternity and parental bonding leave | Paid sick daysExecutive-level Full TimeNew Jersey Office - 210 Hudson … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Generative AI Specialist USD 100K-150KAgent systems | Agentic Workflows | Chunking | Deterministic Evaluation | EmbeddingsSenior-level Full TimeUnited States - Remote R1d ago
-
Large Language Model Specialist USD 100K-150KAdapter-Tuning | Attention Optimization | Benchmarking | DPO | DeepSpeed ZeRODirect W2 position | Remote workSenior-level Full TimeTempe, AZ R1d ago
-
Machine Learning Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data quality monitoringSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Infrastructure Storage Engineer USD 100K-150KAnsible | Automation | CSI | Capacity Planning | CephCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
ML Security Engineer USD 100K-150KAccess Controls | Access Management | Adversarial ML | Application Security | AuthorizationSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Solutions Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
ML Performance Engineer USD 100K-150KBenchmarking | C++ | Continuous batching | DeepSpeed | Distributed TrainingRemote workSenior-level Full TimeTempe, AZ R1d ago
-
Lead AI/ML Engineer - Remote USD 145K-249KAWS | Apache Spark | Azure | CI/CD | Cloud platform401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Associate AI/ML Engineer (RAG/LLM) USD 77K-137KAWS | Data Pipelines | LLM workflows | Language Models | Language Processing401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Hybrid workMid-level Full TimeBasking Ridge, New Jersey, UNITED STATES; … R1d ago
-
Portfolio Management Group Tech AI Engineer, Associate USD 125K-170KAWS SageMaker | Azure Machine Learning | Computer Vision | Deep learning | JavaComprehensive healthcare | Flexible time off | Leave benefits | Retirement benefits | Support for working parentsExecutive-level Full TimeAT8 - 725 Ponce de Leon … R1d ago