ML Platform Engineer
Tasks
- Build autoscaling and capacity management
- Collaborate with ML and product teams for model releases
- Design model serving platforms
- Develop deployment workflows canary releases shadow testing automated rollback
- Document operational procedures and performance characteristics
- Drive end-to-end observability
- Implement caching prompt deduplication response reuse
- Implement routing rate limiting quality of service
- Implement security controls request signing content filtering abuse detection
- Integrate model serving with API gateways identity systems observability platforms
- Operate incident response for high availability AI services
- Optimize inference performance
- Support production rollout of AI serving improvements
- Tune GPU utilization and memory management
Perks/Benefits
Skills/Tech-stack
API Gateway | Automated rollback | Autoscaling | C++ | Caching | Canary Releases | Continuous batching | Distributed Systems | FinOps | GPU Architecture | Go | Identity Management | Incident Response | KV cache | Kubernetes | LLM | Memory Management | Metrics | Model Compression | Model Distillation | Multi-tenant | Multi-tenant routing | Observability | Python | Quality of Service | Quantization | Rate Limiting | Request Multiplexing | Rust | Shadow testing | Speculative decoding | Structured Logging | Tenant Routing | TensorRT-LLM | Tracing
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R2d ago
-
API Design | Agent Optimization | Agent systems | Atomic operations | Caching401k plan | Calm app access | Disability insurance | In Home Office Setup Support | Internet stipendSenior-level Full TimeUnited States and Canada - Remote … R17h ago
-
Lead Data Engineer USD 160K-193KAmazon Redshift | CI/CD | DBT | ELT | ETL401k match | Adoption benefits | Employee resource groups | Flexible time off | Health insuranceSenior-level Full TimeDeerfield, IL, United States R17h ago
-
Senior Data Engineer II USD 134K-203KAPI Gateway | API Management | AWS | AWS API | AWS API GatewayHealth insurance | Health leave | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - US R18h ago
-
Forward Deployed ML/AI Engineer USD 167K-200KAWS | Azure | CI/CD | Databricks | DockerAnnual company retreat | Company winter break | Education bonus | High-performance culture | Optional in person events and meetupsSenior-level Full TimeUnited States R19h ago
-
Senior Software Engineer, Marketplace Optimization USD 166K-230KAPI Design | AWS | Cloud Native | Distributed Systems | Event Driven401k | Dental insurance | Disability insurance | Employee assistance program | Employee stock purchase planSenior-level Full TimeUnited States | Remote R19h ago
-
Software Engineer II, Fulfillment USD 106K-142KA/B | A/B Testing | AWS | B testing | CI/CD401k match | Education stipend | Employer-paid health insurance | Flexible time off | IKEA discountsSenior-level Full TimeSan Francisco, California, United States R20h ago
-
Alerting | BigQuery | Buildkite | CI/CD | Container OrchestrationDental and vision coverage | ESPP | Employee stock purchase plan | Flexible spending wallets | Health care coverageSenior-level Full TimeRemote US R21h ago
-
Senior DevOps Engineer - Storage Platforms USD 90K-252KAlerting | Ansible | Backup Rubrik | Backup Technologies | Bash401k matching | Basic life insurance | Company-Paid Holidays | Employee stock purchase plan | Health, dental and vision coverageSenior-level Full TimeUnited States (Remote) R22h ago
-
AI Solutions Engineer USD 127K-204KAPI Integrations | Anthropic Claude | Benefit Analysis | Change Management | Cost BenefitCareer development | Distributed team collaboration | Learning opportunities | Work from anywhereMid-level Full TimeCanada R1d ago
-
AI Specialist USD 182K-295KAgent systems | AgentCore) | Agentbuilder | Architecture Diagrams | Automated EvaluationDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R1d ago
-
AWS | AWS CloudFormation | AWS CloudTrail | AWS Lambda | AWS SecretsEqual opportunity employment | Remote workSenior-level Full TimePhoenix, AZ, United States R1d ago
-
Ansible | C# | C++ | CMake | CUDAMentorship | Remote work | Training workshopsMid-level Full TimeBaltimore, MD, United States R1d ago
-
Senior Data Engineer USD 110K-115KAWS Glue | AWS Lambda | Access Control | Agile | Amazon KinesisFully remoteSenior-level Full TimeUnited States R1d ago
-
Airbyte | Apache Airflow | Apache Iceberg | Cloud platform | DBTContinuous learning environment | Fully remote work environment | Health benefits | Home office setup allowance | Remote work stipendSenior-level Full TimeCanada R1d ago
-
AWS | Artificial Intelligence | BigQuery | Cloud platform | Computer VisionEquity incentives | Flexible time off | Fully remote | Healthcare coverage | Professional developmentSenior-level Full TimeCanada R1d ago
-
Senior Software Engineer, Data Insights USD 196K-243KAWS VPC | Amazon EKS | Analytics infrastructure | Apache Superset | Data EngineeringSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Senior Data Engineer USD 171K-207KAWS | Access Control | Apache Airflow | Apache Iceberg | Change Data Capture401k match | Dental insurance | Digital tools access | Enhanced mental health support | Fertility healthcareSenior-level Full TimeUnited States, Remote R1d ago
-
Senior Software Engineer, Unsecured Installments USD 160K-223KA/B | A/B Testing | Accessibility | B testing | CI/CD401k match | Dental insurance | Disability insurance | Health insurance | Health savings accountSenior-level Full TimeUnited States | Remote R1d ago
-
Software Engineer, Unsecured Installments USD 136K-196KCI/CD | Cypress | GraphQL | Java | JavaScript401k | Company holidays | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeUnited States | Remote R1d ago
-
Machine Learning Engineer USD 120K-150KBERT | CI/CD | Document parsing | Embeddings | Fine Tuning401k matching | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountMid-level Full TimeRemote (United States) R1d ago
-
AI Engineer - AI/ML USD 98K-176KAWS | Access Control | Agentic Workflows | Agile | AuditabilityCareer development | Comprehensive benefits | Inclusion culture | TelecommuteMid-level Full TimeMinnetonka, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hudi | Apache Spark | Data GovernanceBenefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago