ML Platform Engineer
Tasks
- Build autoscaling capacity management
- Collaborate with ML and product teams for model releases
- Design model serving platforms
- Develop deployment workflows canary releases shadow testing automated rollback
- Document operational procedures performance characteristics tuning guidance
- Drive end-to-end observability
- Implement caching prompt deduplication response reuse
- Implement multi tenant routing rate limiting quality of service
- Implement security controls request signing content filtering abuse detection
- Integrate model serving with API gateways identity and observability
- Operate incident response for high availability AI services
- Optimize inference performance
- Translate AI serving research into production
- Tune GPU utilization memory management KV cache
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | Abuse detection | Automated rollback | Autoscaling | C++ | Caching | Canary Deployment | Content Filtering | Distributed Systems | GPU Utilization | Go | Incident Response | KV cache | Kubernetes | LLM Inference | Memory Management | Metrics | Observability | Python | Quality of Service | Rate Limiting | Request Signing | Rust | Shadow testing | Structured Logging | TensorRT-LLM | Tracing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R10h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R13h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R13h ago
-
Senior WEM AQM Prompt Engineer USD 88K-247KA/B | A/B Testing | API Integration | B testing | CalibrationInclusive environment | Remote work | Team-first cultureSenior-level Full TimeUnited States (Remote) R14h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R17h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R19h ago
-
Machine Learning Engineer (Platform) USD 156K-211KAWS | CPU Optimization | Data Processing | Data throughput | Distributed TrainingRemote workSenior-level Full TimeRemote-US R1d ago
-
Principal Data Engineer USD 155K-184KAWS Glue | Alerting | Amazon Web Services | Apache Airflow | Automated testing401k retirement program | Company-Paid Holidays | Paid time offSenior-level Full TimeUnited States R1d ago
-
Sr. Software Engineer (Data)-0336 USD 132K-203KAWS | Apache Spark | ClickHouse | Databricks | GitHubEmotional support | Financial benefits | Health benefits | Remote work days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R1d ago
-
Sr Staff Software Engineer- Data Platform USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Access Control | AlgorithmsDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R1d ago
-
Senior SW Engineer, Data Recording USD 129K-198KBackpressure | Bazel | Build systems | C plus plus | C#Senior-level Full TimeWork From Home - United States, … R1d ago
-
Lead Data Engineer USD 75KApache Airflow | Apache Beam | Autoscaling | BigQuery | CI/CD401k matching | Adoption reimbursement | Commuter benefits | Disability benefits | Discounts and savingsSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Principal Embedded Software Engineer USD 150K-175K4G | Battery Management | Battery Management Systems | Board Bring-up | Bring-upSenior-level Full TimeMASSACHUSETTS - VIRTUAL - MA01, United … R1d ago
-
Mid-level Full TimeMASSACHUSETTS - VIRTUAL - MA01, United … R1d ago
-
Fullstack Engineer USD 85K-134KETL | Hadoop | Hive | Java | Linux401k plan | Continuing Education/Professional Development | Dental insurance | Employee assistance program | Life insuranceEntry-level Full TimeRemote, CA, United States R1d ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Alerting | Apache Spark | Azure HDInsightRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Streaming Data Engineer USD 100K-150KAccess Control | Access Control Lists | Ansible | Apache Kafka | Apache Kafka ConnectSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAPI Gateway | Abuse detection | Automated rollback | Autoscaling | C++Senior-level Full TimeUnited States - Remote R1d ago
-
AI Scientist USD 100K-150KAccelerator hardware | Computer Vision | Deep learning | Distributed Training | Experiment designRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code reviewSenior-level Full TimeUnited States - Remote R1d ago
-
Generative AI Engineer USD 100K-150KAdapters | Benchmarking | DPO | Deep learning | Distributed TrainingSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter based Fine Tuning | Attention Optimization | Cluster management | DPO | Distributed TrainingSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Director, Machine Learning & AI (BPD) USD 203K-304KAWS | Agentic Systems | Azure | Bias Testing | Cloud ComputingSenior-level Full TimeUS - Gaithersburg - MD, United … R1d ago