Staff Machine Learning Engineer, ML Infrastructure
Tasks
- Build feedback loops between cloud inference edge devices and data flywheel
- Define SLOs and observability standards for ML services
- Define model lifecycle best practices registry deployment monitoring rollback drift
- Design and evolve cloud inference systems for real time video and events
- Drive architecture decisions for Kubernetes based ML platform
- Identify and remove bottlenecks in ML deployment infrastructure
- Improve throughput latency and cost for production CV models
- Lead deep technical reviews for system design capacity planning reliability
- Lead incident response and postmortems for critical ML systems
- Set technical direction for ML infrastructure
- Shape LLM serving in production
Perks/Benefits
Skills/Tech-stack
AWS EKS | Amazon IAM | Amazon S3 | Autoscaling | Batching | C++ | CI/CD | Docker | Drift Detection | GPU scheduling | Go | Infrastructure as Code | KServe | KV cache | Kafka | Kubernetes | LLM serving | ML inference | MLflow | Model Monitoring | Model Registry | Multi-tenancy | NVIDIA Triton | Python | Quantization | Ray | Rust | Speculative decoding | VLLM | Weights and Biases | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Junior AI Engineer (Open to remote) USD 110K-135KAPI Development | Language Model | Language Model Evaluation | Language Models | Language Processing401k | Dental insurance | Health savings account | Medical insurance | Paid time offEntry-level Full TimeNew York, NY, US, NY 10019 R4h ago
-
Senior Data Platform Engineer, Remote USD 135K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatchSenior-level Full TimeUnited States, UNITED STATES, United States R5h ago
-
Robotics Application Engineer USD 100K-300KAutonomous Systems | C++ | Computer Vision | Machine Learning | PythonMid-level Full TimePittsburgh, San Mateo5h ago
-
AI Software Engineer USD 181K-270KAWS | CI/CD | Docker | Edge Functions | GitHub CopilotComprehensive benefits | Equity | Learning stipend | Remote-first cultureSenior-level Full TimeUnited States or Canada R9h ago
-
Senior-level Full TimeLos Angeles, CA9h ago
-
Machine Learning Intern USD 80K-90KAWS | Apache Hive | Apache Spark | C++ | Cloud platformFinal evaluation | Mentorship | Performance feedbackEntry-level InternshipMountain View, USA10h ago
-
Forward Deployment AI Engineer USD 120K-150KAgent Orchestration | Autogen | Automation | Cloud services | Data extractionClient site travel | Client-facing role | Hybrid workMid-level Full TimeCleveland, OH or Columbus, OH10h ago
-
Senior-level Full TimeUT, US, 8404311h ago
-
AI Engineer USD 120K-158KAI Services | AIOps | Azure | Azure AI | Azure AI Services401k match | Dental insurance | Holidays | Medical insurance | Paid time offMid-level Full TimeLos Angeles, CA, USA11h ago
-
Senior Machine Learning Engineer, GenAI Data USD 243K-295KAmazon S3 | Batch Processing | C plus plus | Data Pipelines | Data PreprocessingSenior-level Full TimeSan Mateo, CA, United States R11h ago
-
Data Engineer, Human Cohorts USD 191K-195KAWS | Azure | CI/CD | Cloud platform | ComplianceOnsite work requirementSenior-level Full TimeSouth San Francisco, CA11h ago
-
Software Engineer, Cortex AI Infrastructure USD 160K-225KC++ | CI/CD | Cloud Native | Cloud Native Architecture | Data-intensiveMid-level Full TimeUS-CA-Menlo Park12h ago
-
AI Engineer USD 105K-132KAWS | CAP | CLIA | Electronic Health Records | FDA401k benefits | Baby bonding leave | Commuter benefits | Dental insurance | Disability insuranceMid-level Full TimeUS Remote R12h ago
-
Senior Embedded Software Engineer USD 120K-180KADA | Aerospace Avionics | C++ | Communication Protocols | Control SystemsCareer growth opportunities | Comprehensive benefits | MentorshipSenior-level Full TimeHuntsville, Alabama12h ago
-
Senior Applied AI Engineer USD 200K-270KA/B | A/B Testing | AWS | Ablation Testing | Agentic WorkflowsCareer growth | Mentorship | Travel Onsite TimeSenior-level Full TimeUS-CA-Menlo Park13h ago
-
Applied AI Engineer USD 126K-181KA/B | A/B Testing | AWS | Ablation Testing | Agentic WorkflowsCustomer facing technical collaboration | Travel onsite 25 percentSenior-level Full TimeUS-CA-Menlo Park13h ago
-
Senior Software Engineer, Machine Learning USD 190K-220KAWS | Airflow | DBT | Kubernetes | MLflow401k match | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leave | Remote-first teamSenior-level Full TimeRemote (United States) R13h ago
-
Member of Technical Staff - Principal ML Engineer USD 200K-300KAPI Design | Access Management | Auth0 | Cloud Architecture | Entra ID401k | Equity incentives | FSA | Health insurance | Mental health benefitsSenior-level Full TimeRemote (USA) R13h ago
-
Staff AI Engineer USD 150K-185KAPI Design | API Gateway | API Integration | AWS Lambda | AWS SQSRemote work | Travel opportunitiesSenior-level Full TimeUnited States13h ago
-
DevOps Engineer – CI/CD & Pipeline Platform USD 125K-180KAlerting | Ansible | ArgoCD | CI/CD | GitHub401k | Employee assistance program | Flexible PTO | Flexible spending account | Health savings account contributionsMid-level Full TimeLas Vegas, Nevada14h ago
-
Application/Agentic AI Engineer USD 124K-166KAPI Integration | Agentic AI | CI/CD | DevSecOps | Development LifecycleMid-level Full TimeAberdeen, Maryland14h ago
-
Site Reliability Engineer - Storage Engineer USD 98K-192KAWS | Ansible | Bash | CI/CD | Ceph401k retirement plan | Dental insurance | Employee Assistance Program (EAP) | Employee Health Insurance | Hybrid work optionsSenior-level Full TimeAustin, Texas, United States R14h ago
-
Analytics, Finance & Strategy USD 270K-320KAWS | Airflow | Business Intelligence | DBT | DashboardingFlexible working hours | Generous vacation | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA14h ago
-
Edge AI/Model Optimization Engineer USD 115K-175KBatching | Benchmarking | CUDA | Caching | ContainersMid-level Full TimeAberdeen, Maryland14h ago
-
AI Engineer (Research & Development) USD 148K-225KAI Platform | AWS SageMaker | Autogen | Azure Machine Learning | CrewAIAdditional PTO | Nutritionist support | Paid medical/dental/vision | Paid time off | Workout lunchesSenior-level Full TimeRaleigh, NC14h ago