Senior Machine Learning Engineer (Inference Platform)
Tasks
- Build production ML pipelines
- Define serving SLAs
- Develop observability monitoring alerting
- Ensure security scalability resiliency
- Implement model versioning rollout rollback
- Improve serving architecture performance reliability scalability
- Integrate CI CD testing
- Optimize inference performance
- Own inference platform lifecycle
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alerting | CI/CD | Continuous batching | Data Processing | Deployment | Experimentation platforms | GPU Memory Optimization | GPU memory | Google Cloud | Hardware acceleration | Inference | KV cache | Low Latency | Low-Latency Systems | MLOps | Machine Learning | Memory Optimization | Microsoft Azure | Model Registry | Model versioning | Monitoring | Observability | Performance Profiling | Python | Quantization | SGLang | Scalability | Secure Systems | TensorRT-LLM | Testing | Text Generation | Text generation inference | VLLM
Education
Related jobs
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R2h ago
-
Staff Data Engineer, Ads USD 248K-279KAPI Integration | Airflow | Alerting | Anomaly Detection | BigQuerySenior-level Full TimeRemote (U.S.) R9h ago
-
A/B | A/B Testing | AWS | Alerting | B testingAnnual refresh grants | Equity grant | Flex First Work Options | On-call rotation | Remote workSenior-level Full TimeUnited States - Remote R12h ago
-
Staff Data Engineer- Data Lake USD 170K-190KAWS | AWS EMR | AWS Glue | Airflow | Amazon AthenaFlexible work hours | Health insurance | Paid time off | Retirement options | Wellness holidaysSenior-level Full TimeNew York R14h ago
-
Staff Data Engineer - Emerald USD 170K-190KAWS | Amazon EMR | Amazon Redshift | Amazon S3 | Apache AvroFlexible work hours | Health and charitable donation stipends | Health insurance options | Paid time off | Retirement optionsSenior-level Full TimeNew York R14h ago
-
Senior-level Full TimeWork from home, VA, United States R15h ago
-
Sr. Staff Machine Learning Engineer USD 170K-235KAWS | Apache Spark | Azure | CI/CD | Data Pipelines401k matching | Company equity | Free subscription | Medical/Dental/Vision | Paid HolidaysSenior-level Full TimeUSA R15h ago
-
C++ | Computer Vision | Data Association | Deep learning | Feature estimation401k match | Commuter benefits | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeDearborn, Michigan, United States, Palo Alto, … R17h ago
-
A/B | A/B Testing | B testing | CI/CD | Data PipelinesSenior-level Full TimeRemote - USA R18h ago
-
Data Engineer (Multiple Levels) USD 105K-200KAWS | Apache Spark | CI/CD | Cloud platform | Code reviewRemote work in U SMid-level Full Time1668 S. Garfield Ave. 2nd Floor, … R1d ago
-
Senior Machine Learning Engineer USD 133K-245KAPI Design | Artificial Intelligence | Containerization | Data Pipelines | Data Processing401k matching | Fertility benefits | Health insurance coverage | Lifestyle spending account | Mental health benefitsSenior-level Full TimeMenlo Park, CA R1d ago
-
Machine Learning Engineer USD 161K-200KA/B | A/B Testing | B testing | Kafka | Kubernetes401k matching | Disability insurance | Employer-paid life insurance | Fertility benefits | Health insuranceSenior-level Full TimeBellevue, WA R1d ago
-
Data Engineer USD 111K-204KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeContinuous learning | Employee ownership | Inclusive culture | Mentorship | Remote workSenior-level Full TimeRemote - VA, United States R1d ago
-
API Design | Angular | Azure | CI/CD | CSS3Mid-level Full TimeRemote Location, United States R1d ago
-
API Design | AWS | Algorithms | Amazon SQS | AzureFlexible time off | Healthcare benefits | Hybrid work model | Leave benefits | Retirement benefitsSenior-level Full TimeSF4-San Francisco - 400 Howard Street, … R1d ago
-
Applied AI Engineers USD 151K-332KASR | Barge In | CRM Integrations | Evaluation Frameworks | GoHybrid work | Remote work optionsMid-level Full TimeRemote (US), United States R1d ago
-
Manager, Applied AI Engineer USD 171K-375KAI/ML | ASR | Barge In | CRM | Enterprise IntegrationsCommunity impact | Employee benefits | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (US), United States R1d ago
-
Data Engineer USD 100K-138K800-53 | API Integration | AWS GovCloud | Agile | Automated testing401k matching | Healthcare benefits | Life insurance | Paid Holidays | Paid time offMid-level Full TimeUnited States - Remote R1d ago
-
Data Engineer - Healthcare USD 97K-133KArtificial Intelligence | Azure | Big Data | Cause analysis | DBT401k retirement savings plan | Life insurance | Long-term disability | Medical, dental, vision benefits | Occasional travel for training or meetingsSenior-level Full TimeRemote US, United States R1d ago
-
Lead Machine Learning Engineer - REMOTE USD 30K-190KAWS SageMaker | Batch inference | Data Quality | Drift Detection | Experiment tracking401k matching | Healthcare benefits | Paid parental leave | Personal day | Remote work scheduleSenior-level Full TimeBoston MA - Virtual, United States R1d ago
-
Principal MLOps Engineer USD 142K-196KAWS | Apache Airflow | Authority to Operate | Automated Deployment | Automated deployment pipelinesComprehensive healthcare benefits | Onsite onboarding travel up to 10 percent domestic | Paid time off | Remote work | Retirement benefitsSenior-level Full TimeRemote - Pennsylvania, United States R1d ago
-
Senior AI Engineer USD 216K-277KAWS | Agent systems | Autonomous Agents | Azure | By DesignCareer development | Home workspace stipend | MacBook provided | Medical, dental, and vision insurance | Mental health benefitsSenior-level Full TimeAustin, TX R1d ago
-
Data Engineer USD 130K-160KAWS | Change Data Capture | DBT | Data Capture | Data GovernanceEmployer-matched 401k | Employer-paid health insurance | Health & Wellness reimbursements | PTO | Paid HolidaysSenior-level Full TimeRemote (United States) R1d ago
-
Data Engineer I IS - Remote USD 104K-208KAPI Integration | Alerting | Bash | CDC | CI/CD401k with employer matching | Comprehensive benefits package | Health insurance (medical, dental, vision) | Paid parental leave | Paid time offEntry-level Full TimeRenton, WA, United States R1d ago
-
Senior Data Engineer USD 135K-165KAmazon Kinesis | Amazon Redshift | Apache Airflow | Apache Iceberg | Apache Kafka401k | Healthcare benefits | Paid time offSenior-level Full TimeVirtual, United States R1d ago