Machine Learning Infrastructure Engineer
Tasks
- Build high-performance inference services
- Configure autoscaling
- Design ML inference platforms
- Develop caching strategies
- Implement observability with metrics tracing and logging
- Implement request routing and batching
- Operate production inference systems
- Optimize GPU utilization
- Perform incident response for production services
Perks/Benefits
Skills/Tech-stack
Autoscaling | Batching | C++ | Caching | Capacity Planning | Distributed Systems | FinOps | GPU Architecture | Go | Incident Response | Kubernetes | Metrics | Model Compression | Model Inference | Observability | Performance Engineering | Python | Quantization | Request Routing | Rust | Structured Logging | TensorRT-LLM | Tracing | VLLM
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Senior Software Engineer - Machine Learning (Remote US) USD 230K-270KAI workflows | APIs | Backend Development | Cloud Native | Context engineeringRemote workSenior-level Full TimeUSA R15h ago
-
Lead Machine Learning Engineer USD 172K-276KAWS | Azure | CI/CD | Databricks | Distributed SystemsFlexible autonomy | Learning and development programs | MentorshipSenior-level Full TimeChicago, Illinois, USA R18h ago
-
Application Insights | Azure | Azure Monitor | BeautifulSoup | CI/CD401k | Dental insurance | Educational assistance | Health insurance | Open to remoteMid-level Full TimeNew York, United States R19h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated testing | CI/CD | Data Versioning | Experimental Design | MLOpsDiscretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R20h ago
-
Principal Engineer, Data & ML Infrastructure USD 200K-275KAWS | Cloud Computing | Data Mining | Data Processing | Data Warehousing401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimeBoston, Massachusetts, United States; Pittsburgh, Pennsylvania, … R20h ago
-
Data Analytics Engineer USD 139K-230KAWS | Azure | Azure Data | Azure Data Lake | Cloud platformDEI initiatives | Dental insurance | Medical insurance | Mental health support | Remote workSenior-level Full TimeRemote, United States R21h ago
-
Data Engineer USD 126K-208KAPI Integration | APIs | AWS | Amazon Redshift | Apache AirflowDEI initiatives | Dental insurance | Employee recognition program | Medical insurance | Mental health supportMid-level Full TimeRemote, United States R21h ago
-
Data Engineer (Healthcare) USD 105K-130KAWS | AWS Redshift | Apache Airflow | Azure | Azure DataKnowledge sharing | Mentoring | Quarterly travel | Remote workMid-level Full TimeUSA, Remote; USA, Remote; USA, Remote R22h ago
-
API Design | Atomics | Concurrency | Distributed Systems | Generative AIHome office setup | Internet stipend | Learning and development budget | Paid Holidays | Professional membershipsSenior-level Full TimeUnited States or Canada, Remote Opportunity R22h ago
-
Staff Embedded Engineer, Android OS USD 185K-273KAOSP | Android OS | Android Open Source | Android Open Source Project | C++401k contribution | Dental insurance | Disability insurance | Health insurance | Hybrid workSenior-level Full TimeHybrid - Austin, Texas; Hybrid - … R23h ago
-
Senior AI Product Builder, Inventory Optimization USD 151K-251KAPI Design | Artificial Intelligence | Data Contracts | Data Modeling | Demand forecasting401k match | Basic life insurance | Flexible time off | Medical/Dental/Vision insurance | Paid HolidaysSenior-level Full TimeRemote - United States R1d ago
-
Senior Machine Learning (ML) Engineer (AI Insurtech) USD 190K-225KBigQuery | Dagster | Data Analysis | Data Modeling | Exploratory Data Analysis401k matching | ADandD insurance | Catered lunches | Dental insurance | Family benefitsSenior-level Full TimeNew York, NY or Remote R1d ago
-
Senior Sales Engineer - Bay Area USD 149K-198KAPM | AWS | Artificial Intelligence | Cloud platform | Developer experienceCareer pathing | Community guilds | Continuous professional development | Employee Stock Purchase Plan (ESPP) | Fitness reimbursementsSenior-level Full TimeCalifornia, USA, Remote R1d ago
-
Senior HPC and Quantum Systems Engineer USD 224K-431KAPI Integration | C++ | CUDA | CUDA-Q | CuQuantumSenior-level Full TimeUS, MA, Westford R1d ago
-
Data Engineer (2258) USD 119K-150KAWS | Azure | Data Visualization | Docker | ETL401k | Dependent care | Discounted tickets and entertainment perks | Flexible work schedule | Medical insuranceMid-level Full TimeNew York, New York, United States R1d ago
-
Senior-level Full TimeUSA R1d ago
-
Mid-level Full TimeBay Area - Hybrid R1d ago
-
Mid-level Full TimeNYC - Hybrid R1d ago
-
Founding AI Engineer (Senior/Staff) - VC Backed Startups USD 170K-250KAWS | Airflow | Apache Spark | Azure | Azure MLSenior-level Full TimeNYC - Hybrid R1d ago
-
Principal AI/ML Engineer - VC Backed Startups USD 170K-270KAirflow | Amazon SageMaker | Apache Spark | Azure Machine Learning | Cloud ComputingTalent network visibilitySenior-level Full TimeBay Area - Hybrid R1d ago
-
Principal AI/ML Engineer - VC Backed Startups USD 170K-270KAWS SageMaker | Apache Airflow | Apache Kafka | Apache Spark | Azure Machine LearningTalent network visibilitySenior-level Full TimeNYC - Hybrid R1d ago
-
Founding AI Engineer (Senior/Staff) - VC Backed Startups USD 170K-250KAWS | Airflow | Apache Spark | Azure | Azure MLProfile sharing with portfolio companies | Talent network access | Visibility to early stage AI rolesSenior-level Full TimeBay Area - Hybrid R1d ago
-
Data Engineer - Clearance Required USD 101K-174KAPI | Access Control | Access Management | Auditing | Continuous integrationSenior-level Full TimeRemote, United States R1d ago
-
Security Engineer, AI USD 80K-120KAdversarial Attacks | Ansible | Bash | Compliance | Container SecurityBirthday Bonus Day | Health & wellness days | Holiday and Vacation Time | Medical, dental & vision coverage | Remote workSenior-level Full TimeUnited States R1d ago