Senior Software Engineer, ML Infrastructure
Tasks
- Build evaluation and experimentation infrastructure
- Design and build distributed training platforms
- Drive technical direction and mentor engineers
- Establish best practices for ML infrastructure
- Improve latency and cost efficiency across training and serving
- Integrate training algorithms into production pipelines
- Own inference architecture and multi provider routing
Perks/Benefits
Skills/Tech-stack
Cost Optimization | Distributed Training | Experimentation | Fault Tolerance | GPU clusters | Inference Optimization | Inference Serving | Language Models | Large Language Models | Latency optimization | Machine Learning | Model Evaluation | Multimodal
Education
N/A
Regions
Countries
States
Related jobs
-
Click Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Data ModelingMid-level Full TimeSan Jose, California, United States3h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud USD 183K-265KAccelerators | C++ | Cloud Architecture | Data Pipelines | Distributed TrainingTravelSenior-level Full TimeAddison, TX, USA; Washington D.C., DC, …4h ago
-
C++ | Data Structures | Data structures algorithms | Debugging | Google CloudMid-level Full TimeSunnyvale, CA, USA4h ago
-
C++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA4h ago
-
Senior Software Engineer, AI/ML USD 174K-252KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA4h ago
-
Forward Deployed Engineer, Applied AI, Google Cloud USD 127K-183KAPI | CRM | Cloud platform | Conversational AI | Conversational agentsHigh-impact role | Opportunity to lead technical delivery | Travel up to 50 percentMid-level Full TimeNew York, NY, USA; Atlanta, GA, …4h ago
-
Software Engineer, AI System Hacker, GenAI, DeepMind USD 174K-252KArtificial Intelligence | C++ | CSS | Data Visualization | Generative AIMid-level Full TimeMountain View, CA, USA4h ago
-
Agent systems | Agentic Workflows | Cloud platform | Cost Per Request | CrewAISenior-level Full TimeNew York, NY, USA; Addison, TX, …4h ago
-
Software Engineer, Applied AI USD 147K-211KAI Agents | Cloud infrastructure | Data Processing | Debugging | Generative AIMid-level Full TimeSunnyvale, CA, USA4h ago
-
Senior Software Engineer, Generative AI USD 174K-252KAgent Development | Agent Development Kit | Agent-based | Agent-based systems | Cloud ComputingSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Machine Learning Engineer USD 138K-183KAWS | Airflow | Amazon Redshift | Amazon SageMaker | Apache Flink401k retirement savings | Health care insurance | Occasional travel for meetings | Paid parental leave | Paid sick timeMid-level Full TimeRemote - US R12h ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | DBT | Data Governance | Data Modeling | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R14h ago
-
Database Engineer USD 162K-203KAWS | Backup and Restore | C++ | Cost Optimization | Data WarehouseCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY15h ago
-
Software Engineer - Voice AI (Inference Runtime) USD 165K-330KAPI Development | CLI Development | Docker | Kubernetes | Language Processing401k matching | Fertility and family building stipend | Flexible PTO | Medical, dental, and vision insurance | Paid parental leaveSenior-level Full TimeSan Francisco16h ago
-
AI Search | AWS | AWS Bedrock | Azure | Azure AI401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States16h ago
-
Full Stack Software Engineer, Applied AI USD 140K-140KAPI Design | Alerting | CI/CD | Cloud infrastructure | DevOpsFlexible PTO | Health insurance | Mental wellness days | Paid Holidays | Parental leaveMid-level Full TimeSan Francisco16h ago
-
Staff Machine Learning Engineer, Developer Platform USD 230K-322KA/B | A/B Testing | AWS | Automation | B testingCoaching benefits | Comprehensive healthcare benefits | Employer 401k match | Family planning support | Flexible vacationSenior-level Full TimeRemote - United States R16h ago
-
Autonomy and Robotics Software Engineer USD 125K-220KC++ | CI/CD | Classification | Computer Vision | Dataset versioningE-Verify enrollment | Health insurance | Professional development | Retirement plansMid-level Full TimeHuntington Beach17h ago
-
Autonomy and Robotics Software Engineer USD 125K-220KC++ | CI/CD | Embedded Systems | Fault detection | GNSSHealth insurance | Professional development | Retirement plansMid-level Full TimeHuntington Beach17h ago
-
Forward Deployed Engineer - Applied AI USD 150K-210KAPI Development | Artificial Intelligence | Automation | Deployment | JavaScriptFast-paced team | High ownership culture | High-impact work | Travel opportunitiesSenior-level Full TimeGallup, New Mexico, United States; Michigan, …17h ago
-
Early Career Software Engineer – Applied AI USD 100K-120KAWS | Cloud Computing | Cloud platform | Google Cloud | Google Cloud PlatformFlexible PTO | Lunch covered | Mental wellness days | Parental leave | Wellness reimbursementsEntry-level Full TimeSan Francisco17h ago
-
Chaos Engineering | Distributed Systems | Fault injection | Linux | Load TestingFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA18h ago
-
Early Career - AI Solutions Engineer USD 95K-203KAccuracy Monitoring | Agents | C++ | CNN | CalculusEntry-level Full TimeDallas, TX, United States18h ago
-
Sr. Solutions Engineer - MFG USD 152K-209KAmazon Web Services | Artificial Intelligence | Azure | Big Data | Cloud ComputingSenior-level Full TimeBoston, Massachusetts19h ago
-
ML Runtime Optimization Engineer USD 159K-199KCPU | CUDA | Deep learning | Embedded Systems | GPU401k match | Dental insurance | Disability insurance | Health insurance | Learning stipendSenior-level Full TimeSunnyvale, California, United States19h ago