Technical Lead Manager, Machine Learning Runtime & Serving
Mountain View, California
USD 251K-310K Senior-level Full Time
Tasks
- Architect ML runtime systems for edge and cloud
- Build distributed low latency fault tolerant backend systems
- Design profiling and benchmarking infrastructure
- Develop hardware aware performance optimizations
- Extend ML compilers and runtimes
- Guide technical vision for ML infrastructure
- Identify triage and eliminate ML stack bottlenecks
- Manage and grow engineering team
- Optimize real time latency and memory usage
- Partner with ML researchers on system workloads
- Transition ML workloads to JAX native runtime
Perks/Benefits
Skills/Tech-stack
Distributed Systems | Fault Tolerance | GPU Computing | JAX | Low Latency | Low-Latency Systems | Machine Learning | ONNX Runtime | OpenXLA | PJRT | Python | TPU | TVM | TensorRT
Education
Regions
Countries
States
Language: en
Views: 2
Clicks: 0
Saves: 0
Related jobs
-
AI Software Engineer USD 91K-169KAgile | Bash | C++ | Cloud Computing | Containers401k match | Dental insurance | Education assistance | Employee assistance program | Flexible schedulesMid-level Full TimeManassas, VA, US16h ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R19h ago
-
AI/ML Solutions Engineer USD 139K-200KAI Explainability | AWS Glue | AWS SageMaker | AWS Step Functions | Amazon AthenaMid-level Full TimeMiami Lakes, FL, United States20h ago
-
Principal Machine Learning Engineer USD 240K-420KAgent systems | Architecture | C plus plus | Compliance | Deep learning401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R22h ago
-
Agent architecture | Benchmarking | Biomedicine | Context engineering | Data integrationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R22h ago
-
Staff Applied AI Inference Engineer USD 185K-225KC++ | CUDA | Docker | High Throughput | KubernetesCommuter benefits | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeDenver, CO - US22h ago
-
Senior Manager, AI Engineering & Platform USD 118K-145KAI-assisted software development | API Integration | AWS | Authentication | Backup and Recovery401k | Continuous professional development | Entrepreneurial culture | Health, dental, and vision | Minimal travelSenior-level Full TimeOverland Park, KS R23h ago
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R1d ago
-
Senior Data Engineer- People Analytics USD 180K-207KAccess Control | Airflow | Amazon Redshift | CI/CD | Cloud platformSenior-level Full TimeUnited States R1d ago
-
Senior Engineering Manager-People Analytics USD 175K-201KAI | Access Controls | Airflow | CI/CD | DBTSenior-level Full TimeUnited States R1d ago
-
Artificial Intelligence | Big Data | Cloud Computing | Machine Learning | Model Based Systems EngineeringTS/SCI clearanceSenior-level Full TimeChantilly, Virginia, United States; Springfield, Virginia, …1d ago
-
Staff Software Engineer, Applied AI USD 200K-260KDataset curation | FastAPI | Golden datasets | Langchain | Langgraph401k retirement plan | Annual learning and development stipend | Employer HSA contribution | Equity incentive plan | Flexible vacation policySenior-level Full TimeU.S. Remote R1d ago
-
Semantic AI Engineer USD 158K-202KAPI | CI/CD | Data integration | Entity Resolution | FAIR-Data401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimeNorth Chicago, IL, United States1d ago
-
Software Engineer II, Big Data, tvScientific USD 123K-254KAPIs | AWS | Access Controls | Apache Iceberg | Apache SparkFlexible work modelMid-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Mid-level Full Time10 Park Plaza, Boston1d ago
-
Principal Engineer, AI Architect USD 190K-210KCloud Architecture | Cloud Native | Conversational AI | Data analytics | Enterprise Architecture401k retirement plan | Development resources | Employee assistance program | Employee stock purchase program | Flexible paid time offSenior-level Full TimeNew York, New York R1d ago
-
Principal Engineer, AI Architect USD 190K-210KCloud Architecture | Conversational AI | Data analytics | Enterprise SaaS | GCP401k retirement plan | Employee assistance program | Employee stock purchase program | Flexible paid time off | Fully remoteSenior-level Full TimeNew York, New York R1d ago
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R1d ago
-
AI Engineer Co-Op USD 60K-68KAI output evaluation | Agentic Frameworks | Azure OpenAI | Data Engineering | Fine Tuning401k | Disability insurance | Family support services | Health insurance | Life insuranceMid-level Full TimeBoston, MA1d ago
-
AWS | Bitbucket | Confluence | Data Analysis | Eclipse401k employer contribution | Direct contribution to 401k vesting | Educational assistance | Federal Holidays | Healthcare benefitsSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …1d ago
-
Software Engineer 1 - (Python, UI/UX, LLM) USD 169K-207KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Healthcare coverage | PTOMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 241K-295KAI Agents | APIs | Backend Development | Data Pipelines | Docker401k matching | Education assistance | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland1d ago
-
Cloud Software Engineer 3 - (Cloud, Hadoop, Java) USD 228K-278KAnsible | Apache Kafka | Apache Lucene | Apache Solr | Avro401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeFort Meade, Maryland R1d ago
-
Part Time Student - Robotics Engineer - Ames, IA USD 30K-80KArduino | C plus plus | Computer Vision | Data Analysis | JavaAdoption Assistance | Employee assistance programs | Fitness subsidies | Flexible work arrangements | Healthcare benefitsEntry-level Part TimeAmes, IA,Iowa,United States1d ago
-
AI Engineer USD 80K-100KAI | API Development | Cloud infrastructure | Database Design | GitHub401k retirement plan | Employee assistance program | Health Spending Account HSA | Life insurance | Long-term disabilityMid-level ContractOmaha, Nebraska, USA R1d ago