Machine Learning Infrastructure Tech Lead
Tasks
- Build tooling and abstractions for ML production
- Build training and inference stack
- Design multi node multi GPU training systems
- Develop infrastructure benchmarks
- Evaluate and apply training and inference advancements
- Improve GPU utilization latency throughput reliability observability cost efficiency
- Lead technical direction and architecture decisions
- Optimize model serving kernels and runtimes
- Own ML infrastructure roadmap
- Perform design reviews and mentorship
Perks/Benefits
- Commuter reimbursement
- Daily lunch
- Dental insurance
- Health and wellness budget
- Health insurance
- Parental leave
- Unlimited PTO
- Vision insurance
Skills/Tech-stack
Batching | Benchmarking | CUDA | Distributed Systems | GPU Utilization | Inference Optimization | Kubernetes | Latency optimization | Model Serving | Observability | PyTorch | Python | Ray | Scheduling | TensorRT-LLM | Throughput Optimization | Training Optimization | Triton
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R28d ago
-
Algorithms | Data Structures | Debugging | Java | JavaScriptOn-site work | Top Secret clearanceSenior-level Full TimeTysons, VA4h ago
-
Applied AI Software Engineer III USD 102K-210K.NET | AI Agent | AI agent orchestration | AWS | AWS BedrockSenior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …6h ago
-
Data Engineer III USD 110K-218KAnalytics | Dashboard Development | Data Quality | Data integration | Data quality assuranceMentorship | Professional development | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States6h ago
-
AI Engineer, Agentic Systems & AI Infrastructure USD 120K-150KBigQuery | Evaluation Frameworks | GCP | Human-in-the-loop | LLM AgentsMid-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL7h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLMid-level ContractRaleigh, United States7h ago
-
Data Scientist Team Lead USD 150K-175KBig Data | Data Mining | Data Visualization | Looker | Machine LearningSenior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL7h ago
-
Data Engineer USD 125K-160KCloud Architecture | Cloud infrastructure | Data Modeling | Data Monitoring | Data QualitySenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R7h ago
-
Solution Architect/Data Engineer USD 150K-170KAPI Design | API Integration | Apache Kafka | Apache Spark | Artificial Intelligence401k match | Dental insurance | Medical insurance | Paid time off | Professional development and career advancementSenior-level Full TimeUnited States-Illinois-Wood Dale7h ago
-
Solution Architect/Data Engineer USD 150K-170KAPIs | Apache Kafka | Azure | Cloud Computing | Data Modeling401k match | Dental insurance | Medical insurance | Paid time off | Professional development opportunitiesSenior-level Full TimeUnited States-Illinois-Wood Dale8h ago
-
AI/LLM Network Software Development Engineer Graduate (High Speed Network) - 2027 Start (PhD) USD 162K-316KAI communication | Distributed Systems | High Availability | Monitoring | Network DiagnosticsEntry-level Full TimeSan Jose, California, United States8h ago
-
Alerting | Canary Deployment | Distributed Systems | High Availability | Machine LearningEntry-level Full TimeSan Jose, California, United States8h ago
-
Asynchronous execution | Benchmarking | CUDA | Cache optimization | Compilation OptimizationEntry-level Full TimeSan Jose, California, United States8h ago
-
C++ | CUDA | CUDA toolkit | Code generation | Computation SchedulingEntry-level Full TimeSan Jose, California, United States8h ago
-
Software Engineer Graduate (Data-Intelligent Creation-AI Platform-Global Vision Engineering) - 2027 Start USD 128K-316KAutomation | CI/CD | Computer Vision | Generative AI | Language ProcessingEntry-level Full TimeSan Jose, California, United States8h ago
-
Applied Machine Learning Production Engineer Graduate (AML-Production Engineer) - 2027 Start USD 128K-256KAutomation | C++ | Distributed Systems | Linux | MonitoringMentorship | Professional developmentEntry-level Full TimeSan Jose, California, United States8h ago
-
Anomaly Detection | Data Pipelines | LLM | Language Processing | Log AnalysisEntry-level InternshipSan Jose, California, United States8h ago
-
APIs | Backtesting | Cloud | Commodity markets | Data Governance401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeNew York8h ago
-
Advertising | Big Data | C++ | Data Pipelines | Distributed StorageEntry-level Full TimeSeattle, Washington, United States8h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation/Search Alliance) - 2027 Start USD 115K-177KAlgorithms | Big Data | Big Data Engineering | Data Engineering | Data StructuresEntry-level Full TimeSeattle, Washington, United States8h ago
-
Content Classification | DPO | Data Generation | Data Processing | DeepSpeedDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States8h ago
-
Algorithms | C plus plus | Causal Inference | Data Structures | DebiasingEntry-level Full TimeSan Jose, California, United States8h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Live) - 2027 Start (PhD) USD 129K-246KAdvertising | Algorithms | C++ | Causal Inference | Contrastive LearningEntry-level Full TimeSeattle, Washington, United States8h ago
-
C++ | Causal Inference | Contrastive Learning | Debiasing | Deep learningEntry-level Full TimeSeattle, Washington, United States8h ago
-
Security Engineer, Applied AI USD 147K-195KAWS | Adversarial research | Adversary simulation | Agent Orchestration | AndroidSenior-level Full TimeMenlo Park, CA | New York, …9h ago