Lead Machine Learning Engineer, Inference & Performance
Tasks
- Configure autoscaling for serving
- Deploy LLM models in production
- Handle mixed workloads gracefully
- Identify training bottlenecks
- Implement batching and quantization
- Improve throughput per dollar
- Manage KV cache strategies
- Measure GPU utilization
- Minimize latency
- Operate models on GPU clusters
- Optimize LLM inference
- Optimize attention implementations
- Profile training runs
- Translate client requirements into AI architectures
- Tune LLM serving throughput
Perks/Benefits
- 401k employer match
- Bereavement leave
- Comprehensive health insurance
- Employee referral bonuses
- Paid Holidays
- Paid leave
- Parental leave
- Sick leave
Skills/Tech-stack
Attention Mechanism | Batching | CUDA | Data Engineering | FlashAttention | GKE | GPU Architecture | Google Cloud | KV cache | Kubernetes | Profiling | Python | Quantization | SGLang | SQL | Shell Scripting | VLLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R12d ago
-
AI | Autonomous Systems | C++ | Computer Vision | DockerContinuous learning | Fully remote | Knowledge sharing | Opportunity to contribute to open-source projectsSenior-level Full TimeBrazil R3h ago
-
AWS | Azure | CI/CD | Databricks | Databricks SQL100 percent remote within Latin America | Long term project extension potential | Professional growthSenior-level Full TimeBrazil R3h ago
-
AWS | Bash | CI/CD | Databricks | DatadogContinuous learning culture | Healthcare coverage | International collaboration opportunities | Paid parental leave | Relocation assistanceSenior-level Full TimeRomania R4h ago
-
AWS | Azure | Bash | Databricks | DatadogFully remote | Healthcare coverage | International collaboration opportunities | Paid parental leave | Relocation assistanceSenior-level Full TimeItaly R4h ago
-
AWS | Azure | Bash | CI/CD | Data pipelineFully remote work | Healthcare coverage | Inclusive culture | International collaboration opportunities | Paid parental leaveSenior-level Full TimePortugal R4h ago
-
AWS | Bash | Cloud platform | Databricks | DatadogFully remote work | Healthcare coverage | Inclusive culture | International collaboration | Paid parental leaveSenior-level Full TimeNetherlands R4h ago
-
AWS | Azure | Bash | Databricks | DatadogContinuous learning culture | Fully remote work | Healthcare coverage | International collaboration | Paid parental leaveSenior-level Full TimeIreland R4h ago
-
AWS | Alerting | Azure | Bash | CI/CDContinuous learning | Fully remote | Healthcare coverage | Inclusive culture | International collaborationSenior-level Full TimeSwitzerland R4h ago
-
AWS | Azure | Databricks | Datadog | FastAPIContinuous learning culture | Healthcare coverage | International collaboration | Paid parental leave | Relocation assistanceSenior-level Full TimeFrance R4h ago
-
AWS | Bash | CI/CD | Databricks | DatadogContinuous learning culture | Fully remote | Healthcare coverage | International collaboration opportunities | Paid parental leaveSenior-level Full TimeSpain R4h ago
-
AWS | Azure | Bash | CI/CD | Data pipelineContinuous learning | Fully remote work | Healthcare coverage | Inclusive culture | International collaboration opportunitiesSenior-level Full TimeGermany R5h ago
-
AI Solutions Engineer CAD 173K-233KAPIs | Authentication | CI/CD | Circuit Breakers | ContainersDental insurance | Employee stock purchase plan | Flexible spending accounts | Health insurance coverage | Paid time offMid-level Full TimeRemote Canada R10h ago
-
AI Solutions Engineer USD 195K-280KAPIs | Authentication | CI/CD | Containerization | DBTDental insurance | ESPP | Flexible spending accounts | Health insurance | Remote work flexibilityMid-level Full TimeRemote US R10h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeChicago, Illinois, USA R13h ago
-
Mid-level Full TimeRemote R16h ago
-
Lead Analytics Engineer CAD 160K-185KCDC | CI/CD | DBT | Data Governance | Data LineageAnnual professional development budget | Charitable donation match | Dental insurance | Flexible time off | Medical insuranceSenior-level Full TimeRemote - Ontario, Canada R16h ago
-
Lead Analytics Engineer CAD 160K-185KCDC | CI/CD | Cost Optimization | DBT | Data CatalogCharitable donation match | Dental insurance | Flexible time off | Medical insurance | Paid parental leaveSenior-level Full TimeRemote - Alberta, Canada R16h ago
-
Senior-level Full TimeRemote - United States R16h ago
-
Senior Analytics Engineer CAD 145K-165KAmazon Redshift | Automation | CDC | DBT | Data CatalogCharitable donation match | Dental insurance | Flexible time off | Medical insurance | Paid parental leaveSenior-level Full TimeRemote - Alberta, Canada R16h ago
-
Senior Analytics Engineer CAD 145K-165KAmazon Redshift | CDC | DBT | Data Catalog | Data GovernanceCharitable donation match | Dental insurance | Flexible time off | Medical insurance | Paid parental leaveSenior-level Full TimeRemote - Ontario, Canada R16h ago
-
Senior-level Full TimeRemote - United States R16h ago
-
AI DevOps & Reliability Engineer CAD 123K-160KAWS | Alertmanager | Argo CD | Bash | CI/CDHealth and wellness programs | Paid time off | Retirement planningSenior-level Full TimeRemote - Vancouver, Canada R17h ago
-
Senior-level Full TimeIND, Remote R18h ago
-
Staff Applied Scientist (Distribution Center Solutions) USD 169K-252KApproximate Dynamic Programming | Chain management | Decision analysis | Dynamic Programming | Forecasting401k match | Counseling services | Dental insurance | Flexible paid time off | Flexible workspace accessSenior-level Full TimeRemote - Ontario, Canada R18h ago