Lead Machine Learning Engineer, Inference & Performance
Tasks
- Configure autoscaling for serving
- Deploy LLM models in production
- Handle mixed workloads gracefully
- Identify training bottlenecks
- Implement batching and quantization
- Improve throughput per dollar
- Manage KV cache strategies
- Measure GPU utilization
- Minimize latency
- Operate models on GPU clusters
- Optimize LLM inference
- Optimize attention implementations
- Profile training runs
- Translate client requirements into AI architectures
- Tune LLM serving throughput
Perks/Benefits
- 401k employer match
- Bereavement leave
- Comprehensive health insurance
- Employee referral bonuses
- Paid Holidays
- Paid leave
- Parental leave
- Sick leave
Skills/Tech-stack
Attention Mechanism | Batching | CUDA | Data Engineering | FlashAttention | GKE | GPU Architecture | Google Cloud | KV cache | Kubernetes | Profiling | Python | Quantization | SGLang | SQL | Shell Scripting | VLLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Azure | Azure Cloud | Azure Data | Azure Data Factory | Azure DatabricksRemote workMid-level ContractRemote R4h ago
-
Senior Data Engineer – Data Quality & Observability |1789 MXN 911K-1300KAlerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCross-functional collaboration | Fully remote | Opportunity for ownershipSenior-level Full TimeChihuahua, Mexico R5h ago
-
Data Engineer (Snowflake & DBT) INR 1000K-2000KAgile | Airbyte | CI/CD | Change Data Capture | DBTRemote workMid-level Full TimeRemote R5h ago
-
Senior AI Engineer (m/f/d) EUR 36K-45K.NET | AI Search | AIOps | API Integration | AngularChildcare support | Coursera access | Experience days | Flexible hours | Free specialist access for health wellbeingSenior-level Full TimeGranada, AN, Spain R7h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R13h ago
-
Anthropic | Benchmarking | CI/CD | Docker | FastAPIAutonomy | Fully remote | PJ contract structureSenior-level Full TimeBrazil R14h ago
-
API documentation | Airflow | Amazon Web Services | Apache Beam | Apache SparkBirthday day off | Dental insurance | Educational support programs | Fitness and wellness partnerships | Fully remote workMid-level Full TimeBrazil R14h ago
-
Senior Machine Learning Engineer AUD 148K-210KAccess Control | Agent systems | CI/CD | Capabilities Based Access Control | Error RecoveryHealth and wellness benefits | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R19h ago
-
Staff Machine Learning Engineer AUD 140K-185KAWS | Amazon ECS | Amazon ElastiCache | Amazon S3 | Audit LoggingSenior-level Full TimeAustralia - Melbourne - Hybrid R19h ago
-
Senior Machine Learning Engineer AUD 148K-210KACID | Distributed Systems | Durable Execution | Event Sourcing | Fault ToleranceHybrid work | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R19h ago
-
API Development | Autogen | C# | C++ | Cloud PlatformsLong-term engagement | Paid Holidays | Remote work | Training and professional growthMid-level Full TimeIndia Gate, New Delhi, India - … R19h ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Automated testingDental insurance | Employee assistance program | Health and wellness programs | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R19h ago
-
Azure MLOps | Azure Machine Learning | Azure Synapse | Data Deduplication | Data GovernanceSenior-level ContractRemote R19h ago
-
Principal Data Engineer INR 3740K-5876KAirflow | Amazon Athena | Amazon EMR | Amazon Redshift | Apache FlinkHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R19h ago
-
Senior Data Engineer INR 3715K-5449KAirflow | Batch Processing | Bitbucket | CICD | Data LakesHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R19h ago
-
Senior Data Engineer INR 3715K-5449KAirflow | Batch Processing | Bitbucket | CICD | Data LakeHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R19h ago
-
Senior Backend Engineer, AI Engineering: Chat GBP 91K-115KGraphQL | Langchain | Langgraph | Performance Tuning | PostgreSQLEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workSenior-level Full TimeRemote, United Kingdom R19h ago
-
AI workflows | API Integration | Big Data | Big Data Technologies | Cloud ComputingFlexible work environment | Hybrid work | Professional development opportunities | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R19h ago
-
Lead Machine Learning Engineer CAD 156K-251KAWS | Azure | CI/CD | Cloud Computing | Cloud platformAutonomy | Career development support | Learning and development programs | Mentorship and coachingSenior-level Full TimeToronto, Canada R20h ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R20h ago
-
Alternance Data Analytics & AI (H/F) EUR 41K-55KArtificial Intelligence | Big Data | Data Science | Data analytics | Machine LearningActionnariat salarié | Mutuelle familiale avantageuse | Programme Share for You | Restaurant d'entreprise | Télétravail 2 jours par semaineEntry-level Apprenticeship Part TimeEurope, France, Ile de France, CERGY-PONTOISE R20h ago
-
Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricSenior-level Full TimeUS-FL-Remote R21h ago
-
Alerting | Audit Logging | Authentication | Debugging | EvaluationComprehensive benefits package | Equity | PTO | Remote-first cultureMid-level Full TimeManizales, Colombia R22h ago
-
Senior Data Engineer USD 126K-180KAmazon Kinesis | Apache Airflow | Apache Beam | Apache Flink | Apache Spark401k match | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R22h ago