Machine Learning Engineer — Training Optimization
Tasks
- Build and maintain training infrastructure for checkpointing fault tolerance reproducibility
- Collaborate with researchers on architecture aware training strategies
- Evaluate and integrate training techniques
- Improve distributed training strategies
- Optimize large scale model training pipelines
- Optimize training precision
- Own training performance metrics and improve continuously
- Reduce training time and compute cost through profiling and bottleneck analysis
- Tune optimizers schedulers and batch sizing
Perks/Benefits
- N/A
Skills/Tech-stack
BF16 | Backpropagation | Batch sizing | Checkpointing | Data parallelism | DeepSpeed | Distributed Training | FP16 | FP8 | FSDP | Fault Tolerance | Gradient Checkpointing | Learning Rate | Learning Rate Scheduling | Megatron | Mixed Precision | Model Parallelism | Neural Networks | Optimization Algorithms | Optimizers | Pipeline parallelism | Profiling | PyTorch | Reproducibility | Zero
Education
N/A
Related jobs
-
Senior Research Engineer / Scientist - Storage for LLM USD 207K-368KCUDA | Caching | Data Structures | Distributed Systems | Eviction PolicyConference attendance | Open source contributions | Research resourcesSenior-level Full TimeSeattle, Washington, United States R7h ago
-
Research Engineer / Scientist - Storage for LLM USD 153K-300KCUDA | Caching | Distributed Systems | Eviction policies | GPU ComputingConference attendance | Innovation-driven culture | Open source contributions | Research resourcesEntry-level Full TimeSeattle, Washington, United States R7h ago
-
Senior Machine Learning Engineer USD 145K-225KAPI Integration | ChromaDB | Data Pipelines | Deep learning | FaissAnnual bonuses | Corporate certification programs | Home internet support | Hybrid work model | Medical insuranceSenior-level Full TimeDhaka, Bangladesh R11h ago
-
Senior AI Engineer DKK 651K-840KCloud platform | Computer Vision | Deep generative models | Embeddings | Generative ModelsComprehensive onboarding | Internal training | Social events | Staff discounts | Work from homeSenior-level Full TimeBrabrand, Denmark R13h ago
-
Agent Orchestration | Agent SDK | Automated testing | CI/CD | Claude Agent SDKHybrid work environmentMid-level Full TimeMontreal 700, Canada R19h ago
-
Staff Machine Learning Engineer, Traffic Intelligence USD 212K-265KBayesian Calibration | Bayesian Inference | Calibration | Causal Inference | Data PipelinesSenior-level Full TimeUnited States R20h ago
-
Senior Machine Learning Engineer USD 150K-241KC++ | Cloud Architecture | Computer Vision | Data Privacy | EncryptionDiscretionary paid time off | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R20h ago
-
Active Learning | Auto-labeling | Computer Vision | Confidence Scores | Data BalancingBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, … R20h ago
-
Senior Machine Learning Engineer, Vehicle Perception USD 140K-230KAblation Studies | C plus plus | Cloud Computing | Computer Vision | Data CurationComprehensive benefits package | Hybrid work schedule | Incentive programsSenior-level Full TimePalo Alto, CA R22h ago
-
ASICs | C++ | CUDA | CUDA Graphs | Continuous batchingRemote workSenior-level Full TimeUnited States (Remote) R23h ago
-
Data Scientist USD 90K-120KAWS | Agentic AI | Azure | Cypress | Data Analysis401k employer contribution | Remote work optionMid-level Full TimeRemote, USA R1d ago
-
AI Engineer (Remote) USD 169K-230KAWS | Agent systems | Application development | Automation | Azure401k plan | Accident insurance | Dental insurance | Disability insurance | Flexible spending accountExecutive-level Full TimeFort Washington, PA, United States R1d ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Machine Learning | CI/CDRemote | USC OnlySenior-level Full TimeDallas, TX. R1d ago
-
Senior Machine Learning Engineer CAD 150K-188KAdvertising Auctions | Airflow | Automated retraining | BigQuery | Convolutional Neural Networks401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - Ontario, Canada R1d ago
-
Senior Machine Learning Engineer USD 216K-303KAd Ranking | Convolutional Neural Networks | Data Pipelines | Deep learning | Feature Engineering401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Health care benefitsSenior-level Full TimeRemote - United States R1d ago
-
Senior Machine Learning Engineer (NLP/LLMs) PLN 276K-396KAsynchronous programming | Deep learning | FastAPI | Flask | Hugging Face26 days off | Company supported courses | Conference budget | Ebook audiobook service access | English language classesSenior-level Full TimeRemote job R1d ago
-
AI Engineer INR 450K-700KData Preprocessing | Deep learning | Language Processing | MLOps | Machine LearningCareer development | Hybrid work flexibilityExecutive-level Full TimeNoida, India R1d ago
-
Machine Learning Engineer USD 139K-225KData Analysis | Deep learning | Java | Large Datasets | Machine LearningSenior-level Full TimeRemote job R1d ago
-
Tech Lead — ASR / TTS / Speech LLM (IC + Mentor) SGD 60K-130KAGC | Active Learning | Activity Detection | Automatic Speech Recognition | CTCHIPAA compliant environment | Healthcare domain impact | Mentorship | SOC 2 aligned operationsSenior-level Full TimeSingapore R1d ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R1d ago
-
Agent systems | Deep learning | Embeddings | Fine Tuning | Function CallingContinuous learning | Networking opportunities | Professional development opportunities | Work from homeEntry-level Full TimeAsia R1d ago
-
Senior Machine Learning Engineer, Ads ML Platform USD 216K-303KAnomaly Detection | Data Governance | Data Infrastructure | Data Lineage | Data Storage401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible remote workSenior-level Full TimeRemote - United States R1d ago
-
ML Engineer CAD 160K-180KA/B | A/B Testing | Anomaly Detection | B testing | BigQueryDental insurance | Health insurance | Hybrid work environment | Vision insuranceMid-level Full TimeVancouver R1d ago
-
AI/ML Computer Science Research and Development Engineer USD 121K-231KAdversarial Machine Learning | Benchmarking | Computer Vision | Convolutional Neural Networks | Data PreprocessingSenior-level Full TimePenn State University Park, United States R1d ago
-
Senior Performance Engineer GBP 144K-216KAutomation | Benchmarking | C++ | CUDA | Computer ArchitectureSenior-level Full TimeRemote - UK R1d ago