Research Scientist - Distributed Machine Learning
Tasks
- Analyze numeric stability and accuracy versus speed
- Apply kernel fusion communication tuning and memory optimization
- Build and scale distributed pretraining frameworks
- Build logging metrics and experiment tracking tools
- Convert prototypes into CUDA and Triton kernels
- Create launch scripts resilient checkpoints and job monitoring
- Design ablation studies and statistical tests
- Implement custom gradients and tests
- Implement distributed debugging for gradient synchronization and collective operations
- Lead mixed precision training bf16 and fp8
- Mentor interns and junior engineers through code reviews and design docs
- Productionize PyTorch and JAX pretraining stack
- Prototype optimizers and attention methods
- Set up DeepSpeed FSDP and Megatron-LM across multi node GPU clusters
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Employee assistance program
- Health insurance
- Life insurance
- Paid Holidays
- Paid parental leave
- Paid sick leave
- Paid time off
- Visa sponsorship
- Vision insurance
Skills/Tech-stack
BF16 | CUDA | CUDA kernels | DeepSpeed | Distributed Training | Experiment tracking | FP8 | FSDP | Flax | GLOO | JAX | Kernel Fusion | Kubernetes | Logging | Megatron | Megatron-LM | Metrics | Mixed Precision | Mixed-precision training | NCCL | NumPy | Numerical Stability | PyTorch | Ray | Slurm | Triton
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Regions
Countries
States
Cities
Related jobs
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …1h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA2h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA2h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA2h ago
-
Research Scientist, Adaptive Compute, DeepMind USD 174K-253KDeep learning | Generative AI | JAX | Language Models | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …2h ago
-
Senior Data Scientist, Credit USD 120K-135KAirflow | BentoML | Code review | DVC | Data Engineering401k match | Calm app subscription | Dental insurance | Disability coverage | Flexible scheduleSenior-level Full TimeRemote, United States R8h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States12h ago
-
Machine Learning Engineer, Sensor Pipelines USD 175K-215KC++ | Computer Vision | JAX | Machine Learning | PyTorchHybrid work scheduleMid-level Full TimeMountain View, CA, USA13h ago
-
AIML - Sr Data Scientist, Evaluation USD 166K-296KDashboards | Data Analysis | Data Governance | Data Pipelines | Data ProcessingCollaborative environment | Cross-functional collaboration | Data privacy focusSenior-level Full TimeCupertino13h ago
-
Data Scientist USD 168K-297KA/B | A/B Testing | Agentic AI | Airflow | Attribution ModelingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …14h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States14h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States14h ago
-
Software Engineer, ML Platform (ML Training) USD 175K-265KAWS | Computer Vision | DeepSpeed | Distributed Training | JAXMid-level Full TimeFoster City, CA14h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R16h ago
-
Machine Learning Research Engineer, App Store Search USD 185K-313KA/B | A/B Testing | Apache Spark | B testing | Fine TuningMid-level Full TimeSeattle16h ago
-
Principal Machine Learning Engineer USD 126K-264KCode review | Continuous Delivery | Continuous integration | Data Preprocessing | Data Privacy401k match | Adoption Assistance | Dental insurance | Health insurance | Life insuranceSenior-level Full TimeSeattle, WA, United States16h ago
-
Machine Learning Engineer - Vision USD 160K-250KActive Learning | Annotation tools | CAD/CAM | Computer Vision | Image Segmentation401k | Dental insurance | Equity | Flexible vacation | Health insuranceSenior-level Full TimeLos Angeles, CA16h ago
-
Machine Learning Engineer - Multimodal USD 160K-250KActive Learning | Computer Vision | Data Augmentation | Data loaders | Evaluation Frameworks401k | Equity | Flexible vacation policy | Medical/dental/vision/life insurance | Relocation supportSenior-level Full TimeLos Angeles, CA16h ago
-
Machine Learning Engineer - LLMs USD 160K-250KActive Learning | DPO | Data Augmentation | Data loaders | Document Classification401k | Equity | Flexible vacation policy | Medical/dental/vision/life insurance | Relocation supportSenior-level Full TimeLos Angeles, CA16h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA17h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA17h ago
-
Machine Learning Engineer III, Core Agents USD 175K-219KAWS Bedrock | Amazon SageMaker | Embedding Models | Evaluation | IndexingSenior-level Full TimeRedwood City, CA18h ago
-
Sr. AI/ML Engineer II (6707) USD 210K-253KAWS | Anaconda | CI/CD | Containerization | Data analytics401k match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, vision insurance | Paid time offMid-level Full TimeTysons Corner, VA18h ago
-
LA Kings - Sr. Data Engineer USD 111K-135KAlerting | Apache Spark | Batch Processing | Cost Optimization | Data GovernanceSenior-level Full TimeEl Segundo, CA18h ago
-
Staff Data Engineer - Data Engineering USD 207K-275KAccess Control | Apache Fluss | Apache Hudi | Apache Iceberg | Apache Paimon401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTOSenior-level Full TimeLivingston, NJ / New York, NY …18h ago