Research Scientist - Distributed Machine Learning
Tasks
- Analyze numeric stability and accuracy versus speed
- Apply kernel fusion communication tuning and memory optimization
- Build and scale distributed pretraining frameworks
- Build logging metrics and experiment tracking tools
- Convert prototypes into CUDA and Triton kernels
- Create launch scripts resilient checkpoints and job monitoring
- Design ablation studies and statistical tests
- Implement custom gradients and tests
- Implement distributed debugging for gradient synchronization and collective operations
- Lead mixed precision training bf16 and fp8
- Mentor interns and junior engineers through code reviews and design docs
- Productionize PyTorch and JAX pretraining stack
- Prototype optimizers and attention methods
- Set up DeepSpeed FSDP and Megatron-LM across multi node GPU clusters
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Employee assistance program
- Health insurance
- Life insurance
- Paid Holidays
- Paid parental leave
- Paid sick leave
- Paid time off
- Visa sponsorship
- Vision insurance
Skills/Tech-stack
BF16 | CUDA | CUDA kernels | DeepSpeed | Distributed Training | Experiment tracking | FP8 | FSDP | Flax | GLOO | JAX | Kernel Fusion | Kubernetes | Logging | Megatron | Megatron-LM | Metrics | Mixed Precision | Mixed-precision training | NCCL | NumPy | Numerical Stability | PyTorch | Ray | Slurm | Triton
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Regions
Countries
States
Cities
Related jobs
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …5h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA5h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA5h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA5h ago
-
Research Scientist, Adaptive Compute, DeepMind USD 174K-253KDeep learning | Generative AI | JAX | Language Models | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …5h ago
-
C++ | Containers | Distributed Systems | Distributed Training | Distributed inferenceSenior-level Full TimeCupertino10h ago
-
Senior Data Scientist, Credit USD 120K-135KAirflow | BentoML | Code review | DVC | Data Engineering401k match | Calm app subscription | Dental insurance | Disability coverage | Flexible scheduleSenior-level Full TimeRemote, United States R11h ago
-
Senior-level Full TimeUnited States11h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States14h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States16h ago
-
Machine Learning Engineer, Sensor Pipelines USD 175K-215KC++ | Computer Vision | JAX | Machine Learning | PyTorchHybrid work scheduleMid-level Full TimeMountain View, CA, USA16h ago
-
AI Engineer (Temporary) USD 85K-95KAWS | Agents SDK | Anthropic API | Azure | Data RiskAccess to training and enablement resources | Hybrid work environment | Temporary contract with benefitsEntry-level Full Time TemporaryIthaca (Main Campus), United States16h ago
-
AIML - Sr Data Scientist, Evaluation USD 166K-296KDashboards | Data Analysis | Data Governance | Data Pipelines | Data ProcessingCollaborative environment | Cross-functional collaboration | Data privacy focusSenior-level Full TimeCupertino17h ago
-
Data Scientist USD 168K-297KA/B | A/B Testing | Agentic AI | Airflow | Attribution ModelingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …17h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States17h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States18h ago
-
Software Engineer, ML Platform (ML Training) USD 175K-265KAWS | Computer Vision | DeepSpeed | Distributed Training | JAXMid-level Full TimeFoster City, CA18h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R19h ago
-
Machine Learning Research Engineer, App Store Search USD 185K-313KA/B | A/B Testing | Apache Spark | B testing | Fine TuningMid-level Full TimeSeattle20h ago
-
Principal Machine Learning Engineer USD 126K-264KCode review | Continuous Delivery | Continuous integration | Data Preprocessing | Data Privacy401k match | Adoption Assistance | Dental insurance | Health insurance | Life insuranceSenior-level Full TimeSeattle, WA, United States20h ago
-
Machine Learning Engineer - Vision USD 160K-250KActive Learning | Annotation tools | CAD/CAM | Computer Vision | Image Segmentation401k | Dental insurance | Equity | Flexible vacation | Health insuranceSenior-level Full TimeLos Angeles, CA20h ago
-
Machine Learning Engineer - Multimodal USD 160K-250KActive Learning | Computer Vision | Data Augmentation | Data loaders | Evaluation Frameworks401k | Equity | Flexible vacation policy | Medical/dental/vision/life insurance | Relocation supportSenior-level Full TimeLos Angeles, CA20h ago
-
Machine Learning Engineer - LLMs USD 160K-250KActive Learning | DPO | Data Augmentation | Data loaders | Document Classification401k | Equity | Flexible vacation policy | Medical/dental/vision/life insurance | Relocation supportSenior-level Full TimeLos Angeles, CA20h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA20h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA20h ago