Research Scientist - Distributed Machine Learning
Tasks
- Analyze numeric stability and accuracy versus speed
- Apply kernel fusion communication tuning and memory optimization
- Build and scale distributed pretraining frameworks
- Build logging metrics and experiment tracking tools
- Convert prototypes into CUDA and Triton kernels
- Create launch scripts resilient checkpoints and job monitoring
- Design ablation studies and statistical tests
- Implement custom gradients and tests
- Implement distributed debugging for gradient synchronization and collective operations
- Lead mixed precision training bf16 and fp8
- Mentor interns and junior engineers through code reviews and design docs
- Productionize PyTorch and JAX pretraining stack
- Prototype optimizers and attention methods
- Set up DeepSpeed FSDP and Megatron-LM across multi node GPU clusters
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Employee assistance program
- Health insurance
- Life insurance
- Paid Holidays
- Paid parental leave
- Paid sick leave
- Paid time off
- Visa sponsorship
- Vision insurance
Skills/Tech-stack
BF16 | CUDA | CUDA kernels | DeepSpeed | Distributed Training | Experiment tracking | FP8 | FSDP | Flax | GLOO | JAX | Kernel Fusion | Kubernetes | Logging | Megatron | Megatron-LM | Metrics | Mixed Precision | Mixed-precision training | NCCL | NumPy | Numerical Stability | PyTorch | Ray | Slurm | Triton
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Regions
Countries
States
Cities
Related jobs
-
Staff Machine Learning Engineer, Gen AI | Voice & Speech USD 150K-220KBigtable | Cloud Computing | Cloud Native | Cloud-native infrastructure | Data integrationRemote US basedSenior-level Full TimeUS Remote R8h ago
-
Principal Machine Learning Engineer, ML Platform USD 212K-287KAgent workflows | Amazon SageMaker | Artifact management | Autoscaling | Batch inferenceCharity donation match | Coaching | Company offsites | Dental coverage | Flexible working hoursSenior-level Full TimeRemote (United States) R1d ago
-
Senior Software Engineer, AI Developer Experience USD 200K-400KAlerting | Build systems | CI/CD | Caching | DashboardsDaily lunches & snacks | Disability benefits | Life insurance | Medical/Dental/Vision insurance | Parental leaveSenior-level Full TimeSan Francisco1d ago
-
Machine Learning Engineer USD 129K-220KC++ | Computer Vision | Data Curation | Dataset Preparation | Deep learning401k | Flexible working hours | Free Coffee, Drinks & Snacks | Health insurance | Life insuranceEntry-level Full TimeArlington, Virginia1d ago
-
Machine Learning Engineer USD 129K-190KComputer Vision | Deep learning | Language Processing | Machine Learning | Multi-object Tracking401k | Flexible working hours | Free coffee | Free drinks | Free snacksMid-level Full TimeClifton Park, New York1d ago
-
Senior Software Engineer, Robotics Platform USD 143K-241KC# | C++ | CUDA | DDS | LinuxHigh ownership team | On-site work scheduleSenior-level Full TimeSan Francisco1d ago
-
API Development | Ablation Studies | Agent systems | CI/CD | Cloud ComputingDonation matching | Flexible PTO | Health insurance | Lunch stipend | Team building eventsEntry-level InternshipBerkeley, California, United States; San Francisco, …1d ago
-
Senior Storage Engineer (Hybrid) USD 101K-188KAPI | Ansible | Auditability | Azure DevOps | BashHybrid work environment | Medical, dental, vision and life insurance | Retirement plan with 401(k) matchingSenior-level Full TimeManassas, United States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Senior Algorithm Engineer USD 170K-190KContinuous Delivery | Continuous integration | Data labeling | Deep learning | Device SoftwareRemote workSenior-level Full TimeBoston, MA / Remote R1d ago
-
Data Governance | Data Modeling | Data Structures | Data pipeline | Java401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 2 - (Cloud, Analytics, Spark) USD 208K-254KAlgorithm Development | Data Querying | MapReduce | NoSQL | NumPy11 federal holidays | 24 days PTO | 401k 100 Percent Vested | Education assistance | Healthcare coverageSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland1d ago
-
Software Engineer 1 - (Python, UI/UX, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (AI, Python, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Docker | Helm401k match | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Senior Data Scientist USD 138K-185KApache Spark | Data Mining | DevOps | Distributed Systems | HDFS401k matching | Dental insurance | Flexible PTO | Health insurance | Hybrid work scheduleSenior-level Full TimeLos Angeles, California, United States R1d ago
-
Software Engineer, Machine Learning Infrastructure USD 140K-230KAPI Development | AWS | Airflow | Alerting | CI/CD401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsMid-level Full TimeSan Francisco, CA, US1d ago
-
APIs | AWS | Apache Spark | Azure | Azure Data401k matching | Dental insurance | Flexible working arrangements | Health insurance | Life insuranceSenior-level Full TimeSkokie, United States2d ago
-
Data Scientist Specialist - Customer Service USD 132K-214KAWS SageMaker | Azure Machine Learning | CI/CD | Causal Inference | ClassificationSenior-level Full TimeUS-Kansas-Wichita2d ago
-
Data Scientist Specialist - Customer Service USD 132K-219KAWS SageMaker | Azure ML | CI/CD | CUDA | DaskSenior-level Full TimeUS-Kansas-Wichita2d ago
-
Software Engineer Systems Machine Learning - Frameworks USD 112K-166KC# | C++ | CPU | CUDA | Compiler optimizationEntry-level Full TimeSunnyvale, CA | Bellevue, WA2d ago
-
Research Scientist, ML H/W-SW Codesign USD 177K-251KC# | C++ | Deep learning | GPU Architecture | Hardware accelerationMid-level Full TimeSunnyvale, CA2d ago
-
Software Engineer, Google Cloud Storage USD 147K-210KAccess Control | Best practices | Block Storage | C++ | Chaos EngineeringMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA2d ago
-
AI Solutions Engineer USD 123K-178KAI Agents | Azure DevOps | Azure Machine Learning | Bias detection | CI/CDDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeReston, VA, US2d ago
-
Algorithm Engineer USD 150K-170KCI/CD | Code review | Data labeling | Deep learning | Digital SignalIn person office hubs | Remote work flexibilityMid-level Full TimeBoston, MA / Remote R2d ago