Research Scientist - Decentralized LLM Pre-Training
Tasks
- Develop and evaluate scaling methods
- Implement and test bandwidth constrained training approaches
- Implement and test error prone training approaches
- Implement and test heterogeneous training approaches
- Perform decentralized LLM pre training research
- Port research methodology to pre training platform
- Present research at major conferences
- Publish research at major conferences
Perks/Benefits
- N/A
Skills/Tech-stack
Distributed Training | Federated Learning | JAX | Language Models | Large Language Models | Machine Learning | Model Inference | Network Architecture | Neural Network | Neural Network Architecture | Optimization | Optimization Theory | PyTorch | Quantization
Education
Related jobs
-
Data Scientist USD 94K-157KArtificial Intelligence | Data Mining | Data Pipelines | Data analytics | Machine LearningHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilityEntry-level Full TimeUSA-Remote Work R4h ago
-
Causal Inference | Clustering | Data Augmentation | Data Generation | DatabricksSenior-level Full TimeBarcelona, CT, Spain R8h ago
-
Applied Scientist USD 120K-238KAlignment methods | Computer Vision | Diffusion Models | Distributed Training | Generative AISenior-level Full TimeSan Jose, United States R17h ago
-
Data Scientist - Alternance - H/F EUR 23K-26KData Visualization | Deep learning | Machine Learning | NumPy | Pandas13th month pay | Bonuses | Company restaurant | Employee committee access | Employee savings planEntry-level Apprenticeship Full TimeFrance - Boulogne Anthos R17h ago
-
Data Scientist GBP 85K-135KApache Spark | Causal Inference | Graph analytics | Machine Learning | Python401k matching | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceSenior-level Full TimeUnited Kingdom / Europe R18h ago
-
Senior Data Scientist (f/m/d) EUR 80K-100KA/B | A/B Testing | AWS Athena | Airflow | B testingEmployee Assistance Program (EAP) | Fitness classes | Hackathons | Hybrid work model | In-house gymSenior-level Full TimeHamburg R22h ago
-
Cientista de Dados Sr BRL 21K-23KData Analysis | Data Pipelines | Data Visualization | Exploratory Data Analysis | Machine LearningDental plan | Gym membership | Health insurance | Life insurance | Meal allowanceMid-level Full TimeRemote R1d ago
-
Decision Scientist INR 1600K-2000KApplied statistics | Continuous Improvement | Decision Trees | Design of Experiments | ForecastingFinancial coaching | Health insurance | Hybrid work | Mental health support | NPS participationEntry-level Full TimeBengaluru, Karnataka, India, India R1d ago
-
Business System Analyst IV (Fixed -Hybrid) USD 95K-208KAdvanced Analytics | Bias Mitigation | Data Governance | Data Preparation | EMRHybrid work agreementMid-level Full TimeFixed Hybrid R1d ago
-
Senior Data Scientist USD 135K-203KAgile | C++ | Cloud infrastructure | Data Pipelines | Distributed SystemsGlobal office location options | Remote work optionSenior-level Full TimeRemote (Canada); Remote (United Kingdom); Remote … R1d ago
-
Automation | Azure | Data Analysis | Data Pipelines | Data integrationCareer growth | Collaborative team culture | Fully remote | Professional developmentMid-level Full TimeIndia R1d ago
-
AWS Glue | AWS Lambda | Agile | Amazon S3 | Amazon SageMakerContinuous improvement culture | Fully remote work | Remote-first culture | Technical excellence focusSenior-level Full TimeBrazil R1d ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | CI/CD | Cloud Architecture | Deep learning | GCPMid-level Full TimeRemote, India R1d ago
-
Mid-level Full TimeRemote, India R1d ago
-
Associate Principal Engineer, Data Science INR 1800K-2500KANOVA | AWS | Azure | CI/CD | Cloud ArchitectureMid-level Full TimeRemote, India R1d ago
-
AI Researcher USD 290K-365KDistributed Training | Distributed inference | Federated Learning | Incentive design | Machine LearningMid-level Full TimeAnywhere R1d ago
-
Principal Scientist – AI/ML Specialization - WFH1651 USD 145K-251KBias correction | Computational Efficiency | Data Bias Correction | Data Imputation | Data Noise ReductionAir Gapped Linux Environment | Remote work | Working on Resource Constrained Edge HardwareSenior-level Full TimeReston, VA - Remote R1d ago
-
Senior Data Scientist AUD 129K-160KAWS HealthLake | Agile | Amazon QuickSight | Amazon S3 | Amazon SageMakerRemote workSenior-level Full TimeRemote, Australia R1d ago
-
Computer Vision | Deep learning | Diffusion Models | Foundation Models | Generative ModelsHybrid work setup | Mentorship | Onsite Days Per WeekEntry-level Internship Part TimeGM Israel - Technical Center Israel … R1d ago
-
Advisor, Data Science and Analytics USD 78K-131KAWS | Apache Spark | Big Data | C++ | Cloud platformConference and seminar support | Flexible time off | Tuition reimbursement | Workplace flexibilityMid-level Full TimeLagunilla de Heredia, Costa Rica R1d ago
-
Principal Machine Learning Revenue Architect USD 163K-382KBig Data | Business Process | Data Mining | Data Science | Data VisualizationSenior-level Full TimeVirtual, United States R1d ago
-
Biostatistics Scientist USD 114K-158KArtificial Intelligence | Bayesian analysis | Data Analysis | Data sets | Experimental DesignHealth benefits | Paid Holidays | Paid time off | Parental leave | Retirement savings planSenior-level Full TimeNA-US-IA-Virtual Office, United States R1d ago
-
Data Scientist INR 1050K-1050KLanguage Processing | Machine Learning | Natural Language | Natural Language Processing | Predictive AnalyticsFlexible work hours | Remote work flexibilityMid-level Full TimeBangalore, India R1d ago
-
Research Data Scientist III - Brain Research USD 56K-78KArtificial Intelligence | DTI | Data Visualization | Database Management | Deep learningNo weekends or holidays | Remote work | Training and mentoringSenior-level Full TimeRemote Location, United States R1d ago
-
Causal Inference | Experimentation | Machine Learning | Python | SQL401k retirement plan | Disability programs | Family-forming benefits | Flexible spending account | Flexible time offSenior-level Full TimeMassachusetts - Remote, United States R1d ago