Research Scientist - Decentralized LLM Pre-Training
Tasks
- Develop and evaluate scaling methods
- Implement and test bandwidth constrained training approaches
- Implement and test error prone training approaches
- Implement and test heterogeneous training approaches
- Perform decentralized LLM pre training research
- Port research methodology to pre training platform
- Present research at major conferences
- Publish research at major conferences
Perks/Benefits
- N/A
Skills/Tech-stack
Distributed Training | Federated Learning | JAX | Language Models | Large Language Models | Machine Learning | Model Inference | Network Architecture | Neural Network | Neural Network Architecture | Optimization | Optimization Theory | PyTorch | Quantization
Education
Related jobs
-
Data Scientist (m/f) EUR 24K-44KAgile | Data Analysis | Data Science | Machine Learning | Predictive ModelingAdditional pension savings | E-learning access | Meal allowance | Mentorship | Multisport and PassSport cardMid-level Full TimeZagreb, Hrvatska (Hybrid) R12h ago
-
Data Scientist (w/m/d) EUR 13K-16KAgile methodologies | CI/CD | Data Pipelines | Data Warehousing | ForecastingEntry-level Full TimeDeutschlandweit R19h ago
-
Principal, AI Data Science GBP 85K-100KAWS | Automated Data Collection | Data Monitoring | Data Privacy | Data collectionDental insurance | Flexible Paid Vacation | Medical insurance | Retirement savings plan | Vision insuranceSenior-level Full TimeUK - Home-Based, United Kingdom R1d ago
-
Senior Data Scientist, Blockchain USD 152K-205KAnomaly Detection | Blockchain Analytics | Fraud Detection | Machine Learning | Network AnalysisSenior-level Full TimeU.S. - California, United States R1d ago
-
Senior Data Scientist, AI USD 83K-159KAI Studio | Azure AI | Azure AI Studio | Azure Data | Azure Data FactoryBonus incentives | Career advancement | Comprehensive benefits | Paid certifications | Remote workSenior-level Full TimeWork at Home - Cincinnati - … R1d ago
-
Staff Data Scientist, Engagement Ecosystem USD 164K-339KApache Spark | Causal Inference | Experimentation | Machine Learning | PredictionSenior-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Sr. Data Scientist, Core USD 139K-287KData Instrumentation | Data Pipelines | Deep learning | Econometrics | ExperimentationEquity | Hybrid work modelSenior-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Senior-level Contract Full TimeRemote job R1d ago
-
Data Scientist | EU EUR 70KA/B | A/B Testing | Auction mechanisms | B testing | Big DataGrowth budget | Professional development | Tech community eventsSenior-level Contract Full TimeRemote job R1d ago
-
Senior-level Contract Full TimeRemote job R1d ago
-
Lead Machine Learning Scientist USD 160K-200KAWS | Azure | Data Preprocessing | Deep learning | GCPCompany-sponsored events | Dental insurance | Flexible sick days | Flexible vacation | Home-office equipmentSenior-level Full TimeRemote R1d ago
-
Algorithms | Data Architecture | Data Modeling | Data Processing | Data ScienceAgile work culture | Collaboration culture | Work from homeEntry-level Full TimeBogotá, Bogotá, Colombia R1d ago
-
Senior Staff Engineer, Generative AI INR 2500K-4500KAI Deployment | AI/ML | AI/ML cloud services | API Development | AirflowFlexible work hours | Health benefits | Learning and development opportunities | Remote workSenior-level Full TimeRemote, India R1d ago
-
Senior Staff Engineer, Generative Ai INR 2500K-4500KAPI Development | AWS SageMaker | Azure ML | BERT | BicepSenior-level Full TimeRemote, India R1d ago
-
Data Scientist (m/w/d) EUR 50K-52KData Modeling | Data Pipelines | Data cleaning | Database | ETLBicycle leasing | Company health programs | Employee discounts via corporate benefits platform | First class rail travel | Flexible working hoursEntry-level Full Timebundesweit, Deutschland R1d ago
-
Machine Learning Scientist USD 150K-200KAgile | Bayesian Methods | Classification | Clustering | Deep learning401k matching | Health insurance | Paid time off | Remote work | Travel infrequentMid-level Full TimeRemote job R2d ago
-
Data Engineering | Data Processing | Data Visualization | GenAI | LangchainFlexible schedule | Impact on AI development | Part-time | Professional development | Remote workMid-level FreelanceAustralia - Remote R2d ago
-
Data Analysis | Generative AI | Langchain | MLOps | Machine LearningFlexible schedule | Impact on AI development | Remote work | Skill developmentMid-level FreelanceGermany - Remote R2d ago
-
Data Manipulation | Data Preprocessing | Data Visualization | GenAI | LLMsCareer development | Flexible schedule | Freelance | Part-time | Remote workMid-level FreelanceCanada - Remote R2d ago
-
Data Processing | Data Visualization | Data pipeline | GenAI | LLMsFlexible schedule | Portfolio enhancement | Project experience | Remote workMid-level FreelanceUnited Kingdom - Remote R2d ago
-
Big Data | Data Science | Data Visualization | Hadoop | HiveCareer development opportunities | Fast-growing environment | Individual responsibilitySenior-level Full TimeOntario, Canada - Remote R2d ago
-
Data Science Director (Precision Trend R&D) - Remote USD 178K-297KAnomaly Detection | Apache Spark | Boosting algorithms | Cloud Computing | Clustering401k | Medical/Dental/Vision insurance | Paid Holidays | Paid time off | Remote workExecutive-level Full TimeCT, Bloomfield, 900 Cottage Grove Rd … R2d ago
-
Sr. Healthcare Info Data Scientist-Clinical USD 80K-122KBackup and Recovery | CSV | Data Analysis | Data Mining | Data ModelingOn-call support | Training opportunitiesSenior-level Full TimeRemote Associate - Tennessee, United States R2d ago
-
Data Scientist COP 54000K-74400KA/B | A/B Testing | Apache Spark | Azure Machine Learning | B testingAutonomy and goal setting | Career development community | Innovation Labs | Remote work flexibilityMid-level Full TimeBogota, CO R2d ago
-
Big Data | Big data processing | Data Analysis | Data Ingestion | Data ProcessingFlexible schedule | Part-time freelance | Portfolio development | Remote workMid-level FreelanceSaudi Arabia - Remote R2d ago