Research Scientist - Decentralized LLM Pre-Training
Tasks
- Develop and evaluate scaling methods
- Implement and test bandwidth constrained training approaches
- Implement and test error prone training approaches
- Implement and test heterogeneous training approaches
- Perform decentralized LLM pre training research
- Port research methodology to pre training platform
- Present research at major conferences
- Publish research at major conferences
Perks/Benefits
- N/A
Skills/Tech-stack
Distributed Training | Federated Learning | JAX | Language Models | Large Language Models | Machine Learning | Model Inference | Network Architecture | Neural Network | Neural Network Architecture | Optimization | Optimization Theory | PyTorch | Quantization
Education
Related jobs
-
Data Scientist, Product USD 209K-235KClustering | Data Mining | Descriptive Statistics | Distributed Systems | ETLTelecommutingSenior-level Full TimeMenlo Park, CA | Remote, US R2h ago
-
Data Scientist Operations EUR 45K-55KComputer Vision | Data Visualization | Geospatial analysis | IoT | JavaScriptErgonomics support | Flexible work schedule | Free train travel | Personal development | Stress managementMid-level Full TimeSaint-Gilles, BRU, BE, 1060 R6h ago
-
Data Scientist - Agentic AI (Hybrid) GBP 50K-70KAI Agents | AWS | AWS Bedrock | Agents SDK | AzureAnnual leave | Flexible working | Healthcare dental cover | Learning platform access | Lifestyle discountsMid-level Full TimeBelfast 10 Mays Meadow, United Kingdom R13h ago
-
Data Scientist USD 87K-142KData Analysis | Data Validation | Experiment design | Language Models | Language Processing401k program | Company paid life insurance | Company-paid disability insurance | Dental insurance | Medical insuranceMid-level Full TimeRemote R14h ago
-
Sênior/Lead Data Scientist EUR 18K-19KClassification | Databricks | Feature Engineering | Machine Learning | ModelingChildcare support | Dental insurance | Education benefit | Flexible hours | GympassSenior-level Full TimeRemoto R16h ago
-
Machine Learning PhDs - AI Trainer USD 36K-40KComputational Methods | Information Retrieval | Machine Learning | Optimization | Probabilistic methodsFlexible schedule | Fully remoteEntry-level Full TimeRemote (USA) R18h ago
-
Data Scientist - Portfolio Consumer (Hybrid) USD 87K-110KA/B | A/B Testing | B testing | Machine Learning | Python401k matching | Charitable matching | Employee recognition program | Health, dental, and vision insurance | Hybrid work scheduleMid-level Full TimeChicago, IL R20h ago
-
Data Scientist EUR 42K-86KData Pipelines | Feature Engineering | Feature extraction | Information Retrieval | Language ProcessingRemote work | Stock grant opportunities | WeWork access optionalMid-level Full TimeSpain R1d ago
-
Data Scientist: Insights & Intelligence - Level 3 USD 113K-187KAWS | Bayesian | Bayesian Methods | Causal Inference | ContainerizationMid-level Full TimeVAFC01, United States R1d ago
-
Principal Data Scientist, Digital & AI USD 152K-228KAgent architectures | Azure | Classification | Clustering | DBT401k match | Annual bonus | Annual equity awards | Commuting subsidy | Educational assistanceSenior-level Full Time5000 - Vertex US - Fan … R1d ago
-
Machine Learning Engineer USD 150K-200KContainerization | Data Science | Huggingface | Language Processing | Language Understanding401k | Fully remote | Healthcare benefits | Holidays | Paid parental leaveSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Data Scientist USD 125K-250KData Modeling | Experimentation | Forecasting | Machine Learning | Python401k matching | Dental insurance | Employee assistance program | Employee recognition program | Fully remoteSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Data Scientist USD 165K-210KAWS | Azure ML | BigQuery | CI/CD | Claims data401k | Charitable Giving to Causes | Dental & vision insurance | Dependent Health Savings Accounts | Health insuranceSenior-level Full TimeUnited States - Remote R1d ago
-
Backtesting | Data Modeling | Data Science | Financial economics | MATLABDiscretionary bonus | Flexible time off | Healthcare | Hybrid work model | Leave benefitsExecutive-level Full TimeNY7 - 50 Hudson Yards, New … R1d ago
-
AI and Trading Analytics Researcher, AVP USD 175K-175KAlpha signal development | Artificial Intelligence | Asset allocation | Data analytics | Financial Modeling401k match | Dental insurance | Employee assistance program | Employee networks | Flexible work programExecutive-level Full TimeCambridge, Massachusetts, United States R1d ago
-
AI Agents | AI Governance | AWS Bedrock | Agents SDK | AzureNone Full TimeUSA - IL (Remote), United States R1d ago
-
Senior Applied Scientist II, Ads Optimization USD 201K-253KAuction theory | C++ | Causal Inference | Constrained optimization | Control TheoryAnnual refresh grants | Equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R1d ago
-
Bioinformatics Research Scientist II USD 122K-170KAWS | Dimensionality Reduction | Feature Selection | Genomics | Machine LearningRemote-friendlyMid-level Full TimeRemote ; San Diego, California, United … R1d ago
-
Staff Data Scientist USD 152K-282KA/B | A/B Testing | AWS | Advanced SQL | Airflow401k company match | Cell phone stipend | Co-working Space Subsidy | Disability insurance | Employee resource groupsSenior-level Full TimeNerdWallet US R1d ago
-
Data Scientist AWS FP052KA USD 111K-170KAPI Gateway | AWS Lambda | AWS S3 | Amazon API | Amazon API GatewayInternational team | Long-term career growth | Remote work | Strategic high visibility role | Technical leadershipSenior-level Contract Full TimeBuenos Aires R1d ago
-
Senior Data Scientist, Special Projects USD 170K-190KAPI documentation | Bayesian Inference | Causal Inference | Comparative Causal Inference | Data cleaningFlexible time off | Fully remote work | Home office support | Paid parental leave | Professional development supportSenior-level Full TimeRemote R1d ago
-
Data Scientist (Fulfilment) USD 130K-190KData Engineering | Data Pipelines | Data engineering collaboration | Demand forecasting | Engineering CollaborationFlexible working hours | Learning opportunities | Remote work | Unlimited holiday allowance | Vibrant company cultureSenior-level Full TimeRemote - European timezone R1d ago
-
Machine Learning (ML) Bioengineer USD 146K-222KActive Learning | Bioinformatics | Data Analysis | Deep learning | Distributed Training401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | Relocation assistanceMid-level Full TimeLivermore, CA, United States R1d ago
-
Data Scientist (Remote) USD 100K-139KAgile | Apache Spark | Bitbucket | Causal Inference | Experimental Design401k matching | Dental insurance | Flexible time off | Flexible work environment | Medical insuranceMid-level Full TimeHeredia, Heredia, Costa Rica R1d ago
-
Agile | Artificial Intelligence | Code review | Debugging | DocumentationMentorship | Remote work | Tuition coverageEntry-level Apprenticeship ContractRemote (United States) R1d ago