Agent Post-Training, Frontier Evals and Environments Research
Tasks
- Analyze evaluation scalability reliability variance
- Build RL evaluation environments
- Build model self improvement loops
- Design continuous evaluation systems
- Develop automated behavior exploration methodologies
- Measure frontier model capabilities
- Steer training for major model runs
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | Data Pipelines | Evaluation | Experiment design | Grading | Human Feedback | LLM | Language Processing | Learning from Human Feedback | Machine Learning | Model Training | Natural Language | Natural Language Processing | Post-training | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Software Engineering | Statistics | Synthetic data | Systems engineering | Tool use
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R22h ago
-
Senior-level Full TimeNew York, NY9h ago
-
Senior Applied AI Scientist USD 182K-220KCausal Inference | Data Pipelines | Experiment design | LLM | Machine LearningSenior-level Full TimeNew York, NY9h ago
-
AI Scientist, Computational Protein Design USD 120K-240KArtificial Intelligence | Deep learning | Distributed Training | GPU Computing | Generative AIMid-level Full TimeSouth San Francisco, California, United States11h ago
-
Senior-level Full TimeFort Meade, MD12h ago
-
Sr. Data Scientist, Performance Marketing USD 139K-287KCausal Inference | Dashboarding | ETL | Experimentation | ForecastingSenior-level Full TimeSan Francisco, CA, US; Remote, US R13h ago
-
Data Scientist II USD 130K-145KAPIs | AWS | Anndata | Bulk RNA sequencing | CWL401k match | Educational benefits | Flexible spending accounts | Medical, dental & vision coverage | Paid HolidaysMid-level Full TimeRockville, MD15h ago
-
Data Engineer - CENTCOM USD 130K-149KAPI Development | AWS | Apache Spark | Azure | Data ValidationSCIF work environment | Top-Secret Clearance supportSenior-level Full TimeTampa, FL15h ago
-
Bioinformatics Scientist USD 120K-148KBehavioral Data | Behavioral Data Analysis | Cloud-Based Computing | Cloud-based | Data Analysis401k match | Dependent Care Assistant Program | Educational benefits | Flexible spending account | Medical, dental & vision coverageSenior-level Full TimeResearch Triangle Park, NC17h ago
-
Agent Post-Training, Context Research USD 295K-445KData Pipelines | Deep learning | Experimentation | Grading | Language ModelsMid-level Full TimeSan Francisco18h ago
-
Agent Post-Training, API & Power Users USD 295K-445KAI Feedback | Agent systems | Computer use | Cost Optimization | Data GenerationSenior-level Full TimeSan Francisco18h ago
-
Research Engineer / Research Scientist, Vision USD 350K-850KAgentic Systems | Benchmarking | Computer Vision | Data Pipelines | Deep learningFlexible working hours | Generous vacation | Hybrid work option | Optional equity donation matching | Parental leaveSenior-level Full TimeNew York City, NY; San Francisco, …18h ago
-
Data Scientist, North America Onboarding Team USD 180K-200KA/B | A/B Testing | Anomaly Detection | B testing | Data PipelinesEntry-level Full TimeAustin, United States19h ago
-
Senior Applied AI/ML Scientist - Compass USD 196K-269KAgentic AI | Artificial Intelligence | Cost Optimization | Data Modeling | Data strategyHybrid work flexibility | Remote work optionSenior-level Full TimeNew York City, NY; San Francisco, … R20h ago
-
Data Scientist, Marketing Analytics USD 130K-250KA/B | A/B Testing | Attribution Modeling | B testing | Conversion RateMid-level Full TimeAustin, Texas21h ago
-
Senior-level Full TimeMiami, New York, San Francisco22h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 202K-368KCUDA | Distributed Training | GPU Performance | GPU Performance Optimization | Language ModelsEntry-level Full TimeSan Jose, California, United States23h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-170KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States23h ago
-
Sr. Data Scientist USD 131K-198KMachine Learning | Python | R | SQL | Statistical modelingHybrid work schedule | Limited travelSenior-level Full TimeRaleigh, North Carolina, United States23h ago
-
Senior Data Scientist - Government & Public Services USD 131K-218KClass imbalance | Cloud Computing | Data Exploration | Data Preparation | Data leakageSenior-level Full TimeArlington/Rosslyn, Virginia, United States23h ago
-
Data Scientist, Product Analytics USD 178K-204KArtificial Intelligence | Data Mining | Experimentation | Forecasting | Key Performance IndicatorsMid-level Full TimeSunnyvale, CA | Menlo Park, CA … R1d ago
-
Staff AI Research Scientist, Applied AI, Google Cloud USD 207K-301KC++ | Data Mining | Deep learning | Generative AI | Information RetrievalSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Research Scientist, Recommendation Systems, DeepMind USD 174K-253KDeep learning | Experimentation | JAX | Language Models | Language ProcessingMid-level Full TimeMountain View, CA, USA; New York, …1d ago
-
Research Data Scientist, Cybersecurity, Google Cloud USD 147K-211KAdversarial Machine Learning | Cybersecurity | Data Pipelines | Fraud Detection | Generative AIMid-level Full TimeSan Francisco, CA, USA; Reston, VA, …1d ago
-
AI Research Scientist, Applied AI, Google Cloud USD 174K-253KC++ | Deep learning | Evaluation | Experimentation | Generative AIHealth insurance | Paid time off | Parental leave | Professional development | Relocation assistanceMid-level Full TimeSunnyvale, CA, USA1d ago