Agent Post-Training, Frontier Evals and Environments Research
Tasks
- Analyze evaluation scalability reliability variance
- Build RL evaluation environments
- Build model self improvement loops
- Design continuous evaluation systems
- Develop automated behavior exploration methodologies
- Measure frontier model capabilities
- Steer training for major model runs
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | Data Pipelines | Evaluation | Experiment design | Grading | Human Feedback | LLM | Language Processing | Learning from Human Feedback | Machine Learning | Model Training | Natural Language | Natural Language Processing | Post-training | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Software Engineering | Statistics | Synthetic data | Systems engineering | Tool use
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Senior Data Scientist, Credit USD 120K-135KAirflow | BentoML | Code review | DVC | Data Engineering401k match | Calm app subscription | Dental insurance | Disability coverage | Flexible scheduleSenior-level Full TimeRemote, United States R8h ago
-
A/B | A/B Testing | Attribution Modeling | B testing | CalibrationCommuter benefits | Disability insurance | Financial wellness support | Healthcare | Life insuranceSenior-level Full TimeAustin, Texas8h ago
-
Senior Pricing Data Scientist USD 163K-205KCausal Inference | Conjoint analysis | Customer ROI | Customer Segmentation | DBTCell phone stipend | Employer paid medical insurance | Free food | Holidays | Mental health supportSenior-level Full TimeRemote, Illinois, United States, AMER R9h ago
-
Data Scientist, Product USD 155K-185KArtificial Intelligence | Data Analysis | Data Visualization | Experiment design | Machine LearningMid-level Full TimeMountain View, CA12h ago
-
Data Scientist, Trust & Safety USD 210K-310KAmplitude | Anomaly Detection | BigQuery | Causal Impact | Causal InferenceSenior-level Full TimeFoster City, CA13h ago
-
AIML - Sr Data Scientist, Evaluation USD 166K-296KDashboards | Data Analysis | Data Governance | Data Pipelines | Data ProcessingCollaborative environment | Cross-functional collaboration | Data privacy focusSenior-level Full TimeCupertino13h ago
-
Data Scientist USD 168K-297KA/B | A/B Testing | Agentic AI | Airflow | Attribution ModelingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …13h ago
-
Director, Foundation Model Data Recipes USD 349K-431KBayesian Inference | Data Clustering | Data Filtering | Data Mining | Data PreprocessingBonus | Equity incentive plan | Health insuranceExecutive-level Full TimeMountain View, CA. USA; San Francisco, …14h ago
-
Auditability | Compliance | Data Governance | Data Modeling | Data Pipelines401k | Dental insurance | Long-term incentive program | Medical insurance | Paid time offSenior-level Full TimeNorth Chicago, IL, United States16h ago
-
Senior Data Scientist USD 167K-250KCausal Inference | Econometrics | Experimentation | Forecasting | Machine Learning401k matching | Dental insurance | Employee discounts | Health insurance | Paid time offSenior-level Full TimeUnited States, Los Angeles, CA17h ago
-
Active Learning | Bioinformatics | Chemical informatics | Cloud Computing | Data integrationSenior-level Full TimeRedwood City, California, United States18h ago
-
Claims data | Dashboarding | Data Governance | Data Modeling | Data Quality401k | Dental insurance | Long term incentive program eligibility | Medical insurance | Paid time offSenior-level Full TimeMettawa, IL, United States18h ago
-
Cloud Computing | Data Analysis | Data Visualization | Deep learning | Ensemble MethodsSenior-level Full TimeRedwood City, California, United States18h ago
-
Principal Data Scientist – Machine Learning & AI USD 150K-200KAPIs | AWS | Artificial Intelligence | Automated retraining | AzureSenior-level Full TimeUK Remote; US Remote R20h ago
-
Senior Staff Decision Science (Risk) USD 190K-235KCredit Risk | Dashboarding | Data Visualization | Data pipeline | Experimentation401k match | Company equity | Dental insurance | Free subscription | Medical insuranceSenior-level Full TimeNew York, NY; San Francisco, CA20h ago
-
Sr. Data Scientist, Product Analytics USD 115K-147KA/B | A/B Testing | Airflow | Amplitude | B testingCompany 401k match | Dental coverage | Financial Planning Sessions | Flexible time off | Free snacks and refreshmentsSenior-level Full TimeAustin, Texas, United States20h ago
-
Senior-level Full TimeNew York City21h ago
-
Git | Language Processing | Machine Learning | Model Monitoring | Model ValidationEmployee assistance program | Paid parental leave | Paid time off | Tuition assistance | Work-life balanceMid-level Full TimeIllinois, Chicago - 300 E Randolph …22h ago
-
Senior Manager, Risk Strategy Data Scientist USD 136K-181KAnomaly Detection | Automl | Data Visualization | Deep learning | Excel401k | Dental insurance | Disability insurance | Employee assistance program | Employee recognition programsSenior-level Full TimeUnited States23h ago
-
Data Science Lead, Quant Modeling USD 159K-229KA/B | A/B Testing | B testing | Causal Inference | ClassificationSenior-level Full TimeSan Jose, California, United States1d ago
-
Cause analysis | Data Modeling | Data Visualization | Data pipeline | Language ModelsSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA1d ago
-
Staff Product Data Scientist, Pixel Growth, Google Store USD 192K-279KCausal Inference | Churn modeling | Customer Lifetime Value | Experimentation | IncrementalitySenior-level Full TimeMountain View, CA, USA1d ago
-
Data Scientist USD 92K-130KAgile | Artificial Intelligence | Dashboards | Data Governance | Data PipelinesFamily-focused benefits | Health insurance | Leadership programs | Mentorship programs | Student loan repayment assistanceMid-level Full TimeAtlanta, GA, United States1d ago
-
Data Scientist USD 92K-130KAgile | Artificial Intelligence | Change Management | Dashboards | Data GovernanceComprehensive health benefits | Leadership programs | Ongoing mentorship | Student loan reimbursement programs | Student loan repayment assistanceMid-level Full TimeAtlanta, GA, United States1d ago