Agent Post-Training, Frontier Evals and Environments Research
Tasks
- Analyze evaluation scalability reliability variance
- Build RL evaluation environments
- Build model self improvement loops
- Design continuous evaluation systems
- Develop automated behavior exploration methodologies
- Measure frontier model capabilities
- Steer training for major model runs
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | Data Pipelines | Evaluation | Experiment design | Grading | Human Feedback | LLM | Language Processing | Learning from Human Feedback | Machine Learning | Model Training | Natural Language | Natural Language Processing | Post-training | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Software Engineering | Statistics | Synthetic data | Systems engineering | Tool use
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Mid-level Full TimeUnited States-New Jersey-Piscataway3h ago
-
Research Scientist, Adaptive Compute, DeepMind USD 174K-253KDeep learning | Generative AI | JAX | Language Models | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …5h ago
-
Senior Data Scientist, Credit USD 120K-135KAirflow | BentoML | Code review | DVC | Data Engineering401k match | Calm app subscription | Dental insurance | Disability coverage | Flexible scheduleSenior-level Full TimeRemote, United States R11h ago
-
A/B | A/B Testing | Attribution Modeling | B testing | CalibrationCommuter benefits | Disability insurance | Financial wellness support | Healthcare | Life insuranceSenior-level Full TimeAustin, Texas12h ago
-
Senior Pricing Data Scientist USD 163K-205KCausal Inference | Conjoint analysis | Customer ROI | Customer Segmentation | DBTCell phone stipend | Employer paid medical insurance | Free food | Holidays | Mental health supportSenior-level Full TimeRemote, Illinois, United States, AMER R13h ago
-
Data Scientist, Product USD 155K-185KArtificial Intelligence | Data Analysis | Data Visualization | Experiment design | Machine LearningMid-level Full TimeMountain View, CA15h ago
-
Data Scientist, Trust & Safety USD 210K-310KAmplitude | Anomaly Detection | BigQuery | Causal Impact | Causal InferenceSenior-level Full TimeFoster City, CA17h ago
-
AIML - Sr Data Scientist, Evaluation USD 166K-296KDashboards | Data Analysis | Data Governance | Data Pipelines | Data ProcessingCollaborative environment | Cross-functional collaboration | Data privacy focusSenior-level Full TimeCupertino17h ago
-
Data Scientist USD 168K-297KA/B | A/B Testing | Agentic AI | Airflow | Attribution ModelingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …17h ago
-
Director, Foundation Model Data Recipes USD 349K-431KBayesian Inference | Data Clustering | Data Filtering | Data Mining | Data PreprocessingBonus | Equity incentive plan | Health insuranceExecutive-level Full TimeMountain View, CA. USA; San Francisco, …18h ago
-
Manager-Data Science USD 90K-165KApache Hive | Big Data | ChatGPT | Data Mining | Decision TreesCareer development opportunities | Holistic wellbeing support | Learning opportunities | Visa sponsorshipMid-level Full TimeNew York, NY, United States19h ago
-
Auditability | Compliance | Data Governance | Data Modeling | Data Pipelines401k | Dental insurance | Long-term incentive program | Medical insurance | Paid time offSenior-level Full TimeNorth Chicago, IL, United States20h ago
-
Senior Data Scientist USD 119K-234KData Integrity | Data Modeling | Data Preparation | Data Visualization | DebuggingSenior-level Full TimeUnited States; United States, Washington, Redmond; …20h ago
-
Senior Applied Scientist USD 119K-234KA/B | A/B Testing | B testing | Contextual Bandits | Data PipelinesSenior-level Full TimeUnited States, California, Mountain View; United …20h ago
-
Principal Applied Scientist USD 119K-304KA/B | A/B Testing | Artificial Intelligence | B testing | Data CurationSenior-level Full TimeUnited States, Washington, Redmond21h ago
-
Senior Data Scientist USD 167K-250KCausal Inference | Econometrics | Experimentation | Forecasting | Machine Learning401k matching | Dental insurance | Employee discounts | Health insurance | Paid time offSenior-level Full TimeUnited States, Los Angeles, CA21h ago
-
Active Learning | Bioinformatics | Chemical informatics | Cloud Computing | Data integrationSenior-level Full TimeRedwood City, California, United States22h ago
-
Claims data | Dashboarding | Data Governance | Data Modeling | Data Quality401k | Dental insurance | Long term incentive program eligibility | Medical insurance | Paid time offSenior-level Full TimeMettawa, IL, United States22h ago
-
Cloud Computing | Data Analysis | Data Visualization | Deep learning | Ensemble MethodsSenior-level Full TimeRedwood City, California, United States22h ago
-
Credit Risk | Credit risk modeling | Data Analysis | Data Engineering | EconometricsBackup childcare | Financial coaching | Flexible work options | Health care coverage | Mental health supportExecutive-level Full TimeWilmington, DE, United States22h ago
-
Professional Aide USD 39K-57KAWS | Bash | Cloud Computing | Computer Vision | ContainerizationOn-call availability | Temporary positionEntry-level Full TimeMichigan, East Lansing23h ago
-
Principal Data Scientist – Machine Learning & AI USD 150K-200KAPIs | AWS | Artificial Intelligence | Automated retraining | AzureSenior-level Full TimeUK Remote; US Remote R1d ago
-
Senior Staff Decision Science (Risk) USD 190K-235KCredit Risk | Dashboarding | Data Visualization | Data pipeline | Experimentation401k match | Company equity | Dental insurance | Free subscription | Medical insuranceSenior-level Full TimeNew York, NY; San Francisco, CA1d ago
-
Sr. Data Scientist, Product Analytics USD 115K-147KA/B | A/B Testing | Airflow | Amplitude | B testingCompany 401k match | Dental coverage | Financial Planning Sessions | Flexible time off | Free snacks and refreshmentsSenior-level Full TimeAustin, Texas, United States1d ago