Principal Applied Scientist, Agentic AI
Tasks
- Define evaluation metrics for safety quality and win rates
- Design post training pipelines with supervised fine tuning and preference modeling
- Develop reward models and objective formulations
- Improve training and evaluation efficiency using off policy evaluation and replay
- Lead RL post training strategy for production models
- Mentor scientists and engineers in RL post training and evaluation
- Translate conversational logs and behavioral signals into training signals
Perks/Benefits
Skills/Tech-stack
AI Feedback | DPO | Fine Tuning | Human Feedback | Learning from Human Feedback | Multi-Modal | Multi-Objective Optimization | Multi-modal Models | Objective optimization | Off-policy evaluation | Pairwise Ranking | Policy Evaluation | Post-training | Preference Modeling | RLAIF | RLHF | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Reward Modeling | Supervised Fine Tuning | Transformer Models | Vector Search
Education
Related jobs
-
Applied AI/ML Scientist USD 128K-193KA/B | A/B Testing | AWS | Anthropic | Azure401k match | Annual lifestyle stipend | Child Eldercare Support | Flexible paid time off | Health, dental, vision insuranceMid-level Full TimeRemote US R19h ago
-
Lead Data Scientist USD 97K-230KA/B | A/B Testing | Attribution Modeling | B testing | Causal Inference401 k retirement plan matching | Company recognition program | Education assistance | Flexible work location | Health and wellbeing resourcesSenior-level Full TimeRemote, United States R1d ago
-
Principal Software Engineer (AI) ( US) USD 132K-145KAI RMF | Agentic Systems | Alerting | Artificial Intelligence | Audit LoggingContinuous development support | Employee assistance program | Employee recognition | Flexible paid time off | Parental and caregiver leavesSenior-level Full TimeRemote - US R1d ago
-
API | AWS SageMaker | Agile | Airflow | Amazon Redshift401k with employer match | Adoption, Fertility and Surrogacy Reimbursement | Disability and Critical Illness plans | Emergency backup care | Free access to CEUs and professional developmentSenior-level Full TimeCorp Facilities MPB - 350 Centre … R2d ago
-
Data Scientist - NLP & Generative AI USD 106K-145KAWS | Agentic AI | Attention Mechanisms | Bias Mitigation | CI/CDOn site onboarding travel | Relocation assistance not authorized | Remote workMid-level Full TimeRemote - Oregon, United States R6d ago
-
Automatic Speech Recognition | Benchmarking | Data Processing | Error Analysis | Hugging FaceComprehensive medical, dental, vision | Flexible PTO | Monthly wellness stipend | Office meal program | Paid parental leaveSenior-level Full TimeUnited States (Remote) R7d ago
-
AWS | Azure | C# | C++ | Computer VisionHealth benefits | Paid time off | Parental leave | Professional development | Remote workExecutive-level Full TimeCambridge, United States R8d ago
-
Data Scientist II USD 99K-129KCI/CD | Embeddings | Language Processing | MLOps | Machine LearningDental | Education assistance | Fitness reimbursement | HSA match | MedicalMid-level Full TimeRemote, United States R13d ago
-
Internship, Agentic/Machine Learning Development USD 40K-56KAWS SageMaker | Azure ML | Model Optimization | NumPy | PandasHigh-speed internet access | Remote work | Technology providedEntry-level Full Time InternshipRemote CA - R1, United States R13d ago
-
Principal Software Engineer- GenAI USD 136K-219K.NET | AI/ML | AI/ML Systems | Ansible | CQRS401k retirement plan | Dental insurance | Disability insurance | Employee assistance program | Flexible spending accountSenior-level Full TimeRemote, United States, United States R14d ago
-
Research Scientist - Large Language Model USD 200K-300KData Engineering | Deep learning | Distributed Training | Language Processing | Machine LearningMid-level Full TimePalo Alto, CA, Remote - International, … R15d ago
-
Data Scientist USD 133K-178KAI Algorithms | Bayesian Inference | Data Analysis | Data Visualization | Ensemble MethodsHealth insurance | Paid Holidays | Paid time off | Self-care days | Stock optionsSenior-level Full TimeSan Francisco, California, United States R16d ago
-
Senior Applied Scientist USD 152K-257KAgentic AI | Big Data | Big Data Tools | Data Tools | Deep learningCareer growth opportunities | Inclusive culture | Remote workSenior-level Full TimeRemote-USA, United States R21d ago
-
Staff, Data Scientist - Data Operations & Enrichment USD 186K-223KData Visualization | Deep learning | Hadoop | Language Processing | MathematicsBonus plan | Medical insurance | Relocation assistance | Stock optionsSenior-level Full TimeAnn Arbor, MI, Remote - US R21d ago
-
Applied AI Data Scientist (CEO Office) USD 65K-90KAI Model Deployment | Automation systems | Content Analytics | Data Analysis | Data ProcessingCreative environment | Flexible schedule | International team | Performance bonuses | Remote workEntry-level Full TimeUnited States - Remote R23d ago