Principal Applied Scientist, Agentic AI
Tasks
- Define evaluation metrics for safety quality and win rates
- Design post training pipelines with supervised fine tuning and preference modeling
- Develop reward models and objective formulations
- Improve training and evaluation efficiency using off policy evaluation and replay
- Lead RL post training strategy for production models
- Mentor scientists and engineers in RL post training and evaluation
- Translate conversational logs and behavioral signals into training signals
Perks/Benefits
Skills/Tech-stack
AI Feedback | DPO | Fine Tuning | Human Feedback | Learning from Human Feedback | Multi-Modal | Multi-Objective Optimization | Multi-modal Models | Objective optimization | Off-policy evaluation | Pairwise Ranking | Policy Evaluation | Post-training | Preference Modeling | RLAIF | RLHF | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Reward Modeling | Supervised Fine Tuning | Transformer Models | Vector Search
Education
Related jobs
-
Generative AI Scientist - (Model Risk & Validation) USD 110K-130KAI Platform | AWS | Amazon SageMaker | Apache Spark | Azure401k matching | Insurance | Paid Holidays | Paid family leave | Paid time offEntry-level Full TimeRemote, United States R2d ago
-
Senior Applied Scientist - Search USD 200K-200KData Science | Fine Tuning | Hybrid search | Information Retrieval | Knowledge graphs401k retirement plan | Equity package | Growth opportunities | Hybrid work schedule | Medical, dental, and vision coverageSenior-level Full TimeNew York City R2d ago
-
Senior Principal AI Engineer, Agentic Systems USD 350K-600KAgent Orchestration | Data integration | EHR Integration | Evaluation | Fine TuningComprehensive benefits | Hybrid work scheduleSenior-level Full TimeNew York, NY R4d ago
-
Senior Principal AI Engineer, Agentic Systems USD 350K-600KAgent Orchestration | Agent systems | DBT | Deep learning | EHR IntegrationHealth benefits | Hybrid scheduleSenior-level Full TimeNew York, NY R4d ago
-
Senior Applied Scientist USD 142K-270KData Pipelines | Diffusion Models | Direct Preference Optimization | Fine Tuning | Generative AISenior-level Full TimeSan Jose, United States R5d ago
-
Senior Machine Learning Engineer USD 174K-287KComputer Vision | Deep learning | Gradient Computation | Graph theory | Inference Optimization401k match | Comprehensive medical/dental/vision coverage | Flexible work arrangements | Paid parental leave | Paid time offSenior-level Full TimeBoston, United States R7d ago
-
Physics-Informed Machine Learning Specialist USD 175K-267KActive Learning | Artificial Intelligence | Bayesian Inference | Computational Mechanics | Data Engineering401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R7d ago
-
Principal Machine Learning Engineer USD 162K-250KAWS IAM | AWS Lambda | AWS SageMaker | Amazon S3 | Deep learningEquity | Health insurance | Parental leave | Remote work flexibility | Retirement savings matchSenior-level Full TimeRemote - United States R8d ago
-
Senior Consultant, Gen AI USD 125K-188KCI/CD | Databricks | Databricks Mosaic | Databricks Mosaic AI | Delta TablesBlogger writing | Conference speaking | Continuous improvement | Experimentation culture | MentorshipSenior-level Full TimeUnited States - Remote R9d ago
-
Staff Applied Scientist, Generative AI/ML USD 172K-306KComputer Vision | Data Curation | Data Generation | Deep learning | Distributed TrainingSenior-level Full TimeSan Jose, United States R13d ago
-
Sr/Staff Data Scientist (Remote - US) USD 165K-300KAgile | Attention Mechanisms | Chain-of-Thought | Chain-of-Thought prompting | Cloud Computing401k matching | Annual bonus | Counseling services | Dental insurance | Dependent care spending accountSenior-level Full TimeREMOTE, US, US, 76131 R14d ago
-
Sr. Data Scientist, AI/ML Systems USD 139K-287KA/B | A/B Testing | Apache Spark | B testing | Causal InferenceSenior-level Full TimeSan Francisco, CA, US; Remote, CA, … R14d ago
-
[2026] Data Scientist, Foundation AI - PhD Early Career USD 185K-221KA/B | A/B Testing | B testing | Causal Inference | Data GenerationEquity compensation | Health benefits | Onsite work scheduleMid-level Full TimeSan Mateo, CA, United States R14d ago
-
Principal Data Scientist USD 185K-215KAWS Lambda | Agent Orchestration | Amazon Web Services | Apache Spark | CI/CDHealth and wellness benefits | Paid time off | Professional development | Remote workSenior-level Full TimeUS - Morrisville, NC - 3900 … R15d ago
-
Senior Data Scientist, AI Native (Growth) USD 129K-190KA/B | A/B Testing | AWS | B testing | Bayesian ModelingEmployee assistance program | Equipment and tools support | Flexible PTO | Free Membership | Learning and development programsSenior-level Full TimeRemote, USA; Remote, Canada R21d ago
-
Research Scientist, LLM Evaluation & Post-Training USD 150K-160KBenchmarking | Context evaluation | DPO | Data Processing | Error AnalysisSenior-level Full TimeRemote Work( USA), United States R22d ago
-
Data Modeling | Deep learning | Ecommerce | Fine Tuning | Human-in-the-loopEquity | Health benefits | Hybrid work flexibility | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA R25d ago
-
Principal Data Engineer USD 160K-200KAI Agents | AWS Glue | AWS Lambda | Amazon ECS | Amazon MSK401k | Dental insurance | Discounts | Fully remote | Medical insuranceExecutive-level Full TimeNew York, NEW YORK, United States R26d ago
-
Principal AI Software Engineer USD 206K-258KA/B | A/B Testing | AWS | Agentic AI | Audio ProcessingFlexible leave programs | Flexible time off | Leadership programs | Learning resources | Paid HolidaysSenior-level Full TimeRemote (United States) R26d ago
-
Senior-level Full TimeRemote - Pennsylvania, United States R29d ago
-
Amazon Web Services | Apache Airflow | Apache Spark | Attention Mechanism | BenchmarkingCell phone reimbursement | Global mentorship and networking programs | Hybrid work | Insurance coverage | Learning and developmentSenior-level Full TimeSan Diego, California R30d ago
-
AI Agents | AWS | Agentic AI | CUDA | Data PipelinesAdoption leave | Conference speaking opportunities | Employee networks | Paid parental leave | Professional development opportunitiesSenior-level Full TimeSunnyvale, United States R30d ago
-
Lead Applied Scientist, Document Understanding USD 140K-274KCitation Parsing | Data Generation | DeepSpeed | Document Classification | Document Layout AnalysisFitness reimbursement | Flexible work schedule | Headspace app access | Mental health days off | Retirement savingsSenior-level Full TimeUnited States of America, New York, … R30d ago
-
Senior Applied Scientist, Document Understanding USD 100K-236KCitation Parsing | Data Generation | DeepSpeed | Document Classification | Document Layout AnalysisEmployee assistance program | Flex My Way work from anywhere | Mental health days off | Paid volunteer days off | Retirement savingsSenior-level Full TimeUnited States of America, New York, … R30d ago
-
[2026] Applied Scientist - PhD Intern USD 144K-144KC++ | Computer Vision | Deep learning | Distributed Systems | Fraud DetectionEntry-level InternshipSan Mateo, CA, United States R1mo ago