Agent Post-Training Research
Tasks
- Build evals and environments to identify model failures
- Debug model failures and define hypotheses experiments and fixes
- Decide integrations and fixes for major model runs
- Design and run experiments to improve agent behavior
- Develop training signal with data mixtures objectives and synthetic data
- Improve training and launch reliability observability and reproducibility
- Own post training improvements end to end
- Translate product signal into model improvements
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | Agent systems | Calibrated Reasoning | Data Pipelines | Deep learning | Experiment design | Factuality | Function Calling | Grader Systems | Human Feedback | Instruction following | Language Models | Large Language Models | Learning from Human Feedback | Machine Learning | Model Evaluation | Multi-Agent | Multi-Agent Systems | Post-training | RLAIF | RLHF | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Software Engineering | Statistical Analysis | Synthetic data | Tool use
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Computer Vision Engineer USD 170K-251K3D Modeling | AR/VR | Computer Graphics | Computer Vision | Data AnalysisSenior-level Full TimeBurlingame, CA1h ago
-
Principal Engineer, Data Center Hardware Robotics USD 275K-383KActuation systems | Actuator control | Computer Vision | Embedded Systems | FPGASenior-level Full TimeSunnyvale, CA, USA1h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …1h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA1h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA1h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA1h ago
-
Research Scientist, Adaptive Compute, DeepMind USD 174K-253KDeep learning | Generative AI | JAX | Language Models | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …1h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R6h ago
-
Senior Data Scientist, Credit USD 120K-135KAirflow | BentoML | Code review | DVC | Data Engineering401k match | Calm app subscription | Dental insurance | Disability coverage | Flexible scheduleSenior-level Full TimeRemote, United States R8h ago
-
A/B | A/B Testing | Attribution Modeling | B testing | CalibrationCommuter benefits | Disability insurance | Financial wellness support | Healthcare | Life insuranceSenior-level Full TimeAustin, Texas8h ago
-
Senior Pricing Data Scientist USD 163K-205KCausal Inference | Conjoint analysis | Customer ROI | Customer Segmentation | DBTCell phone stipend | Employer paid medical insurance | Free food | Holidays | Mental health supportSenior-level Full TimeRemote, Illinois, United States, AMER R9h ago
-
Data Analysis | Data Visualization | GenAI | Java | Jupyter NotebookSenior-level Full TimeCupertino12h ago
-
Data Scientist, Product USD 155K-185KArtificial Intelligence | Data Analysis | Data Visualization | Experiment design | Machine LearningMid-level Full TimeMountain View, CA12h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States12h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States12h ago
-
Machine Learning Engineer, Sensor Pipelines USD 175K-215KC++ | Computer Vision | JAX | Machine Learning | PyTorchHybrid work scheduleMid-level Full TimeMountain View, CA, USA13h ago
-
AI Engineer USD 105K-115KAPI Cost Modeling | API Integration | API Wrappers | Anthropic API | Conversation DesignCalm health employee membership | Company social events | Comprehensive benefits package | Employee referral incentive program | Employee resource groupsEntry-level Full TimeCincinnati, OH, US13h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States13h ago
-
Data Scientist, Trust & Safety USD 210K-310KAmplitude | Anomaly Detection | BigQuery | Causal Impact | Causal InferenceSenior-level Full TimeFoster City, CA13h ago
-
AIML - Sr Data Scientist, Evaluation USD 166K-296KDashboards | Data Analysis | Data Governance | Data Pipelines | Data ProcessingCollaborative environment | Cross-functional collaboration | Data privacy focusSenior-level Full TimeCupertino13h ago
-
Data Scientist USD 168K-297KA/B | A/B Testing | Agentic AI | Airflow | Attribution ModelingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …13h ago
-
Director, Foundation Model Data Recipes USD 349K-431KBayesian Inference | Data Clustering | Data Filtering | Data Mining | Data PreprocessingBonus | Equity incentive plan | Health insuranceExecutive-level Full TimeMountain View, CA. USA; San Francisco, …14h ago
-
Software Engineer, ML Platform (ML Training) USD 175K-265KAWS | Computer Vision | DeepSpeed | Distributed Training | JAXMid-level Full TimeFoster City, CA14h ago