Researcher: Agent Post-Training, API & Power-Users
Tasks
- Build evals graders and environments
- Create feedback loops from power user traces
- Debug model failures using traces and evals
- Design and run model behavior experiments
- Develop model behavior hypotheses
- Develop training interventions with synthetic data and objectives
- Implement error recovery for long horizon tasks
- Improve tool use and function calling reliability
- Improve training launch reliability observability reproducibility cost latency
- Integrate post training improvements into major model runs
- Measure instruction following and factuality
- Own end to end model behavior projects
- Turn model failures into training data
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | Calibrated Reasoning | Data Generation | Deep learning | Error Recovery | Evals | Experiment design | Factuality | Function Calling | Human Feedback | Instruction following | LLM Evaluation | Language Models | Large Language Models | Learning from Human Feedback | Learning systems | Long Horizon Planning | Machine Learning | Machine learning systems | Model Observability | Production ML | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Reproducibility | Software Engineering | Statistical Analysis | Synthetic data | Systems Thinking | Tool use
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17h ago
-
Staff Research Engineer, Data Agents USD 190K-270KAgent systems | Agentic reinforcement learning | LLM Agents | Language Models | Language ProcessingSenior-level Full TimeSan Francisco, California6h ago
-
Senior-level Full TimeFort Meade, MD6h ago
-
Sr. Data Scientist, Performance Marketing USD 139K-287KCausal Inference | Dashboarding | ETL | Experimentation | ForecastingSenior-level Full TimeSan Francisco, CA, US; Remote, US R8h ago
-
Senior AI Engineer USD 190K-316KAI orchestration | Agent Frameworks | Context Management | Evaluation | LLM401k match | Commuter parking stipend | Dental insurance | Employee stock purchase program ESPP | Flexible time offSenior-level Full TimeSan Francisco, CA8h ago
-
AI Engineer USD 180K-240KAPIs | Agent systems | Cloud infrastructure | Evaluation | Graph traversalSenior-level Full TimeMountain View, CA8h ago
-
Sr AI Engineer - Agentic Systems USD 166K-205KAI Safety | API Integration | Agent Orchestration | Artificial Intelligence | Distributed SystemsSenior-level Full TimeAnywhere, US R9h ago
-
Data Engineer - CENTCOM USD 130K-149KAPI Development | AWS | Apache Spark | Azure | Data ValidationSCIF work environment | Top-Secret Clearance supportSenior-level Full TimeTampa, FL10h ago
-
Staff AI Engineer - Conversational & Agentic AI USD 176K-308KA/B | A/B Testing | API Design | Agent systems | Artificial Intelligence401k plan | Company match | ESPP | Family leave programs | Flexible spending accountsSenior-level Full TimeSanta Clara, California, United States11h ago
-
Principal Machine Learning Engineer USD 285K-457KArtificial Intelligence | Classification | Deep learning | Embeddings | ExperimentationIn-person onboarding | Remote work flexibilitySenior-level Full TimeCambridge, MA, USA12h ago
-
Principal Machine Learning Engineer USD 285K-457KArtificial Intelligence | Classification | Deep learning | Embeddings | ExperimentationIn-person onboarding | Remote work optionsSenior-level Full TimeRemote - USA R12h ago
-
Sr AI Engineer USD 84K-105K3D Printing | Audio signal processing | C# | Data Preprocessing | Digital SignalAccrued Paid Vacation | Commuter benefits | Dental insurance | Flexible spending account | Health savings accountSenior-level Full TimeColumbia, MARYLAND, United States14h ago
-
Senior-level Full TimePlymouth, MI, United States15h ago
-
Senior Staff AI Engineer USD 139K-185K3D Printing | AI Algorithms | Audio signal processing | C# | Data PreprocessingAccrued Paid Vacation | Commuter benefits | Dental insurance | Employee resource groups | Flexible spending accountSenior-level Full TimeColumbia, MARYLAND, United States16h ago
-
Founding Engineer USD 110K-160KAPIs | Automated Evaluation | Fine Tuning | Infrastructure | Language ProcessingMid-level Full TimeSan Francisco, CA, US16h ago
-
AWS | Agentic AI | Azure | CI/CD | Cloud platform401k | Medical | Paid sick leaveMid-level ContractSouth San Francisco, United States16h ago
-
Senior-level Full TimeMiami, New York, San Francisco16h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 202K-368KCUDA | Distributed Training | GPU Performance | GPU Performance Optimization | Language ModelsEntry-level Full TimeSan Jose, California, United States17h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 155K-306KAirflow | CI/CD | DBT | Data Modeling | DatabricksMentorship | Professional development | Travel for client workSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …17h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI | AWS | Agent Bricks | Airflow | Apache SparkSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …17h ago
-
Entry-level Full TimeArlington/Rosslyn, Virginia, United States17h ago
-
Databricks Senior Consultant USD 124K-207KAWS | Azure | Business Intelligence | Cloud Computing | Cloud platformSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …18h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 155K-265K.NET | AWS | Agile | Angular | AzureMentorship opportunities | Professional development | Travel reimbursementSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …18h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-170KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States18h ago
-
Azure Databricks Developer USD 126K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States18h ago