Agent Post-Training, API & Power Users
Tasks
- Build evaluation systems graders and environments from real workflows
- Convert observed model failures into training data
- Create feedback loops using power user traces and API usage patterns
- Debug hard model failures using traces evals training data and product context
- Design and run model behavior experiments for API workflows
- Develop behavior improvement projects from failure analysis to integration and launch readiness
- Develop training and alignment interventions using objectives and synthetic data
- Improve large scale training and launch reliability observability and cost latency
- Improve tool use planning and long horizon execution reliability
- Lead cross functional projects for multi agent systems and production like environments
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | Agent systems | Computer use | Cost Optimization | Data Generation | Deep learning | Evaluation | Experimentation | Function Calling | Human Feedback | Language Models | Language Processing | Large Language Models | Latency optimization | Learning from Human Feedback | Long Horizon Execution | Machine Learning | Model Debugging | Model Training | Multi-Agent | Multi-Agent Systems | Natural Language | Natural Language Processing | Observability | Planning | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Reproducibility | Statistical modeling | Synthetic data | Tool use
Education
N/A
Regions
Countries
States
Related jobs
-
Staff Machine Learning Engineer, Gen AI | Voice & Speech USD 150K-220KBigtable | Cloud Computing | Cloud Native | Cloud-native infrastructure | Data integrationRemote US basedSenior-level Full TimeUS Remote R8h ago
-
Algorithm Engineer, Battlespace Awareness USD 126K-167KAgile Development | C++ | Classification | Clustering | ControlsHealth benefits | Paid time off | Recovery BenefitsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …12h ago
-
Algorithm Developer, Battlespace Awareness USD 126K-167KAgile | C++ | Clustering | Data Association | DebuggingMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …12h ago
-
Senior Algorithm Engineer, Battlespace USD 190K-252KAgile | C++ | Classification | Clustering | ControlsSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …12h ago
-
Analytics Engineer USD 130K-175KAmazon Redshift | BigQuery | Business Intelligence | CRM data | CRM data modelingEntry-level Full TimeStockholm R20h ago
-
Associate or Full Professor of Data Science USD 55K-75KClimate Modeling | Data Analysis | Data Ethics | Data Sovereignty | Data VisualizationBackground check required | Health insurance | Paid time off | Retirement plansMid-level Full TimeUnited States, Eugene, OR1d ago
-
AI Engineer USD 100K-160K.Net Core | API Development | AWS | Access Control | AnthropicHealthcare workflow domain experience optional | Office presenceMid-level Full TimeLittle Rock, AR, US1d ago
-
💎 Computational Materials Scientist 💎 USD 90K-140KAWS EC2 | Artificial Intelligence | Bash | Enterprise Linux | GPU ComputingFree food and snacks | Health care plan | Life insurance | Long-term disability | Paid time offMid-level Full TimeWalnut Creek, California, United States R1d ago
-
Principal Machine Learning Engineer, ML Platform USD 212K-287KAgent workflows | Amazon SageMaker | Artifact management | Autoscaling | Batch inferenceCharity donation match | Coaching | Company offsites | Dental coverage | Flexible working hoursSenior-level Full TimeRemote (United States) R1d ago
-
Data Scientist II USD 118K-157KBig Data | Data Analysis | Data Modeling | Data Visualization | Database Architecture401k matching | Career advancement | Dental insurance | Fitness center on site | Flexible spending accountMid-level Full TimeCA, United States1d ago
-
Full Stack Gen AI Engineer USD 128K-197KAWS Bedrock | AWS Fargate | Amazon ECS | Amazon Web Services | CI/CDSenior-level Full TimeDallas, Texas, United States1d ago
-
Senior Software Engineer, AI Developer Experience USD 200K-400KAlerting | Build systems | CI/CD | Caching | DashboardsDaily lunches & snacks | Disability benefits | Life insurance | Medical/Dental/Vision insurance | Parental leaveSenior-level Full TimeSan Francisco1d ago
-
Machine Learning Engineer USD 129K-220KC++ | Computer Vision | Data Curation | Dataset Preparation | Deep learning401k | Flexible working hours | Free Coffee, Drinks & Snacks | Health insurance | Life insuranceEntry-level Full TimeArlington, Virginia1d ago
-
Machine Learning Engineer USD 129K-190KComputer Vision | Deep learning | Language Processing | Machine Learning | Multi-object Tracking401k | Flexible working hours | Free coffee | Free drinks | Free snacksMid-level Full TimeClifton Park, New York1d ago
-
Senior Data Engineer USD 140K-216KAPI Integration | Airflow | Alerting | Amplitude | BigQuery401k match | Casual dress environment | Development dollars | Disability insurance | Life insuranceSenior-level Full TimeEdmond, OK1d ago
-
API Development | Ablation Studies | Agent systems | CI/CD | Cloud ComputingDonation matching | Flexible PTO | Health insurance | Lunch stipend | Team building eventsEntry-level InternshipBerkeley, California, United States; San Francisco, …1d ago
-
Senior Storage Engineer (Hybrid) USD 101K-188KAPI | Ansible | Auditability | Azure DevOps | BashHybrid work environment | Medical, dental, vision and life insurance | Retirement plan with 401(k) matchingSenior-level Full TimeManassas, United States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Sr. Data Scientist - AI Research USD 150K-171KAPI | Data pipeline | Experimentation | Hypothesis Testing | JSONRemote work optionsSenior-level Full TimeUnited States1d ago
-
Senior Algorithm Engineer USD 170K-190KContinuous Delivery | Continuous integration | Data labeling | Deep learning | Device SoftwareRemote workSenior-level Full TimeBoston, MA / Remote R1d ago
-
Senior Data Scientist USD 100K-150KAPIs | Advanced Analytics | Anomaly Detection | ArcGIS Pro | ArcpySenior-level Full TimeSpringfield, VA, United States1d ago
-
AI | ClickHouse | Confluence | ETL | Git401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeColumbia, Maryland1d ago
-
Data Governance | Data Modeling | Data Structures | Data pipeline | Java401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (Python, UI/UX, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago