Staff Applied Scientist - Agentic Interfaces
Tasks
- Assess cost quality tradeoffs at scale
- Build evaluation datasets and golden traces
- Conduct applied research on agent data interaction
- Define agent evaluation metrics
- Develop regression harnesses for agent quality
- Evaluate multi turn agent performance
- Improve retrieval relevance metrics
- Improve tool selection accuracy
- Measure grounding and hallucination control on telemetry
- Optimize context efficiency
- Provide technical leadership through reviews mentorship and working groups
Perks/Benefits
- Career pathing
- Employee resource groups
- Employee stock purchase plan
- Inclusive culture
- Professional development
- Stock equity
Skills/Tech-stack
A/B | A/B Testing | B testing | Deep learning | Evaluation | Experimentation | GenAI | Information Retrieval | Language Processing | Learning operations | Machine Learning | Machine Learning Operations | Natural Language | Natural Language Processing | Reinforcement Learning | Telemetry
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Data Scientist USD 80K-157KAWS | Airflow | Annotation | Azure | ClassificationHybrid work mode | Professional development opportunitiesMid-levelGeorgetown University: Main Campus: Walsh School …23d ago
-
Machine Learning Engineer II USD 46K-54KAWS | Apache Spark | Azure | Business Intelligence | Data Warehousing401k | Career advancement | Dental insurance | Disability insurance | Health insuranceMid-level Full TimeChicago, IL14h ago
-
Principal AI Engineer, Special Programs USD 220K-350KAI Safety | API Development | API Orchestration | AWS | Cloud platform401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disability insuranceSenior-level Full TimePalo Alto, CA15h ago
-
Software Engineer, Statistical Evaluation and Sampling USD 170K-216KC++ | Data Processing | Data Processing Pipelines | Importance sampling | Machine LearningEntry-level Full TimeMountain View, CA, USA; San Francisco, …15h ago
-
Machine Learning Engineer - Semantic Reasoning (Highway) USD 200K-293KBEV | C++ | Computer Vision | Deep learning | JAXPaid time offSenior-level Full TimeFoster City, CA16h ago
-
Dashboard | Data Visualization | Data pipeline | ETL | Machine LearningOnsite days schedule | Overtime paySenior-level Full TimeSan Mateo, CA, United States R17h ago
-
Sr. Machine Learning Engineer USD 175K-230KAWS | C plus plus | Deep learning | Kubernetes | Language Models401k plan | Cell phone internet reimbursement | Company-Paid Holidays | Flexible paid time off | Health Savings Account employer contributionSenior-level Full TimeRemote - United States R17h ago
-
Senior Applied AI Data Scientist USD 160K-231KBias Mitigation | DBT | Data Pipelines | Data Quality | Deep learning1 1 financial advice | 401k contribution | Financial health resources | Flexible paid time off | Flexible work hoursSenior-level Full TimeNY office18h ago
-
Senior AI & ML Engineer USD 194K-228KAPIs | Agent Orchestration | Agent routing | Agents SDK | Cloud infrastructureSenior-level Full TimeUnited States - Remote R18h ago
-
Staff Data Scientist, Driving Quality USD 238K-302KCausal Inference | Data Analysis | Experiment design | Key Performance Indicators | Machine LearningCompany benefits program | Discretionary annual bonus | Equity incentive plan | Hybrid work environmentSenior-level Full TimeMountain View, California, USA; San Francisco, …19h ago
-
Staff ML Systems Engineer, Distributed Systems USD 70K-300KCPU | Concurrency | DDP | Dask | Data LocalitySenior-level Full TimeSeattle, WA20h ago
-
Senior Staff data science engineer USD 141K-206KAzure Machine Learning | CI/CD | Data Science | Databricks | Distributed SystemsDisability insurance | Employee assistance program | Flexible spending account | Health savings account | Life insuranceSenior-level Full TimeMilpitas, CA, United States21h ago
-
Lead Software Engineer, Data Platform USD 220K-250KAPI Design | Auto-labeling | Azure | Computer Vision | Data pipeline100 Percent covered medical dental vision | Citi Bike membership | Commuter benefits | Free lunch | Holiday observancesSenior-level Full TimeNew York, NY21h ago
-
Senior AI Software Engineer USD 147K-220KAgentic AI | Code review | Debugging | Distributed Systems | DockerAccess to modern AI tools | Career growth opportunities | Continuous improvement culture | Ownership and decision-makingSenior-level Full TimeUSA - Sandy, UT21h ago
-
Machine Learning Engineer USD 168K-198KAPI Development | Amazon SageMaker | Anthropic | Asynchronous processing | CI/CDCommuter stipend | Fertility adoption and parental planning reimbursement | Flexible PTO policy | Learning and development allowance | Medical, dental, and vision coverageSenior-level Full TimeSan Francisco, California, United States22h ago
-
Quantitative Developer - Python USD 200K-225KBacktesting | Low Latency | Low-Latency Systems | Machine Learning | PandasDiscretionary bonus | Insurance | Paid leaveMid-level Full TimeChicago, United States22h ago
-
Lead Data Scientist USD 210K-240KAPIs | Apache Airflow | Apache Beam | Cloud Dataflow | Cloud Dataproc401k | Dental insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeRemote - USA R23h ago
-
Sr. Solutions Engineer - AI Natives Business USD 152K-209KAWS | Apache Spark | Azure | Data Engineering | Data ScienceAnnual performance bonus | Equity | Remote work | Travel requiredSenior-level Full TimeRemote - California; Remote - Colorado; … R23h ago
-
Airflow | Amazon EC2 | Anomaly Detection | Apache Spark | Azure MLOnsite work | Public trust clearance requiredSenior-level ContractWoodlawn, United States1d ago
-
AI Savvy Data Analyst USD 127K-220KAnomaly Detection | Cause analysis | Cloud APIs | Colab | Data GovernanceAdditional day off for birthday | Competitive benefits package | ESG focused company | Flex days between Christmas and New Year | Flexible work hoursMid-level Full TimeDenver, CO, United States R1d ago
-
AWS EC2 | Airflow | Classification | Computer Vision | Dagster401k | Dental insurance | Medical insurance | Paid sick leave | Vision insuranceMid-level ContractSouth San Francisco, United States1d ago
-
Senior Data Engineer USD 130K-174KAWS | Amazon Redshift | Azure | Azure Data | Azure Data LakeIn office work 5 days per week | Security clearance supportSenior-level Full TimeAlexandria, VA1d ago
-
Machine Learning Engineer Graduate (E-Commerce Supply Chain & Logistics)- 2026 Start (PhD) USD 150K-316KData Mining | Deep learning | Demand forecasting | ETA Prediction | Inventory forecastingEntry-level Full TimeSan Jose, California, United States1d ago
-
Data Analysis | Data Engineering | Data Processing | Data Visualization | ExperimentationEntry-level Full TimeSan Jose, California, United States1d ago
-
Databricks Forward Deployed Engineer - GPS USD 97K-162KAPIs | AWS | Agent Bricks | Apache Airflow | Apache SparkMentorship | Professional development | Travel 50 PercentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …1d ago