Staff Applied Scientist - Agentic Interfaces
Tasks
- Assess cost quality tradeoffs at scale
- Build evaluation datasets and golden traces
- Conduct applied research on agent data interaction
- Define agent evaluation metrics
- Develop regression harnesses for agent quality
- Evaluate multi turn agent performance
- Improve retrieval relevance metrics
- Improve tool selection accuracy
- Measure grounding and hallucination control on telemetry
- Optimize context efficiency
- Provide technical leadership through reviews mentorship and working groups
Perks/Benefits
- Career pathing
- Employee resource groups
- Employee stock purchase plan
- Inclusive culture
- Professional development
- Stock equity
Skills/Tech-stack
A/B | A/B Testing | B testing | Deep learning | Evaluation | Experimentation | GenAI | Information Retrieval | Language Processing | Learning operations | Machine Learning | Machine Learning Operations | Natural Language | Natural Language Processing | Reinforcement Learning | Telemetry
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R3d ago
-
A/B | A/B Testing | AWS | Apache Spark | B testingAnnual company retreats | Flexible working hours | Fully remote-first | High-end equipment | Paid annual leaveMid-level Full TimeCanada R5h ago
-
Sr. Application Software Engineer, Data Analytics USD 160K-225KAngular | C# | CI/CD | Computer Vision | Continuous integrationExtended hours | Travel | Weekend workSenior-level Full TimeBastrop, TX10h ago
-
Senior-level Full TimeOnsite - Austin, TX11h ago
-
Senior Data Scientist, Lending USD 133K-185KA/B | A/B Testing | Airflow | B testing | Causal Inference401k match | Annual company paid days off | Community volunteering time | Generous vacation policy | Medical, dental, vision, life, and disability benefitsSenior-level Full TimeSan Francisco, CA, USA R11h ago
-
Data Scientist/Senior Data Scientist USD 136K-183KAgentic Systems | Artificial Intelligence | Calculus | Classification | Cloud NativeTravelSenior-level Full TimeRedwood City, California, United States12h ago
-
Principal AI/ML Scientist USD 150K-207KAWS | AWS GovCloud | Artificial Intelligence | Azure | Azure AIPublic trust suitabilitySenior-level Full TimeARLINGTON, VA, United States16h ago
-
Senior-level Full TimeARLINGTON, VA, United States16h ago
-
AI Engineer 1 - Platform Integration & AI/Data USD 80K-150KAWS | Agentic Systems | Backend Development | Backend Services | CI/CD401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC16h ago
-
Data Scientist, Decisions - Central Market Management USD 128K-160KAttribution Modeling | Behavioral analytics | Data Visualization | Decision Theory | Forecasting401k plan | Child care benefits | Family building benefits | Hybrid work schedule | Medical, dental, and vision insuranceMid-level Full TimeSan Francisco, CA R18h ago
-
Data Science Intern USD 60K-95KAnomaly Detection | Computer Vision | Data Analysis | Data Preprocessing | ExcelCareer Development Training Opportunities | Diversity and inclusion initiatives | Multicultural environmentEntry-level InternshipAUBURN HILLS HQ R&D,US-MI,United States18h ago
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States18h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD19h ago
-
AWS | AWS SageMaker | Azure | Cloud Pak for Data | Cloud infrastructureAccess to national security mission work | Hybrid work | Travel opportunitiesSenior-level Full TimeUSA-VA-Herndon20h ago
-
AI Engineer USD 180KAgent Orchestration | Cost Management | Data Pipelines | Distributed Systems | LLM401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …20h ago
-
Machine Learning Leader - Optical Solutions USD 180K-300KAnomaly Detection | Data analytics | Image Processing | Java | Machine LearningAdoption Assistance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountSenior-level Full TimeFremont, California21h ago
-
Process and Analytics Engineer USD 105K-140KAgile | Anomaly Detection | Asset Framework | HYSYS | HYSYS OnlineDental insurance | Disability insurance | Educational assistance | Flexible spending account | Health insuranceMid-level Full TimeWichita, Kansas21h ago
-
AI Architect USD 134K-237KAI Search | AI Security | API Gateway | API Integration | AWS BedrockAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountsSenior-level Full TimeHouston, Texas | Tulsa, Oklahoma | …21h ago
-
CV/NLP/Multimodal LLM Machine Learning Engineer Graduate (TikTok-Trust and Safety) - 2026 Start (PhD) USD 136K-246KActive Learning | Computer Vision | Content Classification | Data-Driven Strategy | Data-drivenEntry-level Full TimeSeattle, Washington, United States21h ago
-
CV/NLP/Multimodal LLM Research Scientist Graduate (Trust and Safety) - 2026 Start (PhD) USD 137K-237KComputer Vision | Deep learning | Distributed Training | Few-Shot Learning | Few-shotCareer development opportunities | Graduate onboarding support | Research opportunitiesEntry-level Full TimeSeattle, Washington, United States21h ago
-
Sr. Staff Data Scientist- Eng USD 145K-209KAgent systems | Agentic AI | BigQuery | Classification | Data GovernanceSenior-level Full TimeLowell,MA,United States R22h ago
-
Business Data Scientist, YouTube+, GBO Product Finance USD 138K-198KCausal Inference | Data Analysis | Data Storytelling | Database querying | EconometricsMid-level Full TimeSan Bruno, CA, USA; Mountain View, …22h ago
-
Software Engineer III, Generative AI USD 147K-211KComputer Vision | Data Processing | Debugging | Language Models | Language ProcessingSenior-level Full TimeKirkland, WA, USA22h ago
-
Staff Software Engineer, AI/ML, YouTube Ads USD 207K-301KA/B | A/B Testing | B testing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA22h ago
-
Junior Data Scientist USD 70K-85KA/B | A/B Testing | B testing | Cloud platform | Feature EngineeringEntry-level Full TimeDenver, Colorado, United States23h ago