Staff Applied Scientist - Agentic Interfaces
Tasks
- Assess cost quality tradeoffs at scale
- Build evaluation datasets and golden traces
- Conduct applied research on agent data interaction
- Define agent evaluation metrics
- Develop regression harnesses for agent quality
- Evaluate multi turn agent performance
- Improve retrieval relevance metrics
- Improve tool selection accuracy
- Measure grounding and hallucination control on telemetry
- Optimize context efficiency
- Provide technical leadership through reviews mentorship and working groups
Perks/Benefits
- Career pathing
- Employee resource groups
- Employee stock purchase plan
- Inclusive culture
- Professional development
- Stock equity
Skills/Tech-stack
A/B | A/B Testing | B testing | Deep learning | Evaluation | Experimentation | GenAI | Information Retrieval | Language Processing | Learning operations | Machine Learning | Machine Learning Operations | Natural Language | Natural Language Processing | Reinforcement Learning | Telemetry
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R3h ago
-
Artificial Intelligence | Assessment | Curriculum Development | Live coding | Machine LearningEntry-level Part TimeRemote, United States R3h ago
-
AI Agents | AI Governance | Artificial Intelligence | Cybersecurity compliance | Enterprise SearchHybrid work | Local residency requirementEntry-level ContractAustin, United States5h ago
-
Anomaly Detection | Anti-Money Laundering | Apache Spark | Bayesian Modeling | ClassificationSenior-level Full TimeUSA5h ago
-
AI Platform Engineer USD 108K-215KAutogen | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Key VaultMid-level Full TimeBelmont, NC, United States6h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York6h ago
-
Project GenAI Engineer III USD 113K-188KAWS | Bedrock | Generative AI | Machine LearningMentorship | Onsite work | Professional development | Travel up to 25%Senior-level Full TimeArlington/Rosslyn, Virginia, United States6h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R6h ago
-
Mid-level Full TimeUnited States-New Jersey-Piscataway7h ago
-
Software Engineer - TikTok AI Search Infrastructure USD 212K-389KAlgorithm Design | C++ | DAG | Data Architecture | Data ProcessingSenior-level Full TimeSan Jose, California, United States7h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 77K-176KAPI Development | Agile | Backend Development | Cloud Computing | Data Preparation401k | Employee discounts | Employee referral rewards | Flexible work schedule | Health savings accountMid-level Full TimeQuantico, VA, US R8h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R8h ago
-
Computer Vision Engineer USD 170K-251K3D Modeling | AR/VR | Computer Graphics | Computer Vision | Data AnalysisSenior-level Full TimeBurlingame, CA8h ago
-
Principal Engineer, Data Center Hardware Robotics USD 275K-383KActuation systems | Actuator control | Computer Vision | Embedded Systems | FPGASenior-level Full TimeSunnyvale, CA, USA8h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …8h ago
-
Business Data Scientist, YouTube+, GBO Product Finance USD 138K-198KCausal Inference | Data Storytelling | Data Visualization | Database querying | EconometricsMid-level Full TimeSan Bruno, CA, USA; Mountain View, …8h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA8h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA8h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA8h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA8h ago
-
Research Scientist, Adaptive Compute, DeepMind USD 174K-253KDeep learning | Generative AI | JAX | Language Models | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …8h ago
-
Data Scientist USD 95K-110KAuction mechanisms | Causal Inference | Classification | Contextual Bandits | Data ProcessingCareer development workshops | Community involvement | Company events | Parental leave returnMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL10h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R13h ago