Applied Scientist, Support Agent Intelligence and Evaluation
Tasks
- Build confidence calibration metrics
- Build retrieval models for real time interactions
- Create conversation level resolution signals
- Create locale aware evaluation
- Design evaluation framework for agent quality
- Develop automated LLM scoring for answer correctness
- Develop novel metrics for advertiser help outcomes
- Drive multilingual resolution improvements
- Enhance support agent capabilities
- Improve cross lingual retrieval
- Improve generation models for accurate answers
- Model translation quality
- Partner with product and engineering teams to productize research
Perks/Benefits
- 401k matching
- Adoption reimbursement
- Dental insurance
- Employee Assistance Program (EAP)
- Health insurance
- Paid time off
- Parental leave
- Surrogacy reimbursement
- Vision insurance
Skills/Tech-stack
C++ | Confidence Calibration | Cross Lingual Retrieval | Distributed Computing | Evaluation Frameworks | High Performance | High-Performance Computing | Information Retrieval | Java | Language Models | Language Processing | Large Language Models | Machine Learning | Multilingual NLP | Natural Language | Natural Language Processing | Numerical Optimization | Parallel Computing | Performance Computing | Python | Quality modeling | Question Answering | Translation Quality | Translation Quality Modeling | Unix/Linux
Education
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R27d ago
-
Associate Data Scientist USD 75K-111KAllscripts | Alteryx | Business Intelligence | Data Visualization | ETLMid-level Full TimeUnited States-Ohio-Cleveland3h ago
-
Data Scientist - Workforce Analytics USD 141K-236KANOVA | Business Intelligence | Data Analysis | Data Visualization | Descriptive StatisticsHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Springfield3h ago
-
Artificial Intelligence | Data Mining | Deep learning | Experiment design | Language ProcessingSenior-level Full TimeNew York, NY, USA4h ago
-
Research Data Scientist, Search Ads, Google Experience USD 147K-211KData Modeling | Mathematical Modeling | Python | R | SQLMid-level Full TimeMountain View, CA, USA4h ago
-
Senior Research Data Scientist, YouTube Shorts Creation USD 174K-253KData Modeling | Data Quality | Experimental Design | Machine Learning | PythonSenior-level Full TimeSan Bruno, CA, USA4h ago
-
Sr. People Data Scientist USD 157K-205KCluster Analysis | Data Governance | Data Privacy | Data Reconciliation | Data SecuritySenior-level Full TimeMilpitas, CA, United States12h ago
-
Senior-level Full TimeUS - St. Louis, MO - …15h ago
-
Data Scientist - TS/SCI w/Poly USD 212K-287KApache Kafka | Audio Processing | CI/CD | CUDA | Data Mapping401k with company match | Comprehensive health and wellness packages | Flex work weeks | Internal mobility support | Paid HolidaysSenior-level Full TimeUSA VA McLean - Customer Proprietary …15h ago
-
Data Scientist, Core Infrastructure USD 144K-261KCloud infrastructure | Data Modeling | Distributed Computing | Hadoop | Log Analysis401k plan | Company bonus | Equity | Medical, dental, and vision benefits | Wellness stipendsMid-level Full TimeSan Francisco R16h ago
-
ML Data - Research Scientist USD 143K-264KAudio signal processing | Computer Vision | Data Annotation | Experiment design | Inter-rater reliabilityMid-level Full TimeCupertino16h ago
-
ML Data - Research Scientist USD 170K-300KData Annotation | Experiment design | Inter-rater reliability | Machine Learning | Multi-ModalSenior-level Full TimeCupertino16h ago
-
Data Scientist - Conversational AI USD 99K-192KA/B | A/B Testing | Amplitude | B testing | Cloud platformChild care support | Community service paid time off | Dental insurance | Employee resource groups | Flexible family care daysSenior-level Full TimeDearborn, MI, United States16h ago
-
Applied Scientist USD 102K-202KBig Data | Clustering | Computer Vision | Data analytics | Deep learningMid-level Full TimeUnited States, Washington, Redmond; United States, …16h ago
-
CUDA | Cache Compression | Co Optimization | Decoding algorithms | Evaluation methodology401k plan | Career growth and learning opportunities | Collaborative culture | Disability insurance | Flexible work arrangementsSenior-level Full TimePalo Alto, California, United States16h ago
-
Applied Data Solutions Program (Full-Time Opportunities) USD 107K-171KAutomation | Data Pipelines | Data Science | Forecasting | Fraud DetectionCareer development | Project based rotations | Supportive teamEntry-level Full TimeAustin; Cupertino17h ago
-
Applied Data Solutions Program (Full-Time Opportunities) USD 107K-171KAutomation | Data Engineering | Data Pipelines | Data Science | DataikuEntry-level Full TimeAustin; Cupertino17h ago
-
Staff Data Scientist AI and Pricing USD 239K-359KA/B | A/B Testing | Agentic AI | B testing | Causal InferenceFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …18h ago
-
Causal Inference | Clickstream analytics | Data Visualization | GitHub | Hypothesis TestingMid-level Full TimeSunnyvale18h ago
-
Senior Clinical Data Scientist USD 160K-180KADaM | Bias Assessment | CDISC | Clinical data | Data AnalysisSenior-level Full TimeSan Francisco18h ago
-
Clinical Data Scientist USD 140K-160KData Wrangling | Data cleaning | Data harmonization | Machine Learning | NumPyMid-level Full TimeSan Francisco19h ago
-
Data Science Consultant USD 88K-165KCloud Computing | Generative AI | Hypothesis Testing | Language Models | Large Language Models401k match | Dental insurance | Medical insurance | Paid parental leave | Unlimited time offMid-level Full TimeChicago, IL21h ago
-
Data Scientist [Multiple Positions Available] USD 160K-170KAgent Orchestration | Context engineering | Deep learning | Hugging Face | Hugging Face TransformersBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersMid-level Full TimeNew York, NY, United States21h ago
-
Data Scientist USD 120K-159KDashboarding | Data Governance | Data Quality | Data Visualization | KPI ReportingBirthday leave | Flexible working environment | Health and wellness program | Internal awards programs | Learning opportunitiesMid-level Full TimeUnited States of America21h ago
-
Sr. Data Scientist, Core USD 139K-287KDeep learning | Econometrics | Forecasting | Machine Learning | PyTorchSenior-level Full TimeSan Francisco, CA, US; Remote, US R21h ago