Applied Scientist, Support Agent Intelligence and Evaluation
Tasks
- Build confidence calibration metrics
- Build retrieval models for real time interactions
- Create conversation level resolution signals
- Create locale aware evaluation
- Design evaluation framework for agent quality
- Develop automated LLM scoring for answer correctness
- Develop novel metrics for advertiser help outcomes
- Drive multilingual resolution improvements
- Enhance support agent capabilities
- Improve cross lingual retrieval
- Improve generation models for accurate answers
- Model translation quality
- Partner with product and engineering teams to productize research
Perks/Benefits
- 401k matching
- Adoption reimbursement
- Dental insurance
- Employee Assistance Program (EAP)
- Health insurance
- Paid time off
- Parental leave
- Surrogacy reimbursement
- Vision insurance
Skills/Tech-stack
C++ | Confidence Calibration | Cross Lingual Retrieval | Distributed Computing | Evaluation Frameworks | High Performance | High-Performance Computing | Information Retrieval | Java | Language Models | Language Processing | Large Language Models | Machine Learning | Multilingual NLP | Natural Language | Natural Language Processing | Numerical Optimization | Parallel Computing | Performance Computing | Python | Quality modeling | Question Answering | Translation Quality | Translation Quality Modeling | Unix/Linux
Education
Roles
Related jobs
-
Global Supply Chain Analytics Specialist USD 95K-149KDashboarding | Data Modeling | Data Quality | Data Visualization | ForecastingInclusive work environment | Professional developmentMid-level Full TimeUtica, NY, US, NY 135023h ago
-
Senior Specialist Solutions Architect - Agentic AI, AGS Specialist Solutions Architects USD 153K-207KAI Governance | AWS | Agent evaluation | Amazon AgentCore | Amazon BedrockSenior-level Full TimeSeattle, Washington, USA9h ago
-
Strategy Data Scientist - Compliance USD 95K-114KBusiness Intelligence | Cause analysis | DBT | Data Modeling | Data Pipelines401k retirement plan | Dental insurance | Disability insurance | Employee assistance program | Employee recognition programMid-level Full TimeUnited States R10h ago
-
Consultant – Compliance Data Science & AI USD 98K-122KAWS | Anthropic | Azure | Data Pipelines | Data Visualization401k match | Cell phone stipend | Employee assistance program | FSA | HSAMid-level Full TimeSan Francisco, CA, United States11h ago
-
Consultant- Marketing Data Science & AI USD 98K-122KAWS | Anthropic | Azure | Cloud Computing | Cloud platform401k match | Cell phone stipend | College savings | Employee assistance program | Flexible work location optionsMid-level Full TimeSan Francisco, CA, United States11h ago
-
Consultant- Marketing Data Science & AI USD 95K-116KAWS | Azure | Cloud platform | Data Engineering | Data Visualization401k match | Generous PTO | Medical, dental, and vision | Paid parental leaveMid-level Full TimeNew York, NY, United States11h ago
-
Consultant – Compliance Data Science & AI USD 95K-116KAWS | Azure | Cloud platform | Dashboards | Data Pipelines401k with company match | Cell phone stipend | College savings program | Company paid life and ADandD | EAPMid-level Full TimeNew York, NY, United States11h ago
-
Data Scientist USD 140K-180KArcGIS API | ArcGIS API for Python | ArcGIS Enterprise | ArcGIS Maps | ArcGIS Maps SDK401k retirement plan | Accident Hospital | Critical illness | Employee assistance program | Health spending accountSenior-level ContractJuno Beach, Florida, USA R11h ago
-
Transportation Data Scientist USD 94K-121KAir quality | Air quality modeling | Anaconda | ArcGIS | Automated data processingEqual opportunity employment | Flexible work environmentEntry-level Full TimeBoston, MA13h ago
-
Staff AI Scientist USD 199K-228KCausal Inference | Collaborative Filtering | Constrained decoding | Counterfactual evaluation | EmbeddingsDental insurance | Employee Health Ring | Employee discounts | Flexible wellness time off | Health insuranceSenior-level Full TimeRemote - United States R14h ago
-
Staff Data Scientist, EGRI USD 144K-236KA/B | A/B Testing | B testing | Data Storytelling | Data VisualizationHealth and wellness programs | Time away from workSenior-level Full TimeSunnyvale, CA, United States R14h ago
-
Applied Scientist II USD 158K-190KAWS | Evaluation Frameworks | Heuristics | Huggingface | Language Models401k match | Flexible PTO | Flexible spending accounts | Medical/Dental/Vision | Teladoc HealthMid-level Full TimeNew York City, New York15h ago
-
Data Scientist USD 90K-120KAWS | Agentic AI | Azure | Cypress | Data Analysis401k employer contribution | Remote work optionMid-level Full TimeRemote, USA R15h ago
-
Applied Scientist II USD 167K-220KAgentic AI | Amazon SageMaker | Computer Vision | Data Science | Deep learningHybrid work model | Mentorship programMid-level Full TimeSeattle, Washington, United States R16h ago
-
Senior Applied Scientist USD 144K-236KCausal Inference | Data Analysis | Data Modeling | Experimentation | JavaSenior-level Full TimeMountain View, CA, United States R16h ago
-
Artificial Intelligence | C# | Data Analysis | Data Curation | Data Management401k | Career development | Dental insurance | Health insurance | Paid HolidaysSenior-level Full TimeFort Meade, MD; Science/Research; Linthicum Heights, …17h ago
-
Data Scientist / Machine Learning Engineer USD 110K-150KAPIs | Agile | CI/CD | Computer Vision | Continuous Deployment401k | Dental insurance | Flexible spending account | Health insurance | Life and AD&D insuranceMid-level Full TimeSan Diego, California; San Diego, CA; …17h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R19h ago
-
Applied Scientist III USD 236K-260KAWS | Heuristics | Huggingface | LLM Evaluation | Language Models401k match | Flexible PTO | Flexible spending accounts | Medical/Dental/Vision | TeladocSenior-level Full TimeNew York City, New York19h ago
-
Data Scientist Graduate (Multimedia) - 2027 Start USD 128K-177KA/B | A/B Testing | B testing | Causal Inference | Data MiningEntry-level Full TimeSan Jose, California, United States21h ago
-
Anomaly Detection | Classification | Data Cleansing | Data Mining | Data PreprocessingSenior-level Full TimeSan Jose, California, United States21h ago
-
A/B | A/B Testing | B testing | Experiment design | MATLABEntry-level Full TimeSan Jose, California, United States21h ago
-
Data Scientist, Search, Multimodal USD 138K-197KA/B | A/B Testing | B testing | Experiment design | Machine LearningMid-level Full TimeMountain View, CA, USA22h ago
-
A/B | A/B Testing | B testing | Database querying | Experiment designSenior-level Full TimeMountain View, CA, USA; New York, …22h ago
-
Senior Data Scientist, Core Ranking and AI Context USD 174K-252KData Analysis | Experimental Design | Machine Learning | Python | Querying databasesSenior-level Full TimeMountain View, CA, USA22h ago