Sr Applied Scientist, Support Agent Intelligence and Evaluation
Tasks
- Build cross lingual retrieval models
- Build issue resolution metrics
- Calibrate confidence for answers
- Design evaluation frameworks
- Design resolution metric experiments
- Develop LLM based scoring pipelines
- Develop conversation level resolution signals
- Develop cross lingual evaluation methods
- Improve answer correctness scoring
- Improve multilingual resolution rates
- Improve retrieval and generation models
- Model translation quality
- Optimize models for real time latency SLAs
- Partner with product and engineering teams
- Productize research findings
Perks/Benefits
- 401k matching
- Dental insurance
- Employee assistance program
- Health insurance
- Paid time off
- Parental leave
- Vision insurance
Skills/Tech-stack
A/B | A/B Testing | B testing | Confidence Calibration | Cross-lingual Transfer | Deep learning | Distributed Systems | Evaluation metrics | Hadoop | Information Retrieval | Language Models | Language Processing | Large Language Models | Machine Learning | Multilingual NLP | Natural Language | Natural Language Processing | Neural Networks | NumPy | Quality modeling | R | Retrieval-Augmented Generation | SciPy | Scikit-learn | Spark | TensorFlow | Translation Quality | Translation Quality Modeling
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Staff Machine Learning Engineer, DUE USD 238K-302KAnomaly Detection | C++ | Data Processing | Deep learning | Hugging FaceSenior-level Full TimeMountain View, CA, USA5h ago
-
AI Solutions Engineer USD 126K-176KArchitecture Design | Artificial Intelligence | Data Mapping | Data Templates | DataverseHybrid work arrangement | Relocation N/A | Travel opportunityMid-level Full TimePhoenix, AZ, US6h ago
-
Staff Data Scientist - Digital Intelligence USD 191K-230KAdversarial Modeling | Anomaly Detection | Apache Spark | Data Processing | Distributed dataSenior-level Full TimeHybrid - US R6h ago
-
Lead Consultant Data Scientist USD 130K-172KAgile Scrum | Apache Spark | Cloud Computing | Data Governance | Data QualityCare Com Membership | Dental benefits | Emergency child care days | Floating holidays | Headspace membershipSenior-level Full TimeArlington, Virginia, United States, Remote Flexible R7h ago
-
Senior Research Data Scientist USD 330K-375KCausal Inference | Counterfactuals | Difference-in-differences | Double Machine Learning | Doubly RobustDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeNew York, New York7h ago
-
Senior Research Data Scientist USD 330K-375KCausal Inference | Counterfactuals | Difference-in-differences | Distributed Computing | Double Machine LearningCommuter benefits | Disability benefits | Equity awards | Financial wellness support | Health insuranceSenior-level Full TimeBoston, Massachusetts7h ago
-
Data Scientist ll - Digital Intelligence USD 140K-170KDatabricks | Experiment analysis | Feature Engineering | Machine Learning | Model EvaluationMid-level Full TimeHybrid - US R7h ago
-
Applied Scientist, Fauna USD 142K-193K3D Perception | Benchmarking | C++ | Machine Learning | ManipulationMid-level Full TimeSunnyvale, California, USA11h ago
-
Forward Deployed Engineer (FDE) - Intern - 2026-2027 USD 120K-155KA/B | A/B Testing | Asyncio | B testing | Cloud infrastructureEntry-level InternshipSan Francisco11h ago
-
Forward Deployed Engineer (FDE) - New Grad - 2026-2027 USD 125K-178KA/B | A/B Testing | Asyncio | B testing | Cloud infrastructureEntry-level Full TimeSan Francisco11h ago
-
Staff Software Engineer, Agentic Applications USD 198K-272KApproval Workflow | Audit Logging | Behavioral Regression | Behavioral Regression Testing | Content ManagementSenior-level Full TimeMountain View, California12h ago
-
Senior/Staff Machine Learning Engineer USD 223K-268KAPI Integration | Anomaly Detection | Class Imbalanced Modeling | Databases | Drift DetectionHealth benefits | Long-term incentives | Medical benefits | Performance bonusSenior-level Full TimeSan Jose, California, United States13h ago
-
Senior-level Full TimeMountain View, California; San Francisco, California13h ago
-
Staff Software Engineer- CXI USD 164K-225KAPIs | AWS | Agentic Automation | Azure | Backend DevelopmentSenior-level Full TimeMountain View, California; San Francisco, California13h ago
-
Computational Linguist, AI Evaluation USD 140K-160KAWS EC2 | AWS S3 | Analytics | Automated scoring | BenchmarkingCo-working memberships | Daily meals provided | Flexible PTO | Health, dental, vision benefits | Learning and development stipendSenior-level Full TimeSan Francisco13h ago
-
Senior Software Engineer, Foundation Model API USD 160K-225KCloud Native | Deployment Pipelines | Distributed Systems | GPU Orchestration | GoSenior-level Full TimeSan Francisco, California13h ago
-
Senior Software Engineer (Applied AI) USD 160K-200KAPIs | AWS | Agentic Workflows | Best practices | Cost monitoringCareer development | Discretionary performance bonus | Equity options | Health benefitsSenior-level Full TimeSeattle, New York City, Boston, or … R14h ago
-
Staff Data Platform Engineer USD 213K-245KAWS | AWS Lambda | CDK | CI/CD | Code Quality401k match | Catered lunches | Dental insurance | Flexible work schedule | HackathonsSenior-level Full TimeRemote, United States R14h ago
-
Senior Software Engineer, Perception Architecture USD 184K-296KC++ | Computer Vision | Data pipeline | Deep learning | Machine LearningSenior-level Full TimePittsburgh, PA or Remote R14h ago
-
Lead Data Scientist, Demand Forecasting USD 160K-192KBayesian Modeling | Data Pipelines | Data Quality | Hierarchical modeling | MLOps401k match | Dental insurance | Income protection | Medical insurance | Paid time offSenior-level Full TimeCharlotte, North Carolina, United States14h ago
-
Mid-level Full Time上海、圣何塞15h ago
-
Senior Software Engineer, Data & AI Platform USD 171K-224KApache Spark | Batch Processing | CI/CD | Cloud Native | Data Engineering401k retirement savings plan | Annual cash bonus | Equity grants | Flexible time off | Generous parental leaveSenior-level Full TimeRemote, USA R15h ago
-
Generative AI - ML System Engineering USD 175K-300KBF16 | C++ | CUDA | Data loading | Data-parallelComprehensive benefits package | Growth opportunities | In-office work | Silicon Valley work environmentSenior-level Full TimeBay Area Office15h ago