Data Scientist, Decision Quality
Tasks
- Build and maintain retrospective scoring of analyst dispositions
- Capture model signals at data source with detection and platform teams
- Create feedback loops for training review guidance tooling changes and thresholds
- Define and maintain decision quality metrics
- Design sampling and review studies
- Identify causes of missed and misinterpreted defects
- Participate in code reviews sprint planning and technical design discussions
- Present findings to engineering and analysis leadership
- Quantify agreement across analysts shifts territories and test conditions
- Write and maintain transferable methodology documentation
- Write clean, tested, documented code
Perks/Benefits
- N/A
Skills/Tech-stack
Agile Development | Bias | CI/CD | Classification metrics | Experimental Design | Git | Imbalanced Data | Inter Rater Agreement | Machine Learning | Model Evaluation | Model Monitoring | NumPy | Pandas | Python | SQL | Sampling | Scikit-learn | Statistics | Supervised machine learning
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Research Scientist/Software Engineer, LLM/Agent Platform (TikTok-Content Ecology AI Innovation & Platform) USD 160K-230KCUDA | Deep learning | DeepSpeed ZeRO | Distributed Systems | Evaluation FrameworksSenior-level Full TimeSan Jose, California, United States2h ago
-
Research Scientist, Quantitative Growth Research USD 103K-163KA/B | A/B Testing | B testing | Bayesian Methods | Bias MitigationMid-level Full TimeMenlo Park, CA | New York, …2h ago
-
Tax Data Systems and Process Analyst USD 116K-166KAPI Integration | Data Warehouse | GRPC | Java | JavaScriptMid-level Full TimeChicago, IL, USA3h ago
-
A/B | A/B Testing | Anomaly Detection | B testing | Classification AlgorithmsSenior-level Full TimeSan José, CA, USA; Mountain View, …3h ago
-
Data Scientist USD 155K-180KAgile | Amazon Web Services | Apache Spark | Cloud Computing | Data ParsingSenior-level Full TimeSpringfield, VA, United States4h ago
-
Data Scientist USD 130K-140KAWS | Artificial Intelligence | Azure | Azure Data | Azure Data FactorySenior-level Full TimeArlington, VA, United States4h ago
-
Data Scientist USD 130K-137KAgile | Artificial Intelligence | Azure DevOps | Continuous Delivery | Continuous integrationOnsite Work at Least One Day Per Week | Public Trust background investigation requiredSenior-level Full TimeArlington, VA, United States4h ago
-
Senior-level Full TimeSpringfield, VA, United States4h ago
-
Active Directory | Amazon Web Services | Apache Spark | Artificial Intelligence | Azure Data401k program | Car discounts | Cruise discounts | Employee assistance program | Flexible spending accountsSenior-level Full TimeFort Worth, TX, US6h ago
-
Data Scientist USD 104K-143KAzure | Convolutional Neural Networks | Data Intelligence | Data Mining | Data cleaningMid-level Full TimeCudahy, WI, United States6h ago
-
Data Scientist (Remote) USD 92K-102KData Analysis | Language Processing | Machine Learning | Microsoft Excel | Microsoft Outlook401k savings plan | Company holidays | Employee assistance program | Paid time off | Parental leaveMid-level Full TimeOak Brook, IL, United States7h ago
-
Sr Data & AI Scientist USD 151K-215KApache Spark | Azure Machine Learning | Data Governance | Data Quality | Data Visualization401k company match | Charitable matching program | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeLeawood, KS, US9h ago
-
Senior Data Scientist - Product USD 150K-250KCausal Inference | Data Pipelines | Experimentation | Machine Learning | Model MonitoringSenior-level Full TimeSan Francisco12h ago
-
Software Developer - Embedded USD 80K-135KC# | Continuous integration | Embedded Software | Ethernet | GUI Design401k matching | Dental insurance | Disability insurance | Health savings account | Life insuranceMid-level Full TimeLas Vegas, NV, United States12h ago
-
Computer Scientist II USD 85K-100KAgile | Angular | Azure DevOps | C Sharp | CI/CD401k match | Dental insurance | Disability insurance | Health savings account | Life insuranceMid-level Full TimeLas Vegas, NV, United States12h ago
-
Computer Scientist III USD 103K-142KC++ | Computer networks | Configuration Management | Deployment | Development Lifecycle401k match | Dental insurance | Disability insurance | Health savings account | Life insuranceSenior-level Full TimeNorth Las Vegas, NV, United States12h ago
-
Computer Scientist - openMCT USD 135K-165KBrowser Developer Tools | CSS3 | Data Visualization | Developer tools | Git401k matching | Dental insurance | Disability insurance | Flexible spending account | Health savings accountMid-level Full TimeEdwards AFB, CA, United States12h ago
-
Entry-level Full TimeLas Vegas, NV, United States12h ago
-
AI in Residence, Computational Protein Design USD 120K-180KData Curation | Deep learning | Experiment design | Interpretability | Language ProcessingCohort support | Mentorship | Structured feedbackEntry-level Full TimeSeattle, Washington, United States14h ago
-
Machine Learning Engineer USD 210K-240KA/B | A/B Testing | B testing | Data Pipelines | Data Processing401k plan | Commuter benefits | E Bike Transportation | Generous PTO | Learning and development stipendMid-level Full TimeSan Francisco, CA (Hybrid) R16h ago
-
Lead Data Scientist, Rail Data and Risk USD 130K-200KData Analysis | GIS | Geospatial Data | Geospatial Data Analysis | Hypothesis TestingSenior-level Full TimeShelton, CT17h ago
-
Data Scientist Manager USD 164K-171KDataRobot | MLOps | Machine Learning | Power BI | PythonDomestic travel 10 percent | Remote work up to two days per weekMid-level Full TimeMorristown, NJ, United States17h ago
-
Data Scientist USD 84K-124KArtificial Intelligence | Data Analysis | Data Engineering | Data Modeling | Data VisualizationHealth insurance | Paid time off | Retirement savingsMid-level Full TimeMorristown, NJ, United States17h ago
-
AI Research Scientist- World Model USD 165K-185K3D Reconstruction | C++ | Computer Vision | Deep learning | Diffusion Models401k matching | Disability insurance | Financial planning support | Health insurance | Life insuranceMid-level Full TimeSunnyvale, CA, United States18h ago
-
Senior Data Scientist USD 209K-266KA/B | A/B Testing | B testing | Bayesian Inference | Causal InferenceCross-functional collaboration | Equity package | Flexible schedule | Hybrid work schedule | Inclusive work environmentSenior-level Full TimeSunnyvale R18h ago