Product Data Scientist — AI Evaluation & Quality (Remote)
Tasks
- Build quality dashboards
- Handle non deterministic results
- Harden judge stability
- Mine production failure patterns
- Own offline eval suite
- Propose fixes to product and domain experts
- Translate metrics into product decisions
- Turn failures into regression cases
Perks/Benefits
Skills/Tech-stack
Agentic AI | Claude Code | Data Visualization | Databricks | DeepEval | Hypothesis Testing | LLM Evaluation | Machine Learning | Python | RAG | SQL | Sampling | Statistics | Variance analysis
Education
N/A
Roles
Related jobs
-
Senior Data Scientist UAH 1377K-1549KAWS | Azure | BigQuery | ClickHouse | Data PipelinesConference access | Equipment budget | Equity options | Extra days off | Flexible work scheduleSenior-level Full TimeBulgaria; Croatia; Estonia; Greece; Hungary; Latvia; … R14d ago
-
Data Scientist EUR 51K-78KA/B | A/B Testing | AI Pipelines | B testing | BigQueryDiscounts on Company Services | Employee discounts | Extra vacation days | Free home internet | Health insuranceSenior-level Full TimeVilnius, Lithuania R20d ago
-
Data Science Lead EUR 108K-132KA I | Data Analysis | Experimentation | Machine Learning | PythonEnhanced parental leave | Female health leave | Health benefits | Hybrid work model | Learning SupportSenior-level Full TimeVilnius R21d ago
-
A/B | A/B Testing | B testing | Data cleaning | Feature EngineeringEmployee Insurance Discounts | Employee discounts | Flexible working hours | Health insurance | Involvement in charity initiativesMid-level Full TimeVilnius, Vilniaus apskritis, Lithuania R1mo ago