Product Data Scientist — AI Evaluation & Quality
Tasks
- Build offline datasets and judges
- Convert failures into regression cases
- Define and track quality metrics
- Extend offline eval suite
- Handle non determinism
- Harden judge stability methodology
- Maintain online quality dashboards
- Mine production failure patterns
- Monitor resolution rate and CSAT
- Own eval loop for AI products
- Propose fixes to product and domain experts
Perks/Benefits
- Corporate apartment stay
- Hybrid work
- Remote work option
- Stock options
- Wellbeing support
- Work and Swim program
- Work travel flexibility
Skills/Tech-stack
Databricks | Deep learning | Hypothesis Testing | LLM-as-judge | Python | SQL | Sampling | Statistics | Variance
Education
N/A
Roles
Related jobs
-
Senior Data Scientist, Growth Data Products EUR 61K-75KApache Spark | Data Pipelines | Distributed Computing | Guardrails | Hypothesis TestingAnnual learning budget | Discounts on company activities | Fitness budget | Health and wellness benefits | Hybrid work modelSenior-level Full TimeBerlin R1d ago
-
Staff Data Scientist, Growth Data Products EUR 57K-74KA/B | A/B Testing | AWS | Airflow | Apache SparkDiscounts on company activities | Fitness budget | Health and wellness benefits | Hybrid work arrangement | Language reimbursementSenior-level Full TimeBerlin R1d ago
-
Senior/Staff Data Scientist, Analytics EUR 62K-79KCausal Inference | Causal modeling | Classification | Clustering | Confidence IntervalsHybrid work | Remote workSenior-level Full TimeBerlin, Remote in Germany R2d ago
-
Adobe Experience | Adobe Experience Cloud | CDP Activation | Customer Journey | Customer Journey Analytics100 percent remote | Full time or part time | Long-term contractMid-level ContractBerlin R3d ago
-
Agents | Data Architecture | Data Ingestion | Data Modeling | Data PipelinesAnnual performance bonus | Equipment support | Flexible working hours | Gifts and rewards | In-person team eventsSenior-level Full TimeGermany R4d ago
-
(Junior) Data Scientist (m/w/d) EUR 50K-56KAWS | Agile | Azure | Data Modeling | Data VisualizationBike leasing | Coaching | Company pension | Corporate benefits | Deutschland-Ticket subsidyEntry-level Full TimeMünchen, Berlin, Leipzig, Hybrid R7d ago
-
Senior Data Scientist, Growth Data Products EUR 60K-75KApache Spark | Data Pipelines | Distributed Computing | Langchain | Language ModelsAnnual personal growth budget | Discounts on company activities | Fitness budget | Health and wellness benefits | Hybrid work scheduleSenior-level Full TimeBerlin R7d ago
-
Apache Spark | Big Data | Cohort Analysis | Data Analysis | Exploratory Data AnalysisAutonomy and ownership | Company-provided laptop | Flexible paid time off | Health and wellness budget | Home office setup allowanceSenior-level Full TimeGermany R8d ago
-
Carbon Accounting | Data Modeling | Data Pipelines | ETL | EmbeddingsAltersvorsorge | Bicycle leasing | Corporate benefits | Flexible working hours | MacBook equipment allowanceEntry-level Internship Part TimeRemote (Deutschland), Münster R9d ago
-
Analytics Platforms | DBT | Data Modeling | Data Pipelines | Data QualityCoaching opportunities | Fully remote | Hack days | Internal knowledge sharing | Parental leaveSenior-level Full TimeGermany R9d ago
-
Research Scientist Computational Biology EUR 64K-64KBitbucket | Data integration | FAIR-Data | GitHub | Machine LearningHybrid workEntry-level Full TimeBiberach, Germany, Baden-Württemberg R9d ago
-
Data Scientist (m/w/d) // Remote möglich EUR 21K-21KAWS | Agile | Azure | CatBoost | GCPAdditional retirement contributions | Additional vacation days | Company bike | Employee discount | Leadership programsEntry-level Full TimeBerlin, Germany R11d ago
-
Data Scientist (m/w/d) // Remote möglich EUR 21K-21KAgile | Amazon Web Services | Azure | CatBoost | Cloud platformAdditional vacation days from year 5 | Company bike | Employee discount | Remote work option | Urban Sports membership subsidyEntry-level Full TimeHamburg, Germany R11d ago
-
Data Scientist (m/w/d) // Remote möglich EUR 21K-21KAgile | Amazon Web Services | Azure | CatBoost | Cloud platformAdditional paid time off | Company bike | Employee discount | Remote work allowed | Training opportunitiesEntry-level Full TimeDüsseldorf, Germany R11d ago
-
Data Scientist (m/w/d) // Remote möglich EUR 21K-21KAWS | Agile | Azure | CatBoost | GCPAdditional vacation days | Company bike | Employee discount | Mobile work | Retirement savings allowanceEntry-level Full TimeMünchen, Germany R11d ago
-
Data Scientist (m/w/d) // Remote möglich EUR 21K-21KAWS | Agile | Azure | CatBoost | GCPAdditional vacation days | Company bike | Führungsprogramme | Mitarbeitendenrabatt | Mobile workingEntry-level Full TimeStuttgart, Germany R11d ago
-
Data Scientist - AI Search & Ranking EUR 56K-80KA/B | A/B Testing | Airflow | B testing | Bias MitigationConference access | Daily canteen budget | Employee snacks and drinks | Employer supported childcare assistance | Flexible working hoursSenior-level Full TimeDüsseldorf R15d ago
-
Senior Tensor AI Scientist EUR 68K-90KDeep learning | Distributed Training | GPU | GPU Computing | Gradient descentDiverse, supportive culture | Flexible working arrangements | Guidance mentorship | Personal development plan | Professional developmentSenior-level Full TimeGermany - Hybrid R15d ago
-
Bioinformatics | Case management | Cause analysis | Command Line | Customer supportEmployee benefits | Healthcare | Training and developmentEntry-level Full TimeGermany - Darmstadt - Frankfurter Str. … R16d ago
-
Senior Data Scientist - Europe EUR 54K-85KAWS | Amazon EC2 | Amazon S3 | Computer Vision | Deep learningContinuous learning | Flexible working model | Innovation community | Mentorship | Opportunity for thought leadershipSenior-level Contract Full TimeBerlin, Germany - Remote R22d ago
-
(Senior) Specialist Data Analytics (w/m/d) EUR 50K-52KDashboards | Data Engineering | Data Science | Data Visualization | Data analyticsCollegial work environment | Early responsibility | Flexible work location | Modern equipment | Professional developmentMid-level Full Timedeutschlandweit R26d ago
-
Dashboard Design | Data Analysis | Data Modeling | Data Warehouse | PythonCompany fitness | Flexible working hours | Hybrid work | Team eventsEntry-level Contract Part Timebundesweit, Germany R29d ago
-
Data Analysis | Data Visualization | Python | R | ResearchCareer development | Coaching and mentoring | Hybrid work | Remote work flexibility | Travel opportunitiesSenior-level Full TimeBerlin - Mittelstrasse, Germany R30d ago
-
Senior Data Scientist (Commodity Markets) m/f/d EUR 59K-98KAWS | Cloud Computing | Containerization | Dash | Data ModelingAdditional paid leave | Fitness studio | Work from anywhereSenior-level Full TimeGermany - Karlsruhe R1mo ago
-
Senior Data Scientist (Commodity Markets) m/f/d EUR 59K-98KAWS | Cloud Platforms | Dash | Data Modeling | DockerAdditional leave for social engagement | Fitness studio | Occasional Global Travel | Work from anywhereSenior-level Full TimeGermany - Karlsruhe R1mo ago