Product Data Scientist — AI Evaluation & Quality
Tasks
- Build offline datasets and judges
- Convert failures into regression cases
- Define and track quality metrics
- Extend offline eval suite
- Handle non determinism
- Harden judge stability methodology
- Maintain online quality dashboards
- Mine production failure patterns
- Monitor resolution rate and CSAT
- Own eval loop for AI products
- Propose fixes to product and domain experts
Perks/Benefits
- Corporate apartment stay
- Hybrid work
- Remote work option
- Stock options
- Wellbeing support
- Work and Swim program
- Work travel flexibility
Skills/Tech-stack
Databricks | Deep learning | Hypothesis Testing | LLM-as-judge | Python | SQL | Sampling | Statistics | Variance
Education
N/A
Roles
Related jobs
-
AWS | AWS Lambda | Amazon EC2 | Amazon S3 | Amazon SageMakerB2B contract | Flexible work hours | Fully remote | Knowledge sharing | Mentorship opportunitiesSenior-level Contract Full TimeGermany R1d ago
-
Senior Data Scientist - Europe EUR 54K-85KAWS | Amazon EC2 | Amazon S3 | Computer Vision | Deep learningContinuous learning | Flexible working model | Innovation community | Mentorship | Opportunity for thought leadershipSenior-level Contract Full TimeBerlin, Germany - Remote R2d ago
-
A/B | A/B Testing | AWS | Apache Spark | B testingAnnual company retreats | Flexible working hours | Fully remote-first | High-end equipment | Paid annual leaveMid-level Full TimeGermany R4d ago
-
Dashboard Design | Data Analysis | Data Modeling | Data Warehouse | PythonCompany fitness | Flexible working hours | Hybrid work | Team eventsEntry-level Contract Part Timebundesweit, Germany R9d ago
-
Algorithms | Computer Science | Data Analysis | Data Mining | Data VisualizationFlexible working hours | Hybrid work model | MentorshipEntry-level Full Time Part TimeSchwalbach / Frankfurt, Germany R9d ago
-
Bioinformatics | Command Line | Customer support | Data Analysis | LinuxEmployee benefits | Health insurance | Paid time off | Professional developmentMid-level Full TimeGermany - Darmstadt - Frankfurter Str. … R9d ago
-
Data Analysis | Data Visualization | Python | R | ResearchCareer development | Coaching and mentoring | Hybrid work | Remote work flexibility | Travel opportunitiesSenior-level Full TimeBerlin - Mittelstrasse, Germany R10d ago
-
Senior Data Scientist (Commodity Markets) m/f/d EUR 59K-98KAWS | Cloud Computing | Containerization | Dash | Data ModelingAdditional paid leave | Fitness studio | Work from anywhereSenior-level Full TimeGermany - Karlsruhe R11d ago
-
Senior Data Scientist (Commodity Markets) m/f/d EUR 59K-98KAWS | Cloud Platforms | Dash | Data Modeling | DockerAdditional leave for social engagement | Fitness studio | Occasional Global Travel | Work from anywhereSenior-level Full TimeGermany - Karlsruhe R11d ago
-
AWS | Anomaly Detection | Azure | Cloud platform | Data PipelinesFlexible working hours | Part time work available | Pro rata vacation days | Remote work optionEntry-level Part TimeUlm, Germany R11d ago
-
Data Scientist - AI Search & Ranking EUR 55K-85KA/B | A/B Testing | B testing | Dense retrieval | Entity recognitionFitness options | Flexible working hours | Health childcare support | On-site gym | Relocation supportSenior-level Full TimeDüsseldorf R14d ago
-
Active Learning | Anomaly Detection | Bayesian optimization | Cloud Computing | ContainerizationBuddy program | Childcare subsidy | Coaching and Meditation | Company pension plan | Corporate benefitsEntry-level Full TimeFrankfurt, München, Berlin, Essen, Hybrid, Nürnberg R21d ago
-
Azure | CI/CD | CRM | Classification | ClusteringCompany health management | Flexible working hours | Home office option | Hybrid work | Jobrad eBike leasing supportSenior-level Full Time Part TimeRatingen, Germany; Ratingen, NRW, Germany; Ratingen R30d ago
-
AWS | Azure | Data Aggregation | Data Deduplication | Data Monitoring100% remote | Long-term contractMid-level ContractBerlin R1mo ago
-
(Associate) Manager Data Science & AI (m/w/d) EUR 50K-60KAgent systems | Amazon Web Services | Artificial Intelligence | Cloud Computing | Cloud platformCompany Car via Salary Conversion | Company fitness | Duz-culture | Family service | Flexible vacationMid-level Full Timebundesweit, Germany R1mo ago
-
Working Student Data Science Forecasting (m/f/d) EUR 32K-34KAWS | Azure | BigQuery | DBT | DockerEGYM Wellpass | Futurebens discounts | Remote workEntry-level Part TimeHamburg, Remote, Berlin, München R1mo ago
-
Senior Data Scientist (f/m/x) EUR 45K-51KA/B | A/B Testing | AWS | Azure | B testingDiscounts on Autohero | Educational budget | International team with flat hierarchies | Knowledge sharing sessions | Remote work optionSenior-level Full TimeBerlin, BE, Germany R1mo ago
-
Principal AI Scientist EUR 68K-84KAcoustic Modeling | Automatic Speech Recognition | Fine Tuning | Generative AI | Language ModelingSenior-level Full TimeRemote - Germany R1mo ago
-
Chatbots | Churn modeling | Credit Risk | Customer churn | Customer churn modelingFlexible work arrangements | Hybrid working | International travel | Workplace support coachingSenior-level Full TimeBerlin - Mittelstrasse, Germany R1mo ago
-
Applied Machine Learning Scientist GBP 74K-100KAlgorithms | Data Structures | Deep learning | Machine Learning | OptimizationConference funding | Health benefits | Mental health care program | Paid time off | Parental leaveSenior-level Full TimeGermany; Ireland; London; United Kingdom R1mo ago
-
Scientist for Hybrid Photonic Integration in Quantum Technologies with a Focus on Quantum Sensing EUR 48K-54KArtificial Intelligence | Characterization | Data Analysis | Design | Integrated photonicsDiscounted BVG ticket | Emergency care | Employee discounts | Flexible working hours | Health and sports facilitiesMid-level Full TimeBerlin, DE, 10587 R1mo ago