Product Data Scientist — AI Evaluation & Quality
Tasks
- Build online quality dashboards
- Harden judge stability and handle non determinism
- Mine failure patterns from production traffic
- Own and extend offline eval suite
- Propose fixes to product and domain experts
- Translate metrics into product decisions
- Turn failures into regression cases
Perks/Benefits
- EU travel flexibility
- Personal development opportunities
- Remote/work hybrid options
- Stock options program
- Supportive company culture
- Work and Swim program
Skills/Tech-stack
Agent evaluation | Classification | Claude Code | Databricks | DeepEval | Hypothesis Testing | LLM-as-judge | Machine Learning | Python | RAG | Ranking | Recommendation Systems | SQL | Sampling | Statistics | Variance
Education
N/A
Roles
Related jobs
-
Senior Data Scientist UAH 1377K-1549KAWS | Azure | BigQuery | ClickHouse | Data PipelinesConference access | Equipment budget | Equity options | Extra days off | Flexible work scheduleSenior-level Full TimeBulgaria; Croatia; Estonia; Greece; Hungary; Latvia; … R8d ago
-
Data Science Manager (Credit) PLN 171K-276KA/B | A/B Testing | Affordability Modeling | B testing | Behavioral ModelingContinuous learning and career growth | Flexible work arrangements | Health insurance | Pension plansMid-level Full TimeRemote, Poland R9d ago
-
Senior Data Scientist - Freelance PLN 168K-273KAWS | Agile | Airflow | Apache Spark | Code reviewAgile collaboration | Code review | Continuous integration | Cross-industry projects | Internal knowledge baseSenior-level Contract FreelancePoland - Remote R10d ago
-
Apache Airflow | Apache Spark | Bayesian Methods | BigQuery | Causal InferenceBonus incentives | Cafeteria benefits plan | English classes | Flexible working hours | Hybrid remote workMid-level Full TimePoznań, PL, 61-569 R11d ago
-
Agentic AI | Airflow | Apache Airflow | Bayesian Methods | BigQueryCafeteria benefits plan | English classes | Equipment provided | Flexible working hours | Hybrid workMid-level Full TimePoznań, PL, 61-569 R11d ago
-
Data Scientist PLN 348K-394KAmazon Redshift | Causal Inference | Data Modeling | Data Processing | Distributed dataCareer growth budget | Dental coverage | Fertility healthcare and family forming support | Group life insurance | Gym/Fitness reimbursementMid-level Full TimeWarsaw R11d ago
-
Senior Manager, Product Data Science & Experimentation PLN 250K-329KA/B | A/B Testing | B testing | Causal Inference | Causal measurementRemote workSenior-level Full TimePoland R18d ago
-
Principal Product Data Scientist PLN 257K-348KAgentic AI | Causal Inference | Classification | Clustering | ExperimentationSenior-level Full TimePoland R18d ago
-
Senior Data Scientist, Classification & Discovery PLN 257K-384KCI/CD | Confidence Calibration | Cypher | Deduplication | Drift DetectionCareer development | Employee referral bonuses | Flexible time off | Fun events | Remote workSenior-level Full TimeIndia; Czechia; Poland R18d ago
-
Senior Data Scientist PLN 241K-328KEstimation | GIS | Machine Learning | Predictive Analytics | PythonFlexible working hours | Life insurance | Meal allowance | Medical coverage | Paid time offSenior-level Full TimeKrakow, Poland R24d ago
-
Airflow | Bayesian Methods | BigQuery | Causal Inference | Cloud ComposerCafeteria plan benefits | Conference participation | English classes | Hackathons | Hybrid workMid-level Full TimeWarszawa, PL, 00-841 R25d ago
-
Airflow | Batch Processing | Bayesian Methods | BigQuery | BoostingEnglish classes | Hackathons | Hybrid work model | Meal vouchers | Medical insuranceMid-level Full TimeWarszawa, PL, 00-841 R25d ago
-
Senior Data Scientist – Procurement (m/f/d) PLN 122K-163KAnomaly Detection | Azure | Databricks | Forecasting | MLOpsCareer development | Flexible scheduling | Hybrid work | Remote work on flexible FridaysSenior-level Full TimePOL - Wrocław Office, Poland R30d ago
-
Senior Data Scientist PLN 211K-328KClassification | Databases | Grafana | Kibana | LightGBMCollaborative team culture | Paid time off | Professional support from HRSenior-level Full TimePoland - Remote R1mo ago
-
Senior Data Scientist (Marketing) PLN 258K-342KAttribution | Bayesian Modeling | Causal Inference | Databricks | Experimental Design3 days in office per week | Hybrid work model | In office first cultureSenior-level Full TimeWarszawa , Mazowieckie, Poland R1mo ago
-
Anomaly Detection | Classification | Computer Vision | Decision Systems | EfficientNetRemote workMid-level Full TimeRemote, Poland R1mo ago
-
AI Governance Data Scientist PLN 118K-151KAI Act | Access Control | Bias Assessment | Classification | ClusteringHybrid work model | Work from home | Work-life balanceMid-level Full TimeGdańsk, Pomorskie, PL R1mo ago