Data Scientist, AI/ML Model Quality
Austin; New York City; San Diego
USD 143K-195K (estimate) Mid-level Full Time
Tasks
- Analyze telemetry for model quality
- Build ML monitoring pipelines
- Build data validation frameworks
- Collaborate with engineering privacy and legal teams
- Define observability metrics
- Detect data drift
- Evaluate LLM outputs
- Monitor ML training and validation data health
- Perform statistical analysis and hypothesis testing
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Confidence Calibration | Data Drift | Data Drift Detection | Data Generation | Distributed SQL | Drift Detection | Feature Drift | Feature Drift Detection | Hypothesis Testing | LLM Evaluation | ML monitoring | Model Performance Monitoring | Model performance | NumPy | Observability | Pandas | Performance Monitoring | Process control | PySpark | Python | SQL | Scikit-learn | Statistical Process Control | Synthetic Data Generation | Synthetic data | Uncertainty Quantification
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R28d ago
-
Staff Software Engineering, GenAI Applications, YouTube USD 207K-300KDeep learning | Dense retrieval | Embedding | Hybrid retrieval | Language ModelsSenior-level Full TimeSan Bruno, CA, USA3h ago
-
Staff Product Data Scientist, Google Play USD 192K-278KBusiness Intelligence | Dashboards | Data Pipelines | Experiment design | PythonSenior-level Full TimeMountain View, CA, USA3h ago
-
Senior Software Engineer, AI/ML GenAI, Search USD 174K-252KC++ | Data Processing | Debugging | Distributed Systems | Information RetrievalSenior-level Full TimeMountain View, CA, USA3h ago
-
Research Engineer, Gemini Retrieval, DeepMind USD 174K-252KC plus plus | Information Retrieval | JAX | Language Models | Language ProcessingMid-level Full TimeMountain View, CA, USA; San Francisco, …3h ago
-
Senior Data Scientist - Authentication USD 221K-263KApache Airflow | Apache Spark | Causal Inference | Deep learning | HiveEquity compensationSenior-level Full TimeSan Mateo, CA, United States R8h ago
-
Senior, Data Analyst/BI Engineer USD 108K-145KAWS | Airflow | Amazon Redshift | BigQuery | DataStage401k matching | Healthcare dental vision coverage | PTO | Paid Company Holidays | Paid parental leaveSenior-level Full TimeUnited States R10h ago
-
Staff Machine Learning Engineer, Tools and Framework AI USD 175K-300KApplied Machine Learning | C++ | Java | Machine Learning | Machine Learning InfrastructureSenior-level Full TimeCupertino11h ago
-
Machine Learning Engineer USD 90K-210KAWS | Airflow | Azure | Computer Vision | Docker401k match | Dental insurance | Health insurance | Life insurance | Open leave policySenior-level Full TimeCambridge, MA, Arlington, VA, Seattle, WA11h ago
-
Bayesian Data Scientist USD 90K-210KAlgorithm Development | Bayesian statistics | Big Data | C# | C++10 paid holidays | 401k match | Dental insurance | Health insurance | Life insuranceMid-level Full TimeCambridge, MA, Arlington, VA12h ago
-
Junior Data Engineer USD 70K-85KAWS | Amazon Redshift | Cloud BI | Data Cleansing | Data ModelingCasual work environment | Inclusive culture | Professional developmentEntry-level Full TimeRemote - Atlanta, GA, US R14h ago
-
Werkstudent als Data Engineer (m/w/d) USD 46K-48KAmazon Web Services | CI/CD | DBT | GitHub | JavaFlexible working hours | LinkedIn Learning account | Networking opportunities | Travel cost allowanceEntry-level Part TimeUnterföhring (bei München), DE, 8577414h ago
-
AI Agents | Agent Orchestration | Code Execution | Enterprise systems | GolangFlexible work environment | Remote flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States R15h ago
-
Staff Machine Learning Engineer, Agentic App Platform USD 166K-291KAPI Design | Cloud Computing | Concurrency | Debugging | Distributed Systems401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States R15h ago
-
Display Algorithm Engineer / Machine Learning Engineer USD 166K-296KColor imaging | Image Processing | Machine Learning | PyTorch | PythonSenior-level Full TimeSan Francisco Bay Area15h ago
-
Display Algorithm Engineer / Machine Learning Engineer USD 166K-296KColor imaging | Image Processing | Machine Learning | PyTorch | PythonSenior-level Full TimeSan Francisco Bay Area15h ago
-
Senior AI Engineer (NYC) USD 144K-236KA/B | A/B Testing | B testing | Deep learning | Fine TuningHealth and wellness programs | Hybrid work flexibility | Mentorship | Paid time offSenior-level Full TimeNew York, NY, United States R15h ago
-
Software Engineer, Data Platform Team USD 152K-179KAI | Apache Airflow | BI | Data Quality | DatabricksMid-level Full TimeRemote - USA R15h ago
-
Full Stack Data Engineer USD 130K-160KAI Assisted Development | APIs | APIs integration | AWS | AirflowSenior-level Full TimeAlcoa, TN, US15h ago
-
Senior Data Scientist, Trust (Inference) USD 179K-210KA/B | A/B Testing | B testing | Bayesian Modeling | Causal InferenceEmployee travel credits | Remote work eligibleSenior-level Full TimeRemote - USA R16h ago
-
Applied AI Engineer USD 122K-176KAI Agents | AWS | Automated testing | Azure | CI/CD401k match | Educational assistance program | Employee assistance program | Employee discounts | Employee referral programMid-level Full TimeRemote (United States) R16h ago
-
Staff Analytics Engineer, Compliance Data USD 207K-244KAirflow | DBT | Data Contracts | Data Modeling | Data QualityQuarterly in person surges | Remote-first work environmentSenior-level Full TimeRemote - USA R17h ago
-
On-Device ML Infrastructure Engineer (ML User Experience APIs), Graphics, Games and Machine Learning USD 165K-293KC++ | GPU Programming | Hugging Face | JAX | KV cacheSenior-level Full TimeCupertino17h ago
-
ML Software Research Engineer USD 143K-264KC++ | Data Preprocessing | Device Machine Learning | Foundation Models | GoMid-level Full TimePittsburgh17h ago
-
Sr. Software Engineer, Customer Experience Engineering USD 200K-287KAPI Design | Cloud Computing | Code review | Container Services | DebuggingSenior-level Full TimeUS-CA-Menlo Park R17h ago