Data Scientist, AI/ML Model Quality
Austin; New York City; San Diego
USD 143K-195K (estimate) Mid-level Full Time
Tasks
- Analyze telemetry for model quality
- Build validation frameworks
- Define observability metrics
- Ensure training dataset quality
- Ensure validation dataset quality
- Evaluate model outputs
- Lead telemetry analysis for GenAI workflows
- Monitor data drift
- Perform statistical analysis for model health
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Superset | Bayesian Methods | Causal Graphs | Confidence Calibration | Data Drift | Data Drift Detection | Data Generation | Data Quality | Distributed SQL | Drift Detection | Feature Drift | Feature Drift Detection | Hypothesis Testing | LLM Evaluation | Langsmith | MLflow | Machine Learning | Model Monitoring | NumPy | Observability | Pandas | Process control | PySpark | Python | SQL | Scikit-learn | Spark | Statistical Hypothesis Testing | Statistical Process Control | Synthetic Data Generation | Synthetic data | Tableau | Telemetry Analysis | Uncertainty Quantification | Weights and Biases
Education
Regions
Countries
States
Related jobs
-
Senior-level Full TimeHuntsville, United States15h ago
-
Senior Data Engineer USD 165K-184KAWS | Apache NiFi | Apache Spark | Data Modeling | Data PipelinesSenior-level Full TimeHuntsville, United States15h ago
-
Senior-level Full TimeHuntsville, United States15h ago
-
Mid-level Full TimeHuntsville, United States15h ago
-
Agile | Amazon Web Services | Apache Hive | Apache Spark | Apache ZeppelinMid-level ContractPortland, United States15h ago
-
Apache Flink | Apache Hive | Apache Kafka | Apache Spark | Apache ZookeeperSenior-level ContractPortland, United States15h ago
-
Amazon DynamoDB | Apache Hive | Java | NoSQL | Object-OrientedSenior-level ContractBeaverton, United States15h ago
-
Security Data Engineer USD 128K-214KAI | API Integration | API scaling | Anomaly Detection | Automated MonitoringDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-VA-Herndon15h ago
-
Data Scientist USD 141K-236KCloud Computing | Containerization | Data Analysis | Data Pipelines | Graph theoryHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilityMid-level Full TimeUSA-MD-Fort Meade15h ago
-
Data Engineer USD 94K-157KAWS | Air-gapped | Air-gapped environments | Bash | CRISP-DMHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Arlington, USA-Remote Work15h ago
-
Entry-level Full TimeUSA-VA-Arlington15h ago
-
Palantir MSS Developer / Engineer USD 84K-140KData Engineering | Data Modeling | Data Pipelines | Data Visualization | ELTMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …15h ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Apache Spark | Artificial Intelligence | Data Modeling | Data PipelinesDiscretionary annual incentive program | Mentorship | Professional development | Travel opportunitySenior-level Full TimeRosslyn, Virginia, United States15h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States17h ago
-
Software Engineer, Search, AI/ML USD 147K-210KC++ | Data Governance | Data Governance Framework | Data Management | Data PrivacyMid-level Full TimeCambridge, MA, USA18h ago
-
A/B | A/B Testing | B testing | Causal Inference | ClusteringMid-level Full TimeMountain View, CA, USA; San Francisco, …18h ago
-
Software Engineer, AI/ML, Google Research USD 147K-210KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Language ProcessingMid-level Full TimeMountain View, CA, USA18h ago
-
Audio to Audio Research Scientist, DeepMind USD 207K-300KArtificial Intelligence | Audio Modeling | Data sets | Evaluation datasets | Generative AIMid-level Full TimeMountain View, CA, USA; New York, …18h ago
-
Machine Learning Engineer, Search and Shopping Ads USD 262K-364KAds Prediction | Auction dynamics | Automated Model Search | Deep learning | Feature EngineeringSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …18h ago
-
Software Engineer III, Computer Vision, Pixel Camera USD 147K-210KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSan Diego, CA, USA18h ago
-
C++ | Cloud Computing | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA18h ago
-
Software Engineer III, Generative AI, Workspace Drive USD 147K-210KCode review | Computer Vision | Data Optimization | Data Preparation | DebuggingSenior-level Full TimeBoulder, CO, USA18h ago
-
Senior Software Engineer, Map Ads Machine Learning USD 174K-252KAds serving | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA18h ago
-
Staff Software Engineer, AI/ML, Google Cloud USD 207K-300KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Distributed ComputingSenior-level Full TimeNew York, NY, USA; Seattle, WA, …18h ago
-
Algorithms | Artificial Intelligence | C++ | Code Quality | Data StorageSenior-level Full TimeSunnyvale, CA, USA18h ago