Data Scientist, AI/ML Model Quality
Austin; New York City; San Diego
USD 143K-195K (estimate) Mid-level Full Time
Tasks
- Analyze telemetry for model quality
- Build ML monitoring pipelines
- Build data validation frameworks
- Collaborate with engineering privacy and legal teams
- Define observability metrics
- Detect data drift
- Evaluate LLM outputs
- Monitor ML training and validation data health
- Perform statistical analysis and hypothesis testing
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Confidence Calibration | Data Drift | Data Drift Detection | Data Generation | Distributed SQL | Drift Detection | Feature Drift | Feature Drift Detection | Hypothesis Testing | LLM Evaluation | ML monitoring | Model Performance Monitoring | Model performance | NumPy | Observability | Pandas | Performance Monitoring | Process control | PySpark | Python | SQL | Scikit-learn | Statistical Process Control | Synthetic Data Generation | Synthetic data | Uncertainty Quantification
Education
Regions
Countries
States
Related jobs
-
Senior-level Full TimeHuntsville, United States15h ago
-
Senior Data Engineer USD 165K-184KAWS | Apache NiFi | Apache Spark | Data Modeling | Data PipelinesSenior-level Full TimeHuntsville, United States15h ago
-
Agile | Amazon Web Services | Apache Hive | Apache Spark | Apache ZeppelinMid-level ContractPortland, United States15h ago
-
Apache Flink | Apache Hive | Apache Kafka | Apache Spark | Apache ZookeeperSenior-level ContractPortland, United States15h ago
-
Amazon DynamoDB | Apache Hive | Java | NoSQL | Object-OrientedSenior-level ContractBeaverton, United States15h ago
-
Security Data Engineer USD 128K-214KAI | API Integration | API scaling | Anomaly Detection | Automated MonitoringDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-VA-Herndon15h ago
-
Data Scientist USD 141K-236KCloud Computing | Containerization | Data Analysis | Data Pipelines | Graph theoryHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilityMid-level Full TimeUSA-MD-Fort Meade15h ago
-
Data Engineer USD 94K-157KAWS | Air-gapped | Air-gapped environments | Bash | CRISP-DMHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Arlington, USA-Remote Work15h ago
-
Entry-level Full TimeUSA-VA-Arlington15h ago
-
Palantir MSS Developer / Engineer USD 84K-140KData Engineering | Data Modeling | Data Pipelines | Data Visualization | ELTMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …15h ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Apache Spark | Artificial Intelligence | Data Modeling | Data PipelinesDiscretionary annual incentive program | Mentorship | Professional development | Travel opportunitySenior-level Full TimeRosslyn, Virginia, United States15h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States17h ago
-
Software Engineer, Search, AI/ML USD 147K-210KC++ | Data Governance | Data Governance Framework | Data Management | Data PrivacyMid-level Full TimeCambridge, MA, USA18h ago
-
A/B | A/B Testing | B testing | Causal Inference | ClusteringMid-level Full TimeMountain View, CA, USA; San Francisco, …18h ago
-
Software Engineer, AI/ML, Google Research USD 147K-210KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Language ProcessingMid-level Full TimeMountain View, CA, USA18h ago
-
C++ | Cloud Computing | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA18h ago
-
Senior Software Engineer, Map Ads Machine Learning USD 174K-252KAds serving | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA18h ago
-
Algorithms | Artificial Intelligence | C++ | Code Quality | Data StorageSenior-level Full TimeSunnyvale, CA, USA18h ago
-
Systems Yield Engineer, Quantum AI USD 132K-189KCryogenic testing | Data Analysis | Data Visualization | Electrical Noise Analysis | Electrical noiseMid-level Full TimeGoleta, CA, USA18h ago
-
ANSYS | ANSYS APDL | AVL Excite | Computational Fluid Dynamics | Design optimizationMid-level Full TimeColumbus, IN, United States19h ago
-
C# | Git | JTAG | Logic analyzer | MicrocontrollersEntry-level Full TimeHillsboro, OR, US20h ago
-
AI/ML Engineer - Automation/Robotics USD 180K-200KAlgorithms | Azure Machine Learning | Data Structures | Diffusion Models | Fine Tuning401k retirement plan | Flexible spending account | Medical, dental & vision coverage | Paid time off | Parental leaveSenior-level Full TimeRedmond, WA23h ago
-
Data Engineer USD 79K-147KAccess Control | Auditing | Backup and Recovery | Bash | Caching401k match | Dental insurance | Education assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimeHighlands Ranch, CO, US1d ago
-
AWS | Algorithms | Azure | Cloud Native | Data LineageMid-level Full TimeAustin; Sunnyvale1d ago
-
Senior Machine Learning Engineer USD 149K-224KAIOps | Cloud MLOps | Cloud deployment | Data Analysis | Data Visualization401k match | Career growth opportunities | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States1d ago