AI Data Scientist
Tasks
- Analyze production logs for model failures
- Build evaluation datasets
- Build tooling for AI performance dashboards
- Create rubrics and synthetic test cases
- Design and run end to end experiments
- Identify hallucinations and quality issues
- Monitor AI performance in production
- Productionize successful experiments
- Track product and operational metrics
- Validate improvements with engineers
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | B testing | Data evaluation | Experimentation | Information Retrieval | Language Models | Language Processing | Large Language Models | Machine Learning | Model Monitoring | Natural Language | Natural Language Processing | Prompt engineering | Python | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R22h ago
-
Senior Applied AI Scientist USD 182K-220KCausal Inference | Data Pipelines | Experiment design | LLM | Machine LearningSenior-level Full TimeNew York, NY9h ago
-
AI Scientist, Computational Protein Design USD 120K-240KArtificial Intelligence | Deep learning | Distributed Training | GPU Computing | Generative AIMid-level Full TimeSouth San Francisco, California, United States11h ago
-
Senior-level Full TimeFort Meade, MD12h ago
-
Sr. Data Scientist, Performance Marketing USD 139K-287KCausal Inference | Dashboarding | ETL | Experimentation | ForecastingSenior-level Full TimeSan Francisco, CA, US; Remote, US R13h ago
-
Data Scientist II USD 130K-145KAPIs | AWS | Anndata | Bulk RNA sequencing | CWL401k match | Educational benefits | Flexible spending accounts | Medical, dental & vision coverage | Paid HolidaysMid-level Full TimeRockville, MD15h ago
-
Data Engineer - CENTCOM USD 130K-149KAPI Development | AWS | Apache Spark | Azure | Data ValidationSCIF work environment | Top-Secret Clearance supportSenior-level Full TimeTampa, FL15h ago
-
Bioinformatics Scientist USD 100K-106KBulk RNA sequencing | ChIP-seq | Cluster Analysis | Data Normalization | Data Quality401k match | Dependent Care Assistant Program | Educational benefits | Employee referral bonus | Flexible spending accountMid-level Full TimeResearch Triangle Park, NC17h ago
-
Bioinformatics Scientist USD 120K-148KBehavioral Data | Behavioral Data Analysis | Cloud-Based Computing | Cloud-based | Data Analysis401k match | Dependent Care Assistant Program | Educational benefits | Flexible spending account | Medical, dental & vision coverageSenior-level Full TimeResearch Triangle Park, NC17h ago
-
Agent Post-Training, Context Research USD 295K-445KData Pipelines | Deep learning | Experimentation | Grading | Language ModelsMid-level Full TimeSan Francisco18h ago
-
AI Feedback | Data Pipelines | Evaluation | Experiment design | GradingMid-level Full TimeSan Francisco18h ago
-
Agent Post-Training, API & Power Users USD 295K-445KAI Feedback | Agent systems | Computer use | Cost Optimization | Data GenerationSenior-level Full TimeSan Francisco18h ago
-
Research Engineer / Research Scientist, Vision USD 350K-850KAgentic Systems | Benchmarking | Computer Vision | Data Pipelines | Deep learningFlexible working hours | Generous vacation | Hybrid work option | Optional equity donation matching | Parental leaveSenior-level Full TimeNew York City, NY; San Francisco, …18h ago
-
Data Scientist, North America Onboarding Team USD 180K-200KA/B | A/B Testing | Anomaly Detection | B testing | Data PipelinesEntry-level Full TimeAustin, United States19h ago
-
AI/ML | AI/ML concepts | API Integration | Alteryx | Augmented analytics401k match | Long-term disability | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leaveSenior-level Full Time1101 Church ST, Nashville, Tennessee, United …19h ago
-
Senior Applied AI/ML Scientist - Compass USD 196K-269KAgentic AI | Artificial Intelligence | Cost Optimization | Data Modeling | Data strategyHybrid work flexibility | Remote work optionSenior-level Full TimeNew York City, NY; San Francisco, … R20h ago
-
Data Scientist, Marketing Analytics USD 130K-250KA/B | A/B Testing | Attribution Modeling | B testing | Conversion RateMid-level Full TimeAustin, Texas21h ago
-
AWS | Agentic AI | Azure | CI/CD | Cloud platform401k | Medical | Paid sick leaveMid-level ContractSouth San Francisco, United States21h ago
-
Senior-level Full TimeMiami, New York, San Francisco22h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 202K-368KCUDA | Distributed Training | GPU Performance | GPU Performance Optimization | Language ModelsEntry-level Full TimeSan Jose, California, United States23h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-170KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States23h ago
-
Sr. Data Scientist USD 131K-198KMachine Learning | Python | R | SQL | Statistical modelingHybrid work schedule | Limited travelSenior-level Full TimeRaleigh, North Carolina, United States23h ago
-
Senior Data Scientist - Government & Public Services USD 131K-218KClass imbalance | Cloud Computing | Data Exploration | Data Preparation | Data leakageSenior-level Full TimeArlington/Rosslyn, Virginia, United States23h ago
-
Data Scientist, Product Analytics USD 178K-204KArtificial Intelligence | Data Mining | Experimentation | Forecasting | Key Performance IndicatorsMid-level Full TimeSunnyvale, CA | Menlo Park, CA … R1d ago
-
Staff AI Research Scientist, Applied AI, Google Cloud USD 207K-301KC++ | Data Mining | Deep learning | Generative AI | Information RetrievalSenior-level Full TimeSunnyvale, CA, USA1d ago