AI Data Scientist
Tasks
- Analyze production logs for model failures
- Build evaluation datasets
- Build tooling for AI performance dashboards
- Create rubrics and synthetic test cases
- Design and run end to end experiments
- Identify hallucinations and quality issues
- Monitor AI performance in production
- Productionize successful experiments
- Track product and operational metrics
- Validate improvements with engineers
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | B testing | Data evaluation | Experimentation | Information Retrieval | Language Models | Language Processing | Large Language Models | Machine Learning | Model Monitoring | Natural Language | Natural Language Processing | Prompt engineering | Python | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R20h ago
-
Senior Applied AI Scientist USD 182K-220KCausal Inference | Data Pipelines | Experiment design | LLM | Machine LearningSenior-level Full TimeNew York, NY7h ago
-
Senior-level Full TimeFort Meade, MD10h ago
-
Sr. Data Scientist, Performance Marketing USD 139K-287KCausal Inference | Dashboarding | ETL | Experimentation | ForecastingSenior-level Full TimeSan Francisco, CA, US; Remote, US R11h ago
-
Data Scientist II USD 130K-145KAPIs | AWS | Anndata | Bulk RNA sequencing | CWL401k match | Educational benefits | Flexible spending accounts | Medical, dental & vision coverage | Paid HolidaysMid-level Full TimeRockville, MD13h ago
-
Data Engineer - CENTCOM USD 130K-149KAPI Development | AWS | Apache Spark | Azure | Data ValidationSCIF work environment | Top-Secret Clearance supportSenior-level Full TimeTampa, FL13h ago
-
Bioinformatics Scientist USD 100K-106KBulk RNA sequencing | ChIP-seq | Cluster Analysis | Data Normalization | Data Quality401k match | Dependent Care Assistant Program | Educational benefits | Employee referral bonus | Flexible spending accountMid-level Full TimeResearch Triangle Park, NC15h ago
-
Bioinformatics Scientist USD 120K-148KBehavioral Data | Behavioral Data Analysis | Cloud-Based Computing | Cloud-based | Data Analysis401k match | Dependent Care Assistant Program | Educational benefits | Flexible spending account | Medical, dental & vision coverageSenior-level Full TimeResearch Triangle Park, NC15h ago
-
Agent Post-Training, Context Research USD 295K-445KData Pipelines | Deep learning | Experimentation | Grading | Language ModelsMid-level Full TimeSan Francisco16h ago
-
AI Feedback | Data Pipelines | Evaluation | Experiment design | GradingMid-level Full TimeSan Francisco16h ago
-
Agent Post-Training, API & Power Users USD 295K-445KAI Feedback | Agent systems | Computer use | Cost Optimization | Data GenerationSenior-level Full TimeSan Francisco16h ago
-
Research Engineer / Research Scientist, Vision USD 350K-850KAgentic Systems | Benchmarking | Computer Vision | Data Pipelines | Deep learningFlexible working hours | Generous vacation | Hybrid work option | Optional equity donation matching | Parental leaveSenior-level Full TimeNew York City, NY; San Francisco, …16h ago
-
AI/ML | AI/ML concepts | API Integration | Alteryx | Augmented analytics401k match | Long-term disability | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leaveSenior-level Full Time1101 Church ST, Nashville, Tennessee, United …18h ago
-
Senior Applied AI/ML Scientist - Compass USD 196K-269KAgentic AI | Artificial Intelligence | Cost Optimization | Data Modeling | Data strategyHybrid work flexibility | Remote work optionSenior-level Full TimeNew York City, NY; San Francisco, … R18h ago
-
Data Scientist, Marketing Analytics USD 130K-250KA/B | A/B Testing | Attribution Modeling | B testing | Conversion RateMid-level Full TimeAustin, Texas19h ago
-
AWS | Agentic AI | Azure | CI/CD | Cloud platform401k | Medical | Paid sick leaveMid-level ContractSouth San Francisco, United States19h ago
-
Senior-level Full TimeMiami, New York, San Francisco20h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 202K-368KCUDA | Distributed Training | GPU Performance | GPU Performance Optimization | Language ModelsEntry-level Full TimeSan Jose, California, United States21h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-170KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States21h ago
-
Sr. Data Scientist USD 131K-198KMachine Learning | Python | R | SQL | Statistical modelingHybrid work schedule | Limited travelSenior-level Full TimeRaleigh, North Carolina, United States21h ago
-
Senior Data Scientist - Government & Public Services USD 131K-218KClass imbalance | Cloud Computing | Data Exploration | Data Preparation | Data leakageSenior-level Full TimeArlington/Rosslyn, Virginia, United States21h ago
-
Data Scientist, Product Analytics USD 178K-204KArtificial Intelligence | Data Mining | Experimentation | Forecasting | Key Performance IndicatorsMid-level Full TimeSunnyvale, CA | Menlo Park, CA … R22h ago
-
Staff AI Research Scientist, Applied AI, Google Cloud USD 207K-301KC++ | Data Mining | Deep learning | Generative AI | Information RetrievalSenior-level Full TimeSunnyvale, CA, USA22h ago
-
Research Scientist, Recommendation Systems, DeepMind USD 174K-253KDeep learning | Experimentation | JAX | Language Models | Language ProcessingMid-level Full TimeMountain View, CA, USA; New York, …22h ago
-
Research Data Scientist, Cybersecurity, Google Cloud USD 147K-211KAdversarial Machine Learning | Cybersecurity | Data Pipelines | Fraud Detection | Generative AIMid-level Full TimeSan Francisco, CA, USA; Reston, VA, …22h ago