Applied Scientist, Artificial General Intelligence, AGI Data Services
Tasks
- Build LLM as a judge systems
- Build machine learning models for automated quality assessment
- Coach auditors on quality
- Communicate quality feedback to stakeholders
- Conduct meta audits
- Conduct root cause analysis
- Configure data collection workflows
- Create SOPs for auditing
- Create evaluation rubrics
- Define quality metrics
- Design auditing frameworks
- Design judge architectures
- Develop quality strategies
- Implement sampling methodologies
- Optimize data quality workflows
- Perform manual audits
- Research auditing methodologies
Perks/Benefits
- N/A
Skills/Tech-stack
Auditing | Automated Evaluation | C++ | Java | Language Models | Large Language Models | Learning models | Machine Learning | Machine Learning Models | Multimodal Systems | Python | Quality Assurance | Statistics
Education
Related jobs
-
Junior Data Scientist USD 87K-101KA/B | A/B Testing | B testing | Classification | Data Analysis401k employer match | Childcare reimbursement | Company events | Company-paid parking | Comprehensive health coverageEntry-level Full TimeSan Diego, CA, United States12h ago
-
Data Scientist, Underwriting USD 190K-300KA/B | A/B Testing | B testing | Causal Inference | Data Analysis401k | Commuter benefits | Employee assistance program | Free Lunches | Medical, dental, and vision insuranceMid-level Full TimeSan Francisco, CA14h ago
-
Senior Data Scientist - Alt Defense USD 263K-322KApache Airflow | Apache Hive | Apache Spark | Causal Inference | Deep learningEquity compensation | Health benefitsSenior-level Full TimeSan Mateo, CA, United States15h ago
-
Senior Data Scientist USD 200K-240KAWS | Heuristics | Machine Learning | Optimization | Pandas401k match | Flexible PTO | Flexible spending accounts | Medical, dental, vision plans | Teladoc HealthSenior-level Full TimeNew York City, New York15h ago
-
Senior Staff Marketing Data Scientist, AI Enablement USD 185K-212KAgent Based Workflows | Agent-based | Automation | Causal Inference | ComplianceSenior-level Full TimeUnited States17h ago
-
Senior Computational Biologist – Target ID USD 151K-230KAgentic Workflows | Causal Inference | Cloud Computing | Data integration | EHRBonus | Comprehensive benefits package | Equity compensationSenior-level Full TimeNew York, New York; Salt Lake …18h ago
-
Senior Staff Engineer - Data Scientist USD 150K-190KAmazon Web Services | Anomaly Detection | Apache Airflow | Apache Kafka | Apache SparkContract-to-hire | Remote work | Travel opportunitiesSenior-level Full TimeRemote, REMOTE, United States R18h ago
-
Data Scientist (Hybrid) USD 73K-138KClustering | Data Engineering | Data Visualization | Hypothesis Testing | Machine Learning401k | Dental insurance | Medical insurance | Paid time off | Short Term Incentive ProgramEntry-level Full TimeNorth Chicago, IL, United States20h ago
-
Consumer Product Data Scientist USD 114K-221KBig Data | Customer Retention | Customer churn | Dashboards | Data AnalysisSenior-level Full TimeWashington, DC21h ago
-
Senior Data Scientist USD 156K-224KApache Spark | Backtesting | Bayesian Methods | BigQuery | Data ProcessingSenior-level Full TimeUS-CA-Menlo Park22h ago
-
Data Scientist - TikTok Integrity and Safety (San Jose) USD 150K-240KA/B | A/B Testing | Anomaly Detection | B testing | Causal InferenceMid-level Full TimeSan Jose, California, United States23h ago
-
AI Research Scientist, Audio-Visual Understanding, FAIR USD 147K-208KAudio Visual | Audio-Visual Learning | Computer Vision | Data Analysis | Deep learningMid-level Full TimeMenlo Park, CA | New York, …1d ago
-
Research Scientist USD 150K-251KAgent Orchestration | Automatic Speech Recognition | Conversational AI | Language Models | Language ProcessingMid-level Full TimeMenlo Park, CA1d ago
-
AI Research Scientist, Robotics USD 300K-400KComputer Vision | Deep learning | Human robot | Human-Robot Interaction | Imitation LearningExecutive-level Full TimeRedmond, WA | Burlingame, CA1d ago
-
AI Research Scientist, MRS AI (PhD) USD 117K-173KData Analysis | Deep learning | Dimensional data | Experiment design | High Dimensional DataEntry-level Full TimeMenlo Park, CA1d ago
-
Machine Learning Hardware Research Scientist USD 111K-145KASIC design | Architecture Search | C# | C++ | CPUEntry-level Full TimeSunnyvale, CA1d ago
-
AI Research Scientist, Media Data Research - MSL FAIR USD 147K-208KComputer Vision | Data Curation | Data Generation | Data Scaling Laws | Data scalingEntry-level Full TimeMenlo Park, CA1d ago
-
Computer Science Research - US - IC5 USD 166K-244KData Pipelines | Deep learning | Entity recognition | Generative Models | Image-to-videoKnowledge sharing | Mentoring | Open source contributionsMid-level Full TimeBellevue, WA | Menlo Park, CA1d ago
-
DPO | Data Generation | Data alignment | Deep learning | Human FeedbackSenior-level Full TimeMenlo Park, CA1d ago
-
Data Scientist, Product, Google Voice USD 192K-278KData Analysis | Data Visualization | ETL | Machine Learning | PythonSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA1d ago
-
Search Ads Data Scientist, Product, Gmail Ads USD 138K-198KCausal Inference | Data Analysis | Experiment design | Metrics | PythonMid-level Full TimeMountain View, CA, USA1d ago
-
Junior Data Scientist USD 55K-58KBusiness Intelligence | Data cleaning | Data integration | Geospatial analysis | Machine LearningEntry-level Full TimeNew York City, NY, United States1d ago
-
Senior Data Scientist - AI/ML Engineer USD 185K-250KAPI Development | AWS | Adapter Training | Agentic AI | Cloud NativeAccess to AI resources | Conference Presenting | Conference attendance | Learning budget | Team offsiteSenior-level Full TimeSunnyvale Office1d ago
-
Computer Vision Scientist (multiple levels/openings) USD 165K-219KC++ | Computer Vision | Deep learning | Machine Learning | Neural Networks401k matching | Commuter benefits | Employee referral program | Flexible spending accounts | Life insuranceSenior-level Full TimeSanta Clara, CA1d ago
-
Principal AI Scientist USD 130K-170KAI Governance | AI alignment | Agentic Systems | Benchmarking | Bias Mitigation401k match | Birthday day off | Company holidays | Flexible work arrangements | Paid parental leaveSenior-level Full TimeLos Angeles, CA, United States1d ago