Applied Scientist, Artificial General Intelligence, AGI Data Services
Tasks
- Build LLM as a judge systems
- Build machine learning models for automated quality assessment
- Coach auditors to improve quality
- Collaborate with engineers and domain experts
- Conduct meta audits
- Conduct root cause analysis on data quality issues
- Create SOPs for auditing
- Create evaluation rubrics
- Define quality metrics
- Design auditing frameworks
- Design judge architectures
- Develop quality strategies
- Implement sampling methodologies
- Optimize data quality processes
- Perform manual audits
- Research auditing methodologies
- Set up data collection workflow configurations
Perks/Benefits
- N/A
Skills/Tech-stack
Auditing | C++ | Cause analysis | Data Quality | Evaluation | Evaluation rubrics | Java | Language Models | Large Language Models | Machine Learning | Multimodal Systems | Python | Quality Assurance | Root Cause Analysis | Root cause | Sampling | Statistics
Education
Regions
Countries
States
Cities
Related jobs
-
Computer Scientist II USD 120K-130KAgile | Angular | Azure DevOps | CI/CD | Configuration Management401k match | Dental insurance | Disability insurance | FSA | Health savings accountMid-level Full TimeLas Vegas, NV, United States2h ago
-
Senior-level Full TimeWINCHESTER, VA, United States3h ago
-
Mid-level Full TimeWINCHESTER, VA, United States3h ago
-
Software Engineer Sr. Staff USD 138K-307KAI machine learning | Agile | Algorithm Design | Autoconf | BashClearance based role | On-site workSenior-level Full TimeAlexandria, VA5h ago
-
AI guardrails | API Integration | AutoGPT | Azure AI | Content FilteringHybrid work scheduleMid-level ContractAustin, United States6h ago
-
C# | C++ | CFE | CFS | CI friendly test harness9/80 schedule | Career growth | Onsite cafeteriaMid-level Full TimeUnited States-Texas-Houston-20331-ESCG6h ago
-
C# | C++ | CFE | CFS | CI/CD9/80 work schedule | Career growth | Onsite cafeteriaMid-level Full TimeUnited States-Texas-Houston-20331-ESCG6h ago
-
ADPCM | App Design | Audio DSP | Audio streaming | CFE9/80 work schedule | Career growth | Onsite cafeteriaSenior-level Full TimeUnited States-Texas-Houston-20331-ESCG6h ago
-
Associate Data Scientist USD 92K-159KAlteryx | Business Intelligence | Data Visualization | ETL | Machine LearningMid-level Full TimeUnited States-Ohio-Cleveland7h ago
-
Data Scientist USD 84K-114KExcel | Machine Learning | Optimization | PowerPoint | Predictive ModelingEntry-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Research Scientist in Large Language Model (LLM) - Seed - Graduates - 2027 Start (PhD) USD 244K-450KData Construction | Instruction Tuning | Language Models | Large Language Models | Model OptimizationEntry-level Full TimeSan Jose, California, United States7h ago
-
Research Scientist in Large Language Model (LLM) - Seed - Graduates - 2027 Start (BS/MS) USD 212K-387KCode generation | Data Construction | Instruction Tuning | Language Models | Large Language ModelsEntry-level Full TimeSan Jose, California, United States7h ago
-
Student Researcher (LLM - Seed) - 2027 Start (PhD) USD 200K-300KAlgorithm Design | Language Models | Language Processing | Large Language Models | Machine LearningMid-level Full TimeSan Jose, California, United States7h ago
-
Student Researcher (LLM - Seed) - 2027 Start (BS/MS) USD 187K-300KAlgorithms | Deep learning | Language Models | Language Processing | Large Language ModelsMid-level Full TimeSan Jose, California, United States7h ago
-
Intern Data Engineer USD 44K-62KAzure | Azure DevOps | Databricks | PySpark | PythonProfessional development | Training sessionsEntry-level Full Time InternshipUnited States7h ago
-
Machine Learning Engineer, Ads Targeting USD 137K-237KA/B | A/B Testing | Ad Targeting | B testing | Data PipelinesMid-level Full TimeSan Jose, California, United States7h ago
-
Tech Lead Machine Learning Ops Engineer, Global SRE USD 187K-359KCost Optimization | GPU Computing | Learning operations | Machine Learning | Machine Learning OperationsSenior-level Full TimeSan Jose, California, United States7h ago
-
Machine Learning Engineer, Commerce Ads Ranking USD 145K-250KAuto Crossing | Cold Start | Cold Start Modeling | Delayed Feedback Modeling | Distributed TrainingMid-level Full TimeSan Jose, California, United States7h ago
-
Conversational AI | Generative AI | Image Generation | Language Models | Language ProcessingSenior-level Full TimeSan Jose, California, United States7h ago
-
Machine Learning Engineer Graduate (Global E-commerce Recommendation/Search) - 2026 Start (BS/MS) USD 115K-177KData Modeling | Data Processing | Information Retrieval | Language Processing | Large Scale DataEntry-level Full TimeSeattle, Washington, United States7h ago
-
Machine Learning Engineer Graduate (Global E-commerce Recommendation/Search) - 2026 Start (PhD) USD 118K-187KComputer Vision | Data Analysis | Deep learning | Information Retrieval | Language ProcessingEntry-level Full TimeSeattle, Washington, United States7h ago
-
Machine Learning Engineer - Search Ads USD 145K-250KActive Learning | Ad optimization | CTR Prediction | CVR Prediction | Data AnalysisEntry-level Full TimeSan Jose, California, United States7h ago
-
TikTok Shop - Data Scientist - User Product USD 167K-312KA/B | A/B Testing | B testing | Dashboarding | Data analyticsEntry-level Full TimeSeattle, Washington, United States7h ago
-
A/B | A/B Testing | B testing | Click Through Rate | Conversion RateSenior-level Full TimeSan Jose, California, United States7h ago
-
Machine Learning Engineer Graduate (Global E-commerce Recommendation/Search) - 2026 Start (BS/MS) USD 115K-177KContent Safety | Data Analysis | Graph Algorithms | Language Processing | Large-scaleEntry-level Full TimeSan Jose, California, United States7h ago