ML Data QA Lead, MLO
Tasks
- Adjudicate ambiguous labeling cases
- Build QA analysis pipelines
- Build QA tooling review interfaces
- Conduct root cause analysis for data issues
- Define dataset quality standards
- Design quality checks during data collection
- Develop QA reporting dashboards
- Implement human rating and evaluation programs
- Lead data quality analysts
- Monitor ongoing data quality performance
- Report data quality findings to teams and partners
- Use large language models for quality checks
- Verify dataset completeness and accuracy
Perks/Benefits
- N/A
Skills/Tech-stack
Acceptance Rate | Annotation Guidelines | CSS | Confidence Analysis | Data Quality | Data labeling | Data pipeline | Error Magnitude | Gold Sets | HTML | Human evaluation | Inter Rater Agreement | JavaScript | Labeling Taxonomy | Language Models | Large Language Models | Machine Learning | Prompt engineering | Python | Rater Calibration | Sampling strategy | Statistical Analysis | Vision Language Models | Vision-language
Education
Regions
Countries
States
Cities
Related jobs
-
Novel AI Lead Methodologist USD 171K-247KAutomation | Data Analysis | Data Manipulation | Experiment design | Language ProcessingSenior-level Full TimeWashington D.C., DC, USA; Atlanta, GA, …4h ago
-
Lead Data Manager/SAS programmer (Job 1425) USD 130K-175K21 CFR | 21 CFR Part 11 | API | CDISC | CFR Part 11401k matching | Dental | Education assistance | Medical | PTOSenior-level Full TimeUnited States - Remote R19h ago
-
Marketing Strategy & Analytics Lead - Remote USD 160K-170KA/B | A/B Testing | Artificial Intelligence | Attribution Modeling | B testing401k matching | Dental insurance | FSA | HSA | Health insuranceSenior-level Full TimeParamus, NJ, United States R20h ago
-
Lead Engineer, Big Data USD 105K-170KArtificial Intelligence | Auditability | Automated testing | Azure Databricks | Business RulesSenior-level Full TimeUnited States23h ago
-
Clinical Development Lead, AI/LLM USD 153K-200KClinical Content | Clinical Content Development | Clinical Evaluation | Clinical Safety | Content developmentProtected clinical time | Reasonable adjustments for hiring processSenior-level Full TimeNew York R1d ago
-
Lead Data Scientist USD 160K-170KComputer Vision | Data Curation | Deep learning | Evaluation Frameworks | Generative AIAnnual performance bonus | Dental insurance | Health insurance | Paid time off | Retirement savings planSenior-level Full TimeUnited States Home Office, United States R1d ago
-
Lead Infrastructure Engineer - Public Cloud Storage USD 119K-196KAccess Management | Block Storage | Cloud Compliance | Cloud Governance | Cloud Networking401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …1d ago
-
Lead Data Scientist USD 146K-197KAlerting | Artificial Intelligence | Bias detection | CI/CD | Cloud Computing401k | Career development | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSSC - MD, United States1d ago
-
Lead AI Engineer - Agentic AI & Platform Development USD 129K-177K.NET | AI orchestration | APIs | AWS | Agent systemsSenior-level Full TimeWaterside Bldg, United States1d ago
-
Sr Manager, IT Data Engineering USD 146K-189K21 CFR | 21 CFR Part 11 | API Integration | AWS | AWS BedrockDental insurance | Discretionary annual bonus | Discretionary stock based long term incentives | Life insurance | Medical insuranceSenior-level Full TimeUS - NC - Raleigh, United …1d ago
-
Agile | Business Analysis | Collibra | Confluence | Control FrameworkDental insurance | Employee assistance program | Family care support | Health insurance | Long-term disabilitySenior-level Full TimeQuincy, Massachusetts, United States1d ago
-
Agile | BCBS 239 | Business Analysis | Collibra | ConfluenceEmployee assistance program | Employee networks | Flexible work/life support | Insurance benefits | Paid time offSenior-level Full TimeQuincy, Massachusetts, United States1d ago
-
Senior Manager, Data Analytics & Management USD 70K-92KAnalytics Strategy | Analytics Tool Implementation | Budget Planning | Business Intelligence | Data GovernanceHybrid work modelSenior-level Full TimeUSA - Horizon, United States R1d ago
-
Lead Data Governance Technical Analyst USD 148K-215KCloud Computing | Data Architecture | Data Compliance | Data Governance | Data ManagementFlexible spending accounts | Health insurance | Health savings accounts | Life and disability insurance | Paid time offSenior-level Full TimeUSA - Seattle, WA, United States1d ago
-
Agile | Business Analysis | Collibra | Confluence | Data ArchitectureDental insurance | Employee assistance program | Family care support | Health insurance | Long-term disability insuranceSenior-level Full TimeQuincy, Massachusetts, United States1d ago
-
Agile | Automated Data Quality Rules | Automated data quality | BCBS 239 | Business Analysis401k match | Dental insurance | Employee assistance program | Family care support | Health insuranceSenior-level Full TimeQuincy, Massachusetts, United States1d ago
-
Senior-level Full TimePlano, TX, United States1d ago
-
AWS | Agile | Artificial Intelligence | CSS | Database Management SystemSenior-level Full TimeMcLean, VA, United States1d ago
-
Senior / Principal Business Impact Lead – Manufacturing & Supply Chain (AI Solution Architect) - NYC USD 140K-175KAI | Analytics | Data collection | Data readiness | DeploymentContinuous learning | Freedom to experiment | Hybrid work | Open feedback culture | Team off-sitesMid-level Full TimeUS (New York)2d ago
-
AI Fine-tuning | Analytics | Artificial Intelligence | Data collection | Data readinessHybrid work in NYC office | Learning culture | Performance-based rewards | Team off-sitesMid-level Full TimeUS (New York)2d ago
-
Senior Analytics Manager, Incentive Compensation USD 84K-125KAnalytics | Audit Readiness | Compliance reporting | Data Governance | Data PipelinesHybrid working model | Team developmentSenior-level Full TimeUSA - Majestic, United States R2d ago
-
Biostatistician Lead USD 73K-120KBiomedical Data | Biomedical Data Analysis | Clinical Trial Design | Clinical trial | Cohort StudySenior-level Full TimeUniversity3d ago
-
Lead Software Engineer - Data Engineer and Applied AI USD 176K-195KAWS | Agile | Apache Spark | Application Resiliency | Automated testingBackup childcare | Financial coaching | Health care | Mental health support | Retirement savings planSenior-level Full TimeJersey City, NJ, United States3d ago
-
Technical Lead, Machine Learning USD 172K-220KBias Evaluation | DPO | Data Pipelines | Evaluation | GPU OptimizationSenior-level Full TimeUnited States R3d ago
-
Artificial Intelligence | Curriculum planning | Project-Based Learning | Public speaking | PythonSick timeEntry-level Full TimeSan Francisco, California, United States3d ago