Senior Manager, Machine Learning (Data Operations)
Tasks
- Collaborate with ML and product teams on labeling tasks
- Correct mislabeled data
- Define annotation guidelines and taxonomies
- Design labeling workflows
- Establish gold standard datasets
- Identify active learning opportunities
- Manage Label Studio projects and integrations
- Manage outsourced labeling vendors
- Measure IAA and cost per label
- Monitor inter annotator agreement
- Run audit sampling for labeled data
- Run calibration sessions with vendors
- Set labeling quality frameworks
- Set quality SLAs for vendors
- Track label accuracy metrics
Perks/Benefits
Skills/Tech-stack
Annotation Guidelines | Calibration | Data Operations | Data labeling | Document extraction | Entity recognition | Error Taxonomy | Gold Standard | Gold Standard Datasets | Intent detection | Inter-annotator agreement | Label Studio | Machine Learning | Named Entity Recognition | Python | SQL | Text Classification
Education
N/A
Related jobs
-
Observability Product Manager with AI | Dynatrace SaaS | Burlington, MA | Hybrid | Independent Visa Required USD 150K-180KAIOps | Anomaly Detection | Artificial Intelligence | Automation | CI/CDConfidentiality | Hybrid work schedule | Long-term projectMid-level Contract Full TimeBurlington, MA, United States13h ago
-
Senior Manager, Data Engineering USD 104K-123KAgile | Alerting | Azure DevOps | CI/CD | Cause analysisSenior-level Full TimeN/A, N/A, United States R14h ago
-
Data Scientist - Secret Clearance USD 119K-198KAnalytics | Application Programming | Application Programming Interfaces | Data Governance | Data PipelinesMentorship | Professional development | Travel 0 to 30 percentSenior-level Full TimeSan Diego, California, United States15h ago
-
Agent Orchestration | Artificial Intelligence | Bias Mitigation | Cross-Functional Collaboration | Cross-functionalMid-level Full TimeBellevue, WA18h ago
-
C# | C++ | Computer Vision | Data Compression | Data ProcessingSenior-level Full TimeMountain View, CA, USA18h ago
-
Program Manager II, AI/ML, Google Ads USD 132K-189KAdvertising Systems | Cross-Functional Collaboration | Cross-functional | Data integration | Functional collaborationMid-level Full TimeMountain View, CA, USA18h ago
-
Director, Data Quality & Adoption USD 106K-116KAcceptance Testing | Change Management | Coaching | Continuous Improvement | Customer SuccessComprehensive benefits package | Domestic travel | Paid time off | Virtual work environmentExecutive-level Full TimeRemote, VA, US R1d ago
-
Senior, Engineering Manager - Perception & Auto-Tagging USD 195K-234K2D Object Detection | 3D Object Detection | AWS | Auto-labeling | Cloud infrastructure401k employer match | Accidental death insurance | Dental insurance | Flexible schedule | Health insuranceSenior-level Full TimeAnn Arbor, MI, Remote - US R1d ago
-
Big Data | Customer Success | Data Architecture | Data Engineering | Data IntelligenceRemote work optionsSenior-level Full TimeIllinois; Massachusetts; New York; Washington, D.C. R1d ago
-
Manager, Enterprise Data Engineer USD 125K-225KAI Search | Azure AI | Azure AI Search | Azure Cognitive | Azure Cognitive Search100% telecommuting permitted | Domestic and international travel 25 percentMid-level Full TimeNew York, New York, United States …1d ago
-
Artificial Intelligence | Category analytics | Change Management | Data Accuracy | Data AnalysisSenior-level Full TimeUS - GA - Atlanta, United …1d ago
-
Associate Director, Market Access Deal Analytics USD 147K-221KData Analysis | Excel | Financial Modeling | Power BI | SQLMid-level Full TimeLocation: Boston, United States1d ago
-
Manager 2, AI Science USD 237K-321KAWS Redshift | AWS SageMaker | Adverse Action | Adverse Action Reason Codes | Bureau dataMid-level Full TimeCategory Data Location Mountain View, California …1d ago
-
Solutions Architect Manager USD 134K-190KAdobe Analytics | Algorithms | Analytics | Clickstream Data | Customer JourneySenior-level Full TimeSTORE SUPPORT CENTER, ATLANTA - 9090, …1d ago
-
Manager, Product Management - AI/ML USD 149K-205KAI Automation | Artificial Intelligence | Data Science | MLOps | Machine LearningMid-level Full TimeMcLean, VA, United States1d ago
-
Manager, Applied AI USD 134K-155KAI Agents | AI Governance | AI Services | Agent systems | Artificial Intelligence401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimeChicago - OSW, United States1d ago
-
Digital Analytics Manager Sr USD 113K-186KA/B | A/B Testing | Adobe Analytics | Adobe Experience | Adobe Experience PlatformMid-level Full TimeWork From Home United States, United … R1d ago
-
Digital Analytics Manager USD 89K-146KA/B | A/B Testing | Adobe Analytics | Adobe Launch | B testingMid-level Full TimeWork From Home United States, United … R1d ago
-
Product Adoption Manager, Strategy and Execution USD 180K-274KAnalytics | Automation | Business Operations | Data Analysis | Data VisualizationSenior-level Full TimeUnited States1d ago
-
Legal AI Program Manager USD 315K-385KArtificial Intelligence | Change Management | Enterprise Architecture | Enterprise Software | EvaluationMid-level Full TimeRemote, United States; UK - Remote R1d ago
-
Communications Insights & Analytics Mgr USD 95K-153KAnalytics | Artificial Intelligence | Automation | BigQuery | Business IntelligenceSenior-level Full TimeHouston, United States R1d ago
-
Lead Data Architect USD 130K-150KAgentic AI | Apache Spark | Artificial Intelligence | Cloud Data | Cloud Data PlatformsSenior-level Full TimeUnited States1d ago
-
Senior GTM Strategy & Analytics Manager USD 144K-178KBusiness planning | Dashboarding | Data Analysis | Data Preparation | KPI Management401k match | Catered meals | Cell phone stipend | Commuting Stipend | Dental insuranceSenior-level Full TimeBoston1d ago
-
Product Manager - Fraud AI/ML USD 123K-193KAdversarial Machine Learning | Artificial Intelligence | Continuous Learning | Data analytics | Experimentation DesignBackup childcare | Financial coaching | Health care coverage | Mental health support | Onsite health and wellness centersMid-level Full TimeNew York, NY, United States1d ago
-
Senior Manager, Pricing Strategy & Analytics USD 203K-251KBilling | Business Intelligence | CPQ | CRM | Cause analysisAdoption leave | Commuter benefits | Dental insurance | Disability insurance | Flexible spendingSenior-level Full TimeSan Mateo, CA, United States R1d ago