Director, AI Experimentation & Measurement
USA - NY - Headquarters, United States
USD 162K-271K Executive-level Full Time
Tasks
- Assess data leakage and audience matching
- Conduct power analysis
- Define success criteria for AI experiments
- Design controlled experiments
- Draft pre registered success criteria and KPIs
- Ensure measurement integrity and bias controls
- Escalate when results are not gradeable
- Establish evidence governance and readout cadence
- Evaluate control arms and confounders
- Maintain measurement playbook
- Produce evidence read memos for leaders
- Recommend continue adjust stop actions
- Run backtesting when appropriate
- Synthesize portfolio evidence narrative
Perks/Benefits
- 401k matching
- Caregiver leave
- Health insurance
- Hybrid work
- Paid time off
- Parental leave
- Relocation assistance
Skills/Tech-stack
Artificial Intelligence | Audit trails | Auditability | Bias Mitigation | Causal Inference | Data Quality | Data leakage | Data leakage detection | Experiment design | Experimental Methods | Experimental analysis | KPI Management | Leakage detection | Machine Learning | Matched Controls | Power analysis | Pre Registration | Quasi Experimental | Quasi Experimental Analysis | Quasi-experimental methods | Responsible AI | Statistical Analysis
Education
Regions
Countries
States
Cities
Related jobs
-
Director, Foundation Model Data Recipes USD 349K-431KBayesian Inference | Data Clustering | Data Filtering | Data Mining | Data PreprocessingBonus | Equity incentive plan | Health insuranceExecutive-level Full TimeMountain View, CA. USA; San Francisco, …9h ago
-
Director, Analytics & AI Solutions USD 160K-205KAdvanced Analytics | Analytics Strategy | Artificial Intelligence | BI platforms | Data Ecosystem401k | Dental insurance | Discounts | Health insurance | Hybrid scheduleExecutive-level Full TimeUniversal City, CA, United States R15h ago
-
Director, Machine Learning - Search & Recommendation USD 211K-340KAPI Design | Data Integrity | Data Pipelines | Distributed Systems | Experimentation401k matching | Comprehensive medical coverage | Employee stock purchase plan | Paid parental leave | Unlimited PTOExecutive-level Full TimeAustin, Texas, United States; Chicago; Palo …16h ago
-
Director, AI Commerce Analytics (USA Based Remote) USD 110K-180KAI Tooling | AI Tooling Governance | Agent systems | Artificial Intelligence | CRMEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offExecutive-level Full TimeConnecticut, CT, United States R20h ago
-
Director of Digital Analytics USD 164K-314KAdobe Analytics | Adobe Target | Agile | Analytics Delivery | Artificial Intelligence401k | Adoption Assistance | Career planning | Continuing education | Dental insuranceExecutive-level Full TimeSan Antonio Home Office I, United …1d ago
-
Director, Product & Data Governance USD 136K-252KAPI Standards | API Versioning | Artificial Intelligence | Automation | Backward CompatibilityExecutive-level Full TimeAlpharetta, GA (Alderman), United States1d ago
-
Director of Digital Analytics USD 164K-314KAdobe Analytics | Adobe Target | Agile methodology | Analytics Delivery | Analytics Experimentation401k | Adoption Assistance | Career path planning | Comprehensive medical/dental/vision plans | Continuing educationExecutive-level Full TimeSan Antonio, Texas, UNITED STATES; Charlotte, …1d ago
-
Applied AI Director (Primarily Office) USD 172K-294KAI Governance | Advanced Analytics | Agentic Workflows | Artificial Intelligence | Data Governance401k contribution | Medical/Dental/Vision insurance | Paid Holidays | Paid time off | Pension planExecutive-level Full TimeAF-WI Madison Natl HQ, United States1d ago
-
Artificial Intelligence & Machine Learning Engineer USD 77K-176KArtificial Intelligence | Deep learning | Docker | Kubernetes | Language ProcessingDependent care | Paid leave | Paid time off | Professional development | Tuition assistanceMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …1d ago
-
Artificial Intelligence Engineer USD 77K-176KAI Search | API Design | Azure AI | Azure AI Search | Data CurationDependent care | Paid leave | Professional development | Retirement benefits | Tuition assistanceEntry-level Full TimeUSA, GA, Atlanta (575 Morosgo Drive …1d ago
-
Data Science Director (IC) USD 233K-276KAgent Orchestration | Artificial Intelligence | Bias Mitigation | Causal Inference | Data Product ManagementExecutive-level Full TimeSunnyvale, CA | Bellevue, WA | …2d ago
-
Global Private Bank and Wealth Management Credit Risk Measurement and Analytics-Managing Director USD 260K-285KAlternative Investments | Capital Markets | Credit Risk | Data Analysis | DerivativesBackup childcare | Comprehensive health care | Financial coaching | Mental health support | On-site health and wellness centersExecutive-level Full TimeNew York, NY, United States3d ago
-
Director of Predictive Analytics - Insurance USD 155K-220KAWS | Amazon SageMaker | Azure | Cloud platform | GIS401k | Dental insurance | Medical insurance | Mentorship | Onsite workExecutive-level Full TimeMelbourne, FL3d ago
-
Director, AI Commerce Analytics (USA Based Rempte) USD 110K-180KAI Governance | AI architecture | Agent systems | Agentic commerce | Architecture governanceComprehensive health insurance | Education support | Employee Assistance Program (EAP) | Flexible working environment | Industry-leading parental leaveExecutive-level Full TimeConnecticut, CT, United States R3d ago
-
APIs | Artificial Intelligence | Business Intelligence | Data Governance | Data PipelinesMid-level Full TimeNotre Dame, IN, United States3d ago
-
Associate Director, Data Strategy & Analytics USD 103K-120KAttribution Modeling | BigQuery | Cohort Analysis | DBT | Data Modeling401k match | Dental insurance | Flexible parental leave | Health insurance | Hybrid work optionsMid-level Full TimeNew York R3d ago
-
Senior Director, AI Engineering Transformation USD 225K-250KAWS | Artificial Intelligence | CAD | Change Management | DFM401k matching | Accidental death and dismemberment insurance | Company holidays | Dental insurance | Employee stock purchase programSenior-level Full TimeNeedham, MA, United States3d ago
-
Vice President, AI / Machine Learning Software Engineer USD 120K-190KCI/CD | Cloud Native | Cloud Native Architecture | Data Pipelines | Distributed tracingFlexible resources and tools | Health and wellbeing programs | Paid leave | Paid volunteer timeExecutive-level Full TimeJersey City, NJ, United States3d ago
-
Director - Resource Forecasting & Analytics USD 172K-258KAnalytics | Artificial Intelligence | Data Governance | Data Quality | Data ScienceHealth insurance | Hybrid work schedule | Paid time off | Retirement contributionsExecutive-level Full TimeBillerica, Massachusetts, US, 018214d ago
-
AI Software Engineer USD 86K-198KAWS | Agentic AI | Air-gapped | Angular | Artificial IntelligenceDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, VA, Arlington (1500 Crystal Dr), …4d ago
-
Director, AI Experimentation & Measurement USD 162K-271KArtificial Intelligence | Auditability | Causal Inference | Experiment design | Experimental Methods401k with employer matching | Dental insurance | Health insurance | Hybrid work | Paid caregiver and parental leaveExecutive-level Full TimeUSA - NY - Headquarters, United …4d ago
-
Analytical Chemistry | Analytical Methods | Biochemistry | Biotechnology | ChemistryFlexible working options | Global recognition programs | Hybrid work options | Insurance plans | Paid parental leaveMid-level Full TimeDurham, United States4d ago
-
Senior Director, Advanced Pharmacometrics, Quantitative Pharmacology and Pharmacometrics – Immuno-Oncology (Hybrid or Remote) USD 210K-331KArtificial Intelligence | Bayesian Hierarchical Models | Bayesian Inference | Clinical Trial Simulation | Clinical trialSenior-level Full TimeUSA - New Jersey - Rahway, … R4d ago
-
Associate Director, Commercial Data Science USD 194K-263KAWS | Amazon Web Services | Artificial Intelligence | Causal Inference | Cloud ComputingCareer development | Work-life balanceMid-level Full TimeUS - California - Thousand Oaks, …4d ago
-
Director, Advanced Robotics Systems USD 184K-267KAI machine learning | AI/ML | Actuation | Advanced controls | Agile401k | Dental insurance | Health insurance | Holidays | Paid time offExecutive-level Full TimeUS, MA, Wilmington, United States4d ago