Research Scientist Manager, MetaAI Assistant Measurement
Tasks
- Communicate and collaborate with stakeholders
- Define and execute scientific roadmap for measurement
- Lead development of evaluation metrics and benchmarks
- Mentor and grow research team
- Partner with research, engineering, and product teams
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | AI interaction | B testing | Behavior Modeling | Benchmark building | Content evaluation | Cross-Functional Collaboration | Cross-functional | Data Analysis | Data Synthesis | Dataset creation | Engineering Development | Evaluation metrics | Experiment platform design | Functional collaboration | Generative AI | Human-AI Interaction | Language Model | Large Language Model | NLP | Offline measurement | Online and offline measurement | Ontology Building | Platform Design | Research and Engineering | Research and engineering development | Safety and alignment | Team leadership | Technical Communication | Transformer | User Behavior | User behavior modeling
Education
Regions
Countries
States
Cities
Related jobs
-
Cloud Computing | Co-marketing | Content Creation | Data analytics | Demand GenerationSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA3h ago
-
Manager, IT AI Engineering - Agent Engineering USD 96K-131KA/B | A/B Testing | API Design | Access Control | Agent architecture401k program | Car discounts | Cruise discounts | Employee assistance program | Flexible spending accountsMid-level Full TimeFort Worth, TX, US6h ago
-
AWS CloudFormation | Amazon Web Services | Anomaly Detection | Attribution Modeling | Budget Quota ManagementSenior-level Full TimeMountain View, California14h ago
-
Digital Marketing & Analytics Manager USD 80K-102KA/B | A/B Testing | Audience Segmentation | B testing | Content OptimizationMid-level Full TimeGrafton, Wisconsin, United States18h ago
-
Manager, Digital Analytics - Amazon USD 120K-150KAmazon Vendor Central | CPG analytics | Competitive Analysis | Data Analysis | Driver-based analysis401k match | Equity | Flexible time off | Free products | Happy hoursMid-level Full TimeNew York, NY19h ago
-
Manager, Digital Analytics - Amazon USD 120K-150KAmazon Vendor Central | Business planning | CPG analytics | Competitive Analysis | Data Analysis401k match | Equity | Flexible time off | Flexible work schedule | Free productsMid-level Full TimeNew York, NY19h ago
-
Data Science Program Lead I USD 121K-230KClinical Practice | Clinical Research | Clinical trial | Clinical trial management | Data Analysis401k | Dental insurance | Long-term incentive program | Medical insurance | Paid time offSenior-level Full TimeIrvine, CA, United States19h ago
-
Project Manager / Data Analyst USD 90K-140KDashboarding | Data Analysis | KPI Tracking | Power BI | ServiceNow401k retirement plan with company matching | Commuter Transit Benefits | Dental insurance | FSA | Health insuranceMid-level Full TimeHouston, TX, United States19h ago
-
AI Lead Technical Program Manager USD 176K-245KAgile | Artificial Intelligence | Budget Management | Data Analysis | Project PlanningSenior-level Full TimeColumbus, OH, United States20h ago
-
Architecture Review | Cloud Data | Cloud Data Architecture | Consumption-based models | Customer Architecture ReviewSenior-level Full TimeUS-NY-New York21h ago
-
Senior Manager, Business Development (Embedded Finance) USD 226K-255KB2B Sales | Business Development | Business case | Business case development | Case DevelopmentRemote work up to 4 weeks per yearSenior-level Full TimeNew York, New York, United States R22h ago
-
Senior Manager, Business Development (Embedded Finance) USD 226K-255KB2B Sales | Business case | Business case development | Case Development | Channel salesRemote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, California, United States R22h ago
-
Manager, AI Deployment Engineering - Codex USD 251K-335KCloud Computing | Development Lifecycle | Generative AI | JavaScript | PythonHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco22h ago
-
Senior Manager, Analytics and Insight (Hybrid) USD 169K-186KA/B | A/B Testing | Attribution Modeling | B testing | DBT401k match | Dental insurance | HSA contribution | Health insurance | Paid parental leaveSenior-level Full TimeNew York, NY R1d ago
-
Operations Senior Manager - Global Fulfillment USD 149K-181KChain management | Change Management | Data Analysis | Fulfillment operations | Key Performance IndicatorsDental insurance | Health insurance | Mental health support | Paid time off | Parental planningSenior-level Full TimeUSA - Remote R1d ago
-
Product Manager, GenAI Safety - Trust and Safety USD 147K-205KCross-Functional Collaboration | Cross-functional | Data Analysis | Functional collaboration | Online safetyMid-level Full TimeSan Jose, California, United States1d ago
-
Operations Program Manager- Robotics USD 134K-196KAI Workflow Optimization | AI tools | AI workflow | Budget Forecasting | BudgetingMid-level Full TimeRedmond, WA1d ago
-
AI Manager of Growth and Acquisition USD 116K-145KAd Targeting | Artificial Intelligence | Audience Segmentation | Email Marketing | Experimentation401k retirement plan | Dental coverage | Equity compensation | Healthcare coverage | PTOMid-level Full TimeSan Francisco, Raleigh, Miami, Toronto, Montreal1d ago
-
Manager II, Machine Learning Engineering USD 189K-389KA/B | A/B Testing | B testing | Conditional Two-Tower | Cost OptimizationMid-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Marketing Insights and Analytics Manager (Cambridge, MA) USD 140K-223KData Analysis | Data Visualization | Excel | Loss analysis | Performance reporting401k match | Commuting support | Education reimbursement | HSA contribution | PTOSenior-level Full TimeCambridge - B3 Crossing, United States1d ago
-
CD&A - Commercial Analytics Manager, Patient & Access USD 124K-168KData Analysis | Data Quality | Data Visualization | Data integration | Power BIAward-winning time-off plans | Career development | Dental insurance | Discretionary annual bonus | Flexible spending accountsMid-level Full TimeDeerfield (Horizon), United States1d ago
-
Senior Manager, Global Marketing & C&CL Consumption & Purchase Advanced Analytics Intelligence Services USD 130K-147KAzure ML | Data Analysis | Data Science | Generative AI | Machine LearningGlobal exposure | High leadership visibility | Hybrid workSenior-level Full TimeUS - GA - Atlanta, United …1d ago
-
A/B | A/B Testing | B testing | Data Governance | Data LineageMedical Dental Vision Life Insurance Disability Coverage Retirement Plan 401k Match Wellness Program Educational Assistance Paid Time OffSenior-level Full TimeOne PNC Plaza (PA370), United States1d ago
-
Customer Integration Manager - Robotics USD 105K-105KAutomation | Continuous Improvement | Customer Success | Data Analysis | Industrial Automation401k | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeEden Prairie, MN, US, 554421d ago
-
Manager AI Excellence USD 94K-135KAI Governance | Agile | Analytics | Artificial Intelligence | Automation401k savings plan | Community service hours | Disability insurance | Flexible work schedule | Health Emergency LeaveMid-level Full TimeFrederick, MD, US, 217031d ago