Senior Analyst Conversational AI Analytics
Tasks
- Analyze A B tests on conversational flows
- Analyze conversation transcripts and session data
- Apply NLP evaluation methods
- Build and maintain dashboards
- Conduct mixed methods UX research
- Coordinate with AI and engineering teams
- Define conversational AI KPIs
- Ensure logging and event tracking for analytics
- Establish baseline performance benchmarks
- Flag regression and drift
- Identify friction points and misunderstood intents
- Map conversation flows to user journeys
- Monitor model and flow performance
- Own conversational AI measurement framework
- Partner with applied AI team on evaluation
- Present insights to senior stakeholders
- Run conversation audits
- Support qualitative usability testing
- Translate interaction data into recommendations
Perks/Benefits
Skills/Tech-stack
A/B | A/B Testing | B testing | Conversation transcripts | Conversational AI | Dashboards | Dialogue Management | Entity recognition | Fallback Handling | Intent Recognition | Journey Mapping | LLM Evaluation | Language Processing | Looker | Mixed methods | Mixed methods research | NLP evaluation | Natural Language | Natural Language Processing | Power BI | Prompt evaluation | Python | Qualitative coding | Quantitative Analysis | R | Retrieval-Augmented Generation | SQL | Sentiment Analysis | Tableau | UX research | Usability Testing | User Journey | User Journey Mapping
Education
N/A
Related jobs
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R23h ago
-
Data Analyst USD 90K-115KA/B | A/B Testing | B testing | Data Modeling | Excel401k matching | Dental insurance | Disability insurance | Employee assistance program | Health insuranceEntry-level Full TimeRemote Location, United States R23h ago
-
Data Integrity | Data Visualization | Excel | Machine Learning | Power BIHealth insurance | Paid time off | Retirement planMid-level Full TimeUnited States - Massachusetts - Westborough, … R23h ago
-
Automation | Data Analysis | Data Visualization | Power BI | Process ImprovementBelonging culture | Hybrid work environmentSenior-level Full TimeBuffalo, NY, United States R23h ago
-
Data Governance Analyst USD 93K-120KApex | Approval Processes | Assignment Rules | Change Management | DashboardsEmployee resource groups | Flexible work environment | Remote Work Hybrid ScheduleMid-level Full TimeLa Jolla, CALIFORNIA, United States R1d ago
-
Data Analyst USD 65K-65KAzure | DAX | Data Governance | Data Modeling | Data WarehousingDisability insurance | Employee assistance programs | Flexible spending account | High-yield HSA | Legal plansEntry-level Full TimeAustin, TX, United States R1d ago
-
Data Analyst USD 65K-65KAzure | DAX | Data Governance | Data Modeling | Data QualityDental insurance | Employee assistance program | Flexible spending account | Health insurance | High-yield HSAEntry-level Full TimeDallas, TX, United States R1d ago
-
Data Analyst USD 65K-65KAzure | DAX | Data Governance | Data Modeling | Data QualityComprehensive health insurance | Dental insurance | Employee assistance program | Flexible schedule | Paid family leaveEntry-level Full TimeHouston, TX, United States R1d ago
-
Data Analyst USD 65K-65KAzure Data | Azure Data Factory | DAX | Data Factory | Data GovernanceComprehensive medical, dental and vision plans | Disability insurance | Employee assistance program | Flexible paid time off | High yield HSA or flexible spending accountEntry-level Full TimeSan Antonio, TX, United States R1d ago
-
Biostatistics | Data Governance | Data Integrity | Data Visualization | Power BIAdoption financial assistance | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeMassachusetts R1d ago
-
Biostatistics | Data Analysis | Data Governance | Data Visualization | Healthcare AnalyticsAdoption financial assistance | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeIdaho R1d ago
-
Biostatistics | Compliance | Data Governance | Data Integrity | Data VisualizationAdoption financial assistance | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeMinnesota R1d ago
-
Biostatistics | Data Governance | Data Integrity | Data Visualization | Power BIAdoption financial assistance | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeColumbia R1d ago
-
Biostatistics | Data Analysis | Data Visualization | Large Datasets | Power BIAdoption financial assistance | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeIllinois R1d ago
-
Biostatistics | Data Visualization | Power BI | Python | RAdoption financial assistance | Dental insurance | Employer retirement contribution | Medical insurance | Paid parental leaveSenior-level Full TimeFlorida R1d ago
-
Biostatistics | Data Governance | Data Visualization | Power BI | PythonAdoption financial assistance | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeColorado R1d ago
-
Biostatistics | Data Analysis | Data Governance | Data Visualization | Large DatasetsAdoption financial assistance | Medical, dental, and vision insurance | Paid parental leave | Paid time off | Retirement savings planSenior-level Full TimeConnecticut R1d ago
-
Biostatistics | Data Governance | Data Visualization | Large Datasets | Power BIAdoption financial assistance | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeCalifornia R1d ago
-
Biostatistics | Data Governance | Data Visualization | Power BI | PythonAdoption financial assistance | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeArizona R1d ago
-
Quality Assurance Analyst / ETL Tester USD 80K-104KAgile | Azure DevOps | CI/CD | Data Warehouse | ETLRemote workMid-level Contract Full TimeSpringfield, IL - Remote R1d ago
-
Global Marketing Web Analytics & Testing Analyst USD 80K-110KA/B | A/B Testing | B testing | Google Analytics | Google BigQuery401k match | Hybrid work from home eligibility | Paid Holidays | Paid caregiver leave | Paid medical dental and vision premiumsMid-level Full TimeTampa, FL, United States R1d ago
-
Senior Product Data Analyst USD 182K-194KA/B | A/B Testing | Amazon Redshift | B testing | Business Intelligence401k match | Company-subsidized life insurance | Equity option plan | Flexible work arrangement | Health, dental & vision plansSenior-level Full TimeNew York, NY R1d ago
-
Sr. Data Scientist, Payments USD 152K-205KApache Superset | Business Intelligence | Dashboarding | Data Visualization | PythonSenior-level Full TimeU.S. - California, United States R1d ago
-
Hybrid Remote Data Analyst in Southington, CT USD 60K-70KDashboard Development | Data Analysis | Data Troubleshooting | Data Visualization | Microsoft ExcelHybrid remote workMid-level Full TimeSouthington, CT, USA R1d ago