Senior Manager – GenAI Performance & Analytics
Tasks
- Analyze conversational AI performance
- Build dashboards and reporting frameworks
- Define and track AI metrics
- Design evaluation frameworks for LLM responses
- Establish best practices for AI analytics
- Evaluate model upgrades and prompt changes
- Identify automation opportunities from analytics
- Lead and mentor analytics team
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | AI Evaluation | B testing | Data Analysis | Language Models | Large Language Models | Machine Learning | Python | SQL | Tableau
Education
Roles
AI | AI Performance Analyst | Analyst | Manager | Performance Analyst
Related jobs
-
Business Analyst - Group Data Governance and Control INR 1317K-2500KBenfords Law | Data Modeling | Data Visualization | Data analytics | Microsoft ExcelMid-level Full TimeAhmedabad, Gujarat, India17h ago
-
Manager, Field Analytics INR 1500K-2800KBI Dashboards | DBT | Data Architecture | Data Documentation | Data GovernanceHybrid workMid-level Full TimeBengaluru, India20h ago
-
TechOps - DE - Automation - AI - Manager INR 1500K-2000KAWS | Asyncio | Authentication | Azure | CI/CDCoaching and Mentorship | Continuous learning | Inclusive cultureMid-level Full TimeBengaluru, KA, IN, 56001620h ago
-
AI Cloud Solution Engineer_Director_Software Engineering INR 1500K-6000KAI Foundry | AWS Bedrock | Amazon SageMaker | Azure AI | Azure AI FoundryExecutive-level Full TimeRMZ Ecoworld Business Park, India20h ago
-
AI Automation Forward Deployment Engineer INR 2857K-4590KAI orchestration | Agentic AI | BigQuery | Cause analysis | Data ModelingDonation match | Flexible location | Flexible schedule | Health coverage | Paid vacationSenior-level Full TimeBangalore, India1d ago
-
Associate - Clubcard Optimization INR 1500K-2000KAlteryx | Hive | Python | SQL | TableauFinancial coaching | Health insurance | Hybrid work model | Mental health support | Paid leaveMid-level Full TimeBengaluru, Karnataka, India, India R1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Agent Framework | Agile | Amazon Web Services | Azure Data | Azure Data FactoryBig 4 consulting experienceSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Data Analysis | Microsoft Excel | Power BI | SQL | TableauCollaboration with senior stakeholders | Project ownership | Work from OfficeMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeGurugram, Haryana, India1d ago
-
Manager - Research & Analytics, Delhi INR 1400K-1800KData Analysis | Excel | Impact evaluation | Interview design | Monitoring and EvaluationMid-level Full TimeDelhi, India, India1d ago
-
Platform Manager- Technical Infrastructure, Delhi/Remote INR 1500K-2400KAI coding | AI coding tools | Automation | Coding Tools | Data PipelinesRemote workMid-level Full TimeDelhi, India, India R1d ago
-
Data Analyst, Delhi/Remote INR 2000K-2400KData Pipelines | Data Quality | Data Visualization | Data cleaning | GitHubRemote work option | Rolling application reviewSenior-level Full TimeDelhi, India, India R1d ago
-
Data Analytics Solutions Specialist INR 1500K-1500KBusiness Intelligence | Dashboard Development | Data Validation | Data Visualization | JavaCareer growth and developmentMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Engineering Manager, ML INR 2500K-5000KC# | C++ | Debugging | Distributed Computing | JavaSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
HR TECHNOLOGY - HR Analytics INR 1500K-2200KArtificial Intelligence | Data Modeling | Data integration | Excel | HRISMid-level Full TimePune, Maharashtra, India1d ago
-
Sr. Manager, Software Engineering, Systems Infrastructure INR 2520K-3380KApache Kafka | Apache Pinot | Apache Spark | Autoscaling | Backend APICareer development | Hybrid work | Professional coachingSenior-level Full TimeBengaluru, KA, India1d ago
-
Data Science – (Gen AI Developer) - Associate INR 2000K-2400KAutogen | CI/CD | Data Analysis | Data Visualization | ETLSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Consultant _ADF INR 2000K-2000KADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India1d ago
-
Finance & Strategy - Finance Analytics Analyst INR 3200K-4500KAccrual accounting | Amazon Redshift | BigQuery | Cost Allocation | Data ModelingSenior-level Full TimeBengaluru1d ago
-
Senior-level Full TimeGurgaon, Haryana, India1d ago
-
Mid-level Full TimeMumbai, Maharashtra, India1d ago
-
Engineering-L2-Bengaluru-Associate-Data Governance INR 1500K-2000KAI | Automation | Data Accuracy | Data Analysis | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Engineering-L2-Bengaluru-Associate-Data Governance INR 1500K-2000KAI | Analytics | Automation | Data Analysis | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Engineering-L2-Bengaluru-Analyst-Data Governance INR 1500K-2345KAI | Analytics | Automation | Data Analysis | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India1d ago