Manager – AI Performance & Analytics
Tasks
- Analyze conversational AI performance data
- Build dashboards and reporting frameworks
- Define and track AI performance metrics
- Design frameworks for LLM evaluation
- Establish best practices for AI evaluation
- Evaluate model upgrades and experiments
- Generate insights from conversation analytics
- Identify and recommend improvements for AI responses
- Lead and mentor analytics team
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Artificial Intelligence | B testing | Data Analysis | Language Models | Large Language Models | Machine Learning | Python | SQL | Tableau
Education
Roles
AI | AI & Analytics Manager | AI Performance Analyst | Analyst | Analytics Manager | Manager | Performance Analyst
Related jobs
-
Sr. Manager, AI FDE INR 2755K-3900KAI transformation | AWS | Azure | Cloud Computing | Cloud platformMonthly travel | Remote work option | Travel Once a MonthSenior-level Full TimeRemote - India R4h ago
-
Product Analyst INR 316K-316KAnomaly Detection | Artificial Intelligence | Data Governance | Data Modeling | Data QualityEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offEntry-level Full TimeChennai, TN, India16h ago
-
AI Engineer I (Remote) USD 30K-39KAWS | Agentic Systems | Attention Mechanisms | BERT | CI/CDFull-time employment | Remote workEntry-level Full TimeIndia, Remote R17h ago
-
Agentic AI architect INR 2500K-4800KAPIs | AWS | Agent Orchestration | Autogen | AzureEmployee referral bonuses | Flexible work options | Fun culture | In-house technology training | Learning and development programsSenior-level Full TimeChennai, India19h ago
-
AI Developer (Python) INR 1800K-2500KCI/CD | Document parsing | ETL | FastAPI | Generative AIFlexible work options | In-house technology training | Learning and development programs | Medical insurance | Performance bonusesMid-level Full TimeChennai, India19h ago
-
Senior Manager – Data Scientist INR 2520K-3500KAgent systems | Agentic AI | Amazon SageMaker | Apache Spark | Artificial neural networksContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Gurugram19h ago
-
Mid-level Full TimeIN-KA-Bangalore19h ago
-
AI Engineer INR 300K-300KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicInternal demos | Internal training sessionsEntry-level Full TimePune, Maharashtra, India21h ago
-
Data Analyst - FSD ordering INR 1600K-2000KBigQuery | Cloud platform | Data Storytelling | Data Visualization | Google CloudEntry-level Full TimePune, Maharashtra, India21h ago
-
Market Mix Modelling(MMM), Pricing, RGM,Data Analytics, Data Manipulation SQL - Gurgaon location INR 316K-316KAzure | Azure Databricks | Data Manipulation | Data analytics | DevOpsEntry-level Full TimeGurgaon, HR, India21h ago
-
Sr. HR Analytics Analyst (Data Warehouse Architect) INR 2516K-3380KAgile | Classification | Clustering | Dashboards | Data ModelingSenior-level Full TimeBengaluru, INDIA, India21h ago
-
Associate Process Manager INR 1500K-2000KAmazon Web Services | Azure | Cloud platform | DAX | Data GovernanceMid-level Full TimePune, Maharashtra, India22h ago
-
Senior-level Full TimeMumbai, Maharashtra, India23h ago
-
Data Analyst Fintech INR 1500K-2000KDashboarding | Data Analysis | Data Quality | Data Visualization | Data WarehousingMid-level Full TimeBengaluru, Karnataka, India23h ago
-
AI/ML Engineer INR 2500K-3000KAWS | Anomaly Detection | Automated retraining | Azure | ChromaCollaborative work environment | Competitive compensation | Continuous learning opportunities | Growth-oriented cultureMid-level Full TimeGujarat, Surat, India23h ago
-
AI Solution Engineer INR 900K-1000KAWS | C# | CI/CD | Containerization | Data PipelinesComprehensive health benefits | Flexible work environment | Generous time off | Global days of service | Hybrid work modelMid-level Full TimeBengaluru, Karnataka, India1d ago
-
DAX | MS Excel | NumPy | Pandas | Pivot TablesNight shift readyEntry-level Full TimePune, MH, India1d ago
-
Mid-level Full TimeGurugram, India1d ago
-
Associate Process Manager INR 2000K-2500KAPI Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Agent systemsMid-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeBengaluru, IN, 5601031d ago
-
Senior_AI_developer INR 3000K-4500KCI/CD | CNN | Computer Vision | Data Preprocessing | Deep learningSenior-level Full Timepune, India1d ago
-
Senior_AI_developer INR 3000K-4500KAI pipeline | API Orchestration | ASPICE | Agent behavior | CI/CDSenior-level Full Timebangalore, India1d ago
-
Quant Analytics Associate INR 850K-1050KAdobe Analytics | Data Visualization | Data cleaning | Data forecasting | Database DesignMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior Manager, Data Science INR 2400K-2829KData Mining | Data Quality | Data Quality Management | Machine Learning | Microsoft OfficeEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India1d ago