Testing Manager – Analytics & AI Evaluation Center of Excellence Lead
INR 2000K-3300K (estimate) Senior-level Full Time
Tasks
- Assess model quality fairness bias
- Build and lead validation team
- Define validation strategies
- Ensure data integrity
- Ensure data privacy governance and compliance
- Evaluate large language models
- Execute automated regression suites
- Improve validation efficiency scalability and effectiveness
- Lead end to end user acceptance testing
- Modernize validation automation
- Partner with product managers data scientists and stakeholders
- Translate metrics into business recommendations
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | Acceptance Testing | Analytics Pipelines | Automated Regression | Automated testing | Bias Mitigation | Compliance | Data Governance | Data Integrity | Data Privacy | Data Quality | Decision Making | Development Lifecycle | Fairness | Language Models | Large Language Models | Machine Learning | Model Benchmarking | Prompt testing | Python | Regression testing | Risk-based | Risk-based decision making | SQL | Software Development Lifecycle | Software development | Stakeholder management | Structured data | Unstructured Data | User Acceptance | User Acceptance Testing | Validation strategy
Education
Bachelor of Engineering | Bachelor of Science | Master of Business Administration | Master of Science
Roles
AI | AI Evaluation Lead | Evaluation Lead | Lead | Manager | Testing Manager | User Acceptance Testing Manager
Related jobs
-
Senior-level Full TimeBangalore4h ago
-
Manager - MIS & Reporting INR 650K-1500KData Governance | Data Visualization | Data Warehousing | Data analytics | Database ManagementAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive work cultureMid-level Full TimeGurugram, India5h ago
-
Lead Software Engineer - Java, Spring boot, AWS Cloud & AI/ML (REST APIs, System Design, SDLC) INR 3000K-5000KAPI Gateway | AWS Glue | AWS Lambda | AWS Step Functions | AgileSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Data & AI Project Manager INR 3000K-4500KAgile | Analytics | Business Intelligence | Change Management | ComplianceSenior-level Full TimeIN-TN-Chennai5h ago
-
Associate Engineer - AI/ML INR 2500K-4000KDistributed Systems | Edge AI | GPU | LLM Agents | LangchainAccess to cutting edge technologies and tools | Collaborative work environment | Professional growth and development | Training and development opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Technologist, Data Analytics Engineering INR 3000K-4500KAI orchestration | API Management | Artificial Intelligence | Automation | CI/CDSenior-level Full TimeBengaluru, KA, India6h ago
-
AI/ML Developer (Data Scientist) INR 3264K-5876KAPI Integration | Anomaly Detection | Apache Spark | Azure | CI/CDSenior-level Full TimeBengaluru, India6h ago
-
Software Engineering Manager, Enterprise Data Platform INR 3845K-5500KArtificial Intelligence | C# | C++ | Data Architecture | Data EngineeringSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Mid-level Full TimeIndia8h ago
-
Manager INR 3000K-5500KAI Foundry | AKS | API Design | AWS Bedrock | Azure AIGlobal delivery collaborationSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Assistant Vice President INR 4000K-5199KBusiness Analysis | Communication | Data Storytelling | Data Visualization | ExcelExecutive-level Full TimeIndia9h ago
-
Anthropic SDK | Embeddings | Fine Tuning | Git | GitHub ActionsCollaborative values led team | Exposure to global teams and customers | Generous holiday allowance | Hybrid work environment | Individual career developmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India10h ago
-
Engineering Manager – AI Platforms INR 3000K-5000KAWS Bedrock | AWS SageMaker | Agile | Azure AI | CI/CDCollaborative team environment | Global consulting experience | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India11h ago
-
Software Development Senior Associate INR 2000K-4500KAmazon Web Services | Artificial Intelligence | CI/CD | Data Analysis | DockerCareer growth opportunities | Certification support | Collaborative work environment | MentorshipSenior-level Full TimeChennai, TN, IN11h ago
-
Program Manager – Digital & AI INR 1500K-3000KAgentic AI | Agile | Amazon Web Services | Artificial Intelligence | AzureMid-level Full Timebengaluru, India11h ago
-
Lead Data Engineer (OIC+Python) INR 2817K-4064KAPI Management | Apache Airflow | Cloud Composer | Cloud infrastructure | Cloud platformSenior-level Full TimeHyderabad, India11h ago
-
Manager - Artificial Intelligence & Compliance Automation INR 2500K-5000KAPI Integration | Anomaly Detection | Artificial Intelligence | Automation | Azure AISenior-level Full TimeThane, Maharashtra, India12h ago
-
Senior Manager of Software Engineering - Data Engineering Lead INR 3845K-5500KAgile | Amazon Web Services | Apache Kafka | Apache Spark | Artificial IntelligenceSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Gen AI - Engineering Lead INR 2000K-5000KAI orchestration | Agentic AI | Benchmarking | CrewAI | EmbeddingsSenior-level Full TimeIndia13h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India13h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India13h ago
-
Senior-level Full TimeGurugram, Haryana, India13h ago
-
Lead Data Engineer INR 2000K-3000KApache Kafka | Apache Spark | Automated testing | CI/CD | ConcurrencySenior-level Full TimeBengaluru, KA, India15h ago
-
GenAI Engineer INR 1200K-4500KAI Studio | AKS | App Service | Autogen | AzureCareer growth programs | Flexible work arrangements | Flexible work hours | Generative AI Certifications Support | Remote work optionMid-level Full TimeGurgaon, IN16h ago
-
AI / ML Engineer INR 1200K-2500KAI Agents | Cloud Computing | Deep learning | Generative AI | Machine LearningMid-level Full TimeHyderabad, HDC3B, India18h ago