Artificial Intelligence QA Manager
Tasks
- Build evaluation datasets
- Collaborate on acceptance criteria
- Design AI ML test strategies
- Develop automated test frameworks
- Document defects and failure patterns
- Ensure ethical fairness and compliance
- Evaluate model outputs
- Monitor production models
- Test RAG pipelines
- Validate data quality and pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Amazon SageMaker | B testing | Bias auditing | DBT | Data Analysis | Data Pipeline Testing | Data Quality | Data pipeline | Google Vertex | Google Vertex AI | Great Expectations | LLM Evaluation | MLflow | Machine Learning | Model Monitoring | Pipeline testing | Postman | Prompt engineering | Pytest | Python | Red Teaming | Retrieval-Augmented Generation | Selenium | Shadow Deployment | Vector Databases | Vertex AI
Roles
AI | AI QA | AI QA Manager | Assurance Manager | Manager | QA Manager | Quality Assurance | Quality Assurance Manager
Related jobs
-
Senior-level Full TimePune City, India19h ago
-
Assistant Manager of Data Quality INR 1400K-2437KChange Management | Data Quality | Key Performance Indicators | MIS Reporting | Microsoft ExcelAnnual success-sharing bonuses | Hybrid work environment | Work across global time zonesSenior-level Full TimeIndia21h ago
-
Director of Software Engineering – AI/ML INR 2400K-6000KArtificial Intelligence | Cloud Computing | Data Pipelines | Data labeling | DeploymentEmployee resource groups | Flexible work environment | Remote work optionExecutive-level Full TimeHyderabad, India22h ago
-
Azure Infra AI Operations & Platform Engineer INR 2000K-4500KAI Foundry | AKS | API Integration | Azure | Azure AIMid-level Full Timebangalore, India23h ago
-
Quantum AI Research Engineer INR 180K-240KAI Agents | Artificial Intelligence | Data Analysis | Deep learning | Generative AIEntry-level Full Timebengaluru, India23h ago
-
Agentic Data Delivery Lead INR 2000K-4500KAWS | Access Control | Agent systems | Apache Hadoop | Apache SparkSenior-level Full TimePune, Maharashtra, India23h ago
-
AI Developer - Salesforce Admin INR 2000K-2525KAI Agents | API Integration | Agent testing | Apex | Lightning WebAfternoon shift overlap with US team | Professional development for AI tools | Remote or timezone flexibilityMid-level Full TimeBangalore1d ago
-
AI Engineer (Manager level) INR 1800K-2500KAI Services | Apache Spark | Azure AI | Azure AI Services | Azure CIMid-level Full TimeHyderabad, India1d ago
-
Snowflake Lead - Manager INR 1500K-2500KAirflow | Anthropic Claude | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Mid-level Full TimeHyderabad, TS, India1d ago
-
AES - Generative AI INR 1500K-2700KAI Agents | AI Evaluation | AI orchestration | API Gateway | AWSMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeIndia1d ago
-
Asset & Wealth Management- WIS Quantitative Equity Solutions Client Portfolio Management- Associate-Bengaluru INR 1300K-2000KC plus plus | C# | Computer Programming | Due Diligence | ExcelEntry-level Full TimeBengaluru, Karnataka, India1d ago
-
Associate Practice Manager - IT Development INR 1800K-3300KAPI Management | AWS | Agile | Algorithms | AuditabilityMid-level Full TimeHyderabad, Telangana, India1d ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAPI Development | AWS | Autogen | Azure | Azure OpenAISenior-level Full TimeBangalore, Karnataka, India1d ago
-
Principal Engineer - AI INR 3000K-5000KAWS SageMaker | Amazon Bedrock | Amazon S3 | CI/CD | FaissMeaningful equity | Medical insurance | Unlimited leave | Wellness benefitsSenior-level Full TimeBengaluru1d ago
-
Senior AI Solutions Engineer INR 2000K-4500KAnsible | Argo CD | CI/CD | Configuration Management | Container RegistryEvening and weekend workSenior-level Full TimeBangalore, India1d ago
-
Python Engineer - AI/ML INR 3500K-5000KAPI Integration | Artificial Intelligence | Chroma | Data Engineering | Data IngestionEntry-level Full TimePLOT NO-1, S.NO. 77, India1d ago
-
A/B | A/B Testing | AWS | Azure | B testingSenior-level Full TimeBengaluru Millenia, India1d ago
-
Manager, Enterprise Data & Analytics Products INR 3000K-4000KAgile | Artificial Intelligence | Azure | Data Architecture | Data GovernanceHybrid work | Learning and development | Onsite work | Paid Holidays | Paid vacationSenior-level Full TimeIN025 Embassy Manyata Business Park, India1d ago
-
AVP - Data & ML Platform INR 3000K-4500KA/B | A/B Testing | Anomaly Detection | Audit trails | Auto ScalingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
AI Analytics Diagnostics Lead INR 3000K-5000KA/B | A/B Testing | B testing | Cohort Analysis | Data ModelingSenior-level Full TimeBangalore, India1d ago
-
Agent systems | Agentic AI | Amazon SageMaker | Apache Airflow | Apache HadoopFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
A/B | A/B Testing | AWS | Apache Spark | AzureFlexible work environment | Hybrid work | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India1d ago
-
Senior-level Full TimeIndia - Bengaluru - Doddanekundi Industrial …1d ago