QA Lead – AI/ML Systems
Maharashtra, Pune, India
INR 2000K-2829K (estimate) Senior-level Full Time
Tasks
- Collaborate with Data Science and MLOps to validate models in cloud
- Define AI evaluation metrics accuracy fairness drift explainability
- Develop Python automation for AI testing data validation model evaluation pipelines
- Drive verification and validation for AI models under FDA and SaMD compliance
- Ensure test traceability documentation and audit readiness
- Establish explainability testing frameworks and validate interpretability
- Lead AI model validation for LLM RAG testing bias analysis performance evaluation
- Own QA strategy for AI systems across model data product lifecycle
- Present validation findings risks and recommendations to stakeholders
- Provide technical leadership to QA teams
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | AI evaluation metrics | AI model | AI model validation | AWS SageMaker | Azure ML | Bias analysis | Data Drift | Data Drift Detection | Drift Detection | Evaluation metrics | Explainability | FDA Compliance | Fairness | Google Vertex | Google Vertex AI | IEC 62304 | ISO 13485 | ISO 14971 | LIME | LLM Testing | MLOps | Model Validation | Performance Evaluation | Python | RAG | SHAP | SaMD | Software QA | Test automation | Verification and Validation | Vertex AI | XAI
Education
N/A
Roles
AI | AI QA | AI QA Lead | Lead | QA Lead
Related jobs
-
AI Data Engineer INR 2000K-3300KAWS | Agent memory | Audio Processing | Batch Processing | Cloud ComputingEquityMid-level Full TimeNew Delhi6h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India19h ago
-
AI Engineer – Retail/CPG Domain INR 1500K-2500KAWS | Azure | Cloud platform | Data Governance | Data ModelingMid-level Full TimeGurugram, Haryana, India19h ago
-
Software Engineering Professional INR 1500K-2500KAI orchestration | AIOps | API Integration | AWS | Agent FrameworksMid-level Full TimeBengaluru, IN, 56010322h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPIs | Agentic AI | Agile | Azure | BERTMid-level Full TimeBangalore, Karnataka, India22h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPI Design | Agent Frameworks | Agile | Azure | BERTMid-level Full TimeBangalore, Karnataka, India22h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPI Development | Azure | BERT | Bias Mitigation | Data PreprocessingMid-level Full TimeBangalore, Karnataka, India22h ago
-
Generative AI Lead INR 2475K-3465KAPIs | Chatbots | Cloud infrastructure | Conversational AI | Data LakesHybrid work | Reward and recognition | Volunteering opportunities | Wellness program | Work-life balanceSenior-level Full TimeHyderabad, India22h ago
-
AWS | Airflow | Azure | CI/CD | DBTSenior-level Full TimeBengaluru, KA, India23h ago
-
AWS | Anthropic API | Azure | CI/CD | DockerAnnual offsites | Flexible paid time off | Healthcare coverage | Home office support | Learning budgetSenior-level Full TimeIndia1d ago
-
Consultant - AI Engineer with Claude INR 2000K-4800KAWS | Autogen | Azure | Claude | ContainerizationSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Assistant Manager- AI Engineer INR 1800K-3000KAmazon Web Services | Autogen | Azure | Claude | Cloud platformMid-level Full TimeBangalore, Karnataka, India1d ago
-
Gen AI Tech Lead INR 2500K-4500KAPI Development | Azure Cognitive | Azure Cognitive Search | Azure OpenAI | Cognitive SearchSenior-level Full TimePune, Maharashtra, India1d ago
-
Assistant Manager- AI Engineer INR 1800K-3000KAmazon Web Services | Autogen | Azure | Cloud platform | CrewAIMid-level Full TimeBangalore, Karnataka, India1d ago
-
AI Engineer – AI Agents (Healthcare) INR 2000K-3500KAPI Integration | Cloud Computing | Fine Tuning | Hallucination control | JavaScriptMid-level Full TimeBengaluru1d ago
-
Senior-GDC / Senior Engineer INR 2000K-3300KAngular | Cloud Computing | Containerization | Data Classification | Data GovernanceSenior-level Full TimeHyderabad, Telangana, India1d ago
-
AI Engineer INR 2000K-4000KAWS Bedrock | AWS Bedrock Agents | AWS Bedrock Guardrails | AWS VPC | Agile methodologiesSenior-level Full TimeIndia Office1d ago
-
Tech Lead AI Engineer INR 1800K-3000KAI Evaluation | AWS Bedrock | AWS Lambda | AWS SageMaker | Agile methodologySenior-level Full TimeIndia Office1d ago
-
VP : AI Tech Lead INR 2000K-3500KAgile | Apache Spark | Cloud Computing | Data Governance | Data QualityAccident insurance | Child care assistance reimbursement | Employee assistance program | Flexible working arrangements | Gender neutral parental leaveSenior-level Full TimePune - Margarpatta, India1d ago
-
Automation and AI Solutions Lead INR 2500K-3500KAWS AgentCore | AWS Bedrock | Agent systems | Automation | CI/CDFlex My Way | Flexible vacation | Headspace app access | Hybrid work model | Mental health daysSenior-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Senior Manager - SAP Analytics Cloud & Datasphere INR 2520K-3380KAgile | Analytics Cloud | CI/CD | Cross-calculations | Data BlendingSenior-level Full TimeIndia - Chennai1d ago
-
Software Engineer, AI, AVP INR 2400K-6000KAgile | Automation | CI/CD | Customer Analytics | Data PipelinesExecutive-level Full TimeBengaluru, India1d ago
-
Automation | Backend Infrastructure | Data Management | Data Mining | Data PipelinesContinuing education program | Continuous learning resources | Family-friendly perks | Generous time off | Health care coverageSenior-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …1d ago
-
Bilby | CAMB | Class | DOLFINx | Differential EquationsFlexible part-time schedule | Freelance project-based workSenior-level FreelanceIndia - Remote R1d ago
-
AI Engineer INR 2000K-3000KAutomated testing | CI/CD | Cloud Computing | Language Models | Large Language ModelsEmployee assistance program | Mindfulness programs | Professional development course library | Volunteer donation matching | Volunteer time offMid-level Full TimeIndia Bengaluru1d ago