QA Lead – AI/ML Systems
Maharashtra, Pune, India
INR 2000K-2829K (estimate) Senior-level Full Time
Tasks
- Collaborate with Data Science and MLOps to validate models in cloud
- Define AI evaluation metrics accuracy fairness drift explainability
- Develop Python automation for AI testing data validation model evaluation pipelines
- Drive verification and validation for AI models under FDA and SaMD compliance
- Ensure test traceability documentation and audit readiness
- Establish explainability testing frameworks and validate interpretability
- Lead AI model validation for LLM RAG testing bias analysis performance evaluation
- Own QA strategy for AI systems across model data product lifecycle
- Present validation findings risks and recommendations to stakeholders
- Provide technical leadership to QA teams
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | AI evaluation metrics | AI model | AI model validation | AWS SageMaker | Azure ML | Bias analysis | Data Drift | Data Drift Detection | Drift Detection | Evaluation metrics | Explainability | FDA Compliance | Fairness | Google Vertex | Google Vertex AI | IEC 62304 | ISO 13485 | ISO 14971 | LIME | LLM Testing | MLOps | Model Validation | Performance Evaluation | Python | RAG | SHAP | SaMD | Software QA | Test automation | Verification and Validation | Vertex AI | XAI
Education
N/A
Roles
AI | AI QA | AI QA Lead | Lead | QA Lead
Related jobs
-
Senior Consultant INR 2500K-4000K.Net Core | ASP.Net Core | Azure AI | Azure Machine Learning | Azure OpenAISenior-level Full TimeIN-AP-Hyderabad6h ago
-
AIML Python with AI INR 2500K-3500KAPIs | Computer Vision | Deep learning | Language Processing | MLOpsSenior-level Full TimeIN-AP-Hyderabad6h ago
-
AIML Python with AI Architect INR 2500K-4500KComputer Vision | Deep learning | Feature Engineering | Language Processing | MLOpsSenior-level Full TimeIN-AP-Hyderabad6h ago
-
AI Solutions Lead INR 2500K-4000KAWS | Data Lake | Data Pipelines | Data Warehousing | Deep learningSenior-level Full TimePune, MAHĀRĀSHTRA, India6h ago
-
AI Lead - Gen AI Solution INR 2500K-4500KControlNet | Cosmos DB | DETR | Docker | FP8Full-time employment | Hybrid work | Permanent roleSenior-level Full TimeKochi, Kerala, India7h ago
-
Senior-level Full TimeKochi, Kerala, India7h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAutogen | Claude | Cloud Computing | CrewAI | FastAPIMid-level Full TimePune, Maharashtra, India8h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAgent Frameworks | Autogen | Claude | Cloud Computing | CrewAIMid-level Full TimeBangalore, Karnataka, India8h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAgent Frameworks | Autogen | Claude | Cloud Computing | CrewAIMid-level Full TimePune, Maharashtra, India8h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAutogen | Claude | CrewAI | FastAPI | FlaskMid-level Full TimeBangalore, Karnataka, India8h ago
-
Consultant - AI Engineer with Cloude INR 2500K-4500KAWS | Autogen | Azure | Cloud platform | ContainerizationSenior-level Full TimeBangalore, Karnataka, India10h ago
-
AI Security Manager INR 950K-1250KAnomaly Detection | Artificial Intelligence | Behavioral analytics | CCPA | CybersecurityMid-level Full TimeIndia11h ago
-
AI Security Engineer INR 1500K-2500KAgent systems | Anomaly Detection | Artificial Intelligence | Behavioral analytics | CCPAMid-level Full TimeIndia11h ago
-
Consultant - Delivery INR 2500K-4500KAWS | Amazon SageMaker | Azure | Azure AI | Data PreprocessingSenior-level Full TimePune, MH, IN11h ago
-
Consultant - Gen AI INR 2500K-3200KAWS SageMaker | Apache Airflow | Apache Spark | Azure ML | CI/CDSenior-level Full TimeBangalore, Karnataka, India12h ago
-
Consultant - Gen AI INR 2500K-3200KAPIs | AWS | Airflow | Amazon SageMaker | AzureAccess to AI research labs | Certification opportunities | Cloud innovation platform access | Mentorship | Performance based work environmentSenior-level Full TimeGurgaon, Haryana, India12h ago
-
Lead Software Engineer Python, Pyspark - Big Data INR 1500K-2400KAWS | Apache Spark | Automation | Continuous Delivery | DatabricksSenior-level Full TimeHyderabad, Telangana, India13h ago
-
AI Engineering Intern INR 300K-420KAWS | Agent systems | Anthropic Claude | Anthropic Claude API | BenchmarkingAutonomy | Central office location | Code reviews | Employee medical coverage | MentorshipEntry-level InternshipPune, Maharashtra, India R13h ago
-
Consultant - Gen AI INR 2500K-3200KAPIs | AWS SageMaker | Apache Airflow | Apache Spark | Azure Machine LearningAccess to AI research labs | Certifications | Cloud innovation platforms | Opportunity for leadershipSenior-level Full TimeGurgaon, Haryana, India14h ago
-
Consultant - Gen AI INR 2500K-3200KAPI Design | AWS SageMaker | Apache Airflow | Apache Spark | Azure MLSenior-level Full TimeBangalore, Karnataka, India14h ago
-
Conultant- Gen AI INR 2500K-3200KAPI | AWS SageMaker | Airflow | Apache Spark | Azure Machine LearningSenior-level Full TimeBangalore, Karnataka, India14h ago
-
Consultant- Gen AI INR 2500K-3200KAPIs | AWS SageMaker | Apache Airflow | Apache Spark | Azure Machine LearningSenior-level Full TimeGurgaon, Haryana, India14h ago
-
Lead Software Engineer INR 3375K-4590KAWS | Distributed Systems | GitHub Copilot | Java | LLMContinuous learning | Cross-functional projects | Online learning campus | Training coursesSenior-level Full TimeMumbai, India14h ago
-
AI/ML Engineer II INR 950K-1250KAWS | Azure | Containerization | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R15h ago
-
AI/ML Engineer II INR 950K-1250KAmazon Web Services | Azure | Cloud platform | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R15h ago