QA Lead – AI/ML Systems
Maharashtra, Pune, India
INR 2000K-2829K (estimate) Senior-level Full Time
Tasks
- Collaborate with Data Science and MLOps to validate models in cloud
- Define AI evaluation metrics accuracy fairness drift explainability
- Develop Python automation for AI testing data validation model evaluation pipelines
- Drive verification and validation for AI models under FDA and SaMD compliance
- Ensure test traceability documentation and audit readiness
- Establish explainability testing frameworks and validate interpretability
- Lead AI model validation for LLM RAG testing bias analysis performance evaluation
- Own QA strategy for AI systems across model data product lifecycle
- Present validation findings risks and recommendations to stakeholders
- Provide technical leadership to QA teams
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | AI evaluation metrics | AI model | AI model validation | AWS SageMaker | Azure ML | Bias analysis | Data Drift | Data Drift Detection | Drift Detection | Evaluation metrics | Explainability | FDA Compliance | Fairness | Google Vertex | Google Vertex AI | IEC 62304 | ISO 13485 | ISO 14971 | LIME | LLM Testing | MLOps | Model Validation | Performance Evaluation | Python | RAG | SHAP | SaMD | Software QA | Test automation | Verification and Validation | Vertex AI | XAI
Education
N/A
Roles
AI | AI QA | AI QA Lead | Lead | QA Lead
Related jobs
-
AIML - Tech Lead INR 2500K-4500KApache Airflow | ETL | Entity recognition | Language Processing | Machine LearningSenior-level Full TimeIN-MH-Pune11h ago
-
Senior Lead Software Engineer - Java, PySpark, and AWS INR 1800K-2400KAWS | AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step FunctionsSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Lead Software Engineer INR 1800K-2400KAWS | AWS Glue | AWS Identity | AWS Identity and Access Management | AWS Key Management ServiceSenior-level Full TimeMumbai, Maharashtra, India17h ago
-
Assistant Manager - SA2 (AI Hub - GDC) INR 1400K-2200KAWS | Agent Development | Apache Kafka | Autogen | AzureMid-level Full TimeHyderabad, Telangana, India18h ago
-
Lead Software Engineer, ML Engineering INR 2500K-4500KAPI Integration | Autogen | Azure AI | Azure OpenAI | DDDSenior-level Full TimePune, Maharashtra, India19h ago
-
Lead Engineer - Investment Data Platform INR 3000K-4000K.Net Framework | API Management | Agile | Apigee | AzureHybrid work | Work from office 3 days per weekSenior-level Full TimePune, India1d ago
-
Mid-level Full TimeHyderabad, HDC4A, India1d ago
-
Mid-level Full TimePune - Tower 6, India R1d ago
-
Experienced AI Engineer for Storage Domain INR 3200K-4600KCloud Architecture | Deep learning | DevOps | Distributed Computing | ElasticsearchCareer Development Programs | Health and wellbeing benefits | Hybrid work schedule | Inclusion-focused cultureSenior-level Full TimeBengaluru, Karnātaka, India1d ago
-
Sr. Associate, Innovation & AI Automation INR 2000K-3380KAI Agents | AWS | Agentic Frameworks | Agile | Artificial IntelligenceSenior-level Full TimeIndia - Hyderabad1d ago
-
Senior-level Full TimeHyderabad, HDC3B, India1d ago
-
Data Engineer (Azure + Databricks) INR 1200K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Sr Software Engineer_GenAi/ML - 4to6yrs exp_Chennai/gurgaon INR 2520K-3380KAWS | AWS Bedrock | Agentic AI | Agile Scrum | AzureSenior-level Full TimeChennai - DLF IT Park, India1d ago
-
Experienced AI Engineer for Storage Domain INR 3700K-4600KDeep learning | DevOps | Distributed Computing | Elasticsearch | Hyperparameter TuningCareer Development Programs | Flexible work arrangement | Health and wellbeing benefits | Hybrid work schedule | Inclusion initiativesSenior-level Full TimeBengaluru, Karnātaka, India1d ago
-
Senior Lead, Data Science INR 3000K-4000KAzure Kubernetes | Azure Kubernetes Service | Azure Monitor | Azure OpenAI | CI/CDHybrid work flexibility | Wellbeing programsSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India1d ago
-
Associate Director – Data Science INR 1500K-2525KAKS | Azure Cloud | Azure Kubernetes | Azure Kubernetes Service | Azure MonitorBe Well programs | Certification support | Coaching | Employee development plans | Hybrid workMid-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India1d ago
-
Engineer Data INR 1200K-2000KAb Initio | BMC Control-M | Change Data Capture | Change Management | Control-MFlexible work environment | Internal mobility | Volunteering opportunities | Work-life balanceMid-level Full TimeKA Bangalore, India1d ago
-
Lead Engineer Data INR 2000K-2400KAb Initio | BMC Control-M | Change Data Capture | Change Management | Cloud servicesFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India1d ago
-
Sr Engineer Data INR 2000K-2400KAPI Integration | Ab Initio | Aggregations | BMC Control-M | Change Data CaptureSenior-level Full TimeKA Bangalore, India1d ago
-
Senior Engineer Data INR 1800K-2209KAb Initio | BMC Control-M | Change Data Capture | Change Management | Cloud servicesFlexible work environment | Inclusive workplace | Internal mobility | Volunteering opportunities | WellbeingSenior-level Full TimeKA Bangalore, India1d ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …1d ago
-
IN_Manager_Enterprise AI Architect – GenAI & Agentic AI_Digital Integration_Advisory_Gurgaon INR 2000K-4512KAIOps | Autogen | Azure AI | Azure OpenAI | CrewAISenior-level Full TimeGurugram 10 C, India1d ago
-
AI Engineer, LLM Systems & Agentic Workflows GBP 97K-130KAgentic Workflows | Anthropic API | Constrained decoding | Evaluation Pipelines | Go100 percent remote | Employee referral bonuses | Flexible time off | Fun events | Room to growSenior-level Full TimeArgentina; Brazil; Chile; Colombia; Costa Rica; … R1d ago
-
AI Engineer INR 2755K-4600KAI Safety | API Integration | Access Controls | Agent Orchestration | Data Leakage PreventionAsynchronous work | Continuous learning | High-performance culture | Knowledge sharing | Remote workSenior-level Full TimeRemote, Bangalore R1d ago
-
AWS | Agentic Frameworks | Azure | Cloud Computing | Fine TuningMid-level Full TimeBengaluru, Karnataka, India1d ago