QA Lead – AI/ML Systems
Maharashtra, Pune, India
INR 2000K-2829K (estimate) Senior-level Full Time
Tasks
- Collaborate with Data Science and MLOps to validate models in cloud
- Define AI evaluation metrics accuracy fairness drift explainability
- Develop Python automation for AI testing data validation model evaluation pipelines
- Drive verification and validation for AI models under FDA and SaMD compliance
- Ensure test traceability documentation and audit readiness
- Establish explainability testing frameworks and validate interpretability
- Lead AI model validation for LLM RAG testing bias analysis performance evaluation
- Own QA strategy for AI systems across model data product lifecycle
- Present validation findings risks and recommendations to stakeholders
- Provide technical leadership to QA teams
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | AI evaluation metrics | AI model | AI model validation | AWS SageMaker | Azure ML | Bias analysis | Data Drift | Data Drift Detection | Drift Detection | Evaluation metrics | Explainability | FDA Compliance | Fairness | Google Vertex | Google Vertex AI | IEC 62304 | ISO 13485 | ISO 14971 | LIME | LLM Testing | MLOps | Model Validation | Performance Evaluation | Python | RAG | SHAP | SaMD | Software QA | Test automation | Verification and Validation | Vertex AI | XAI
Education
N/A
Roles
AI | AI QA | AI QA Lead | Lead | QA Lead
Related jobs
-
Sr. Data Engineer USD 127K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityComprehensive benefits | Extensive training initiatives | Group insurance | Growth opportunities | Hospitalization insuranceSenior-level Full TimeBangalore, FL, US, 5600766h ago
-
Tech Lead - Data Bricks Job INR 2040K-3500KAgile | Azure | Azure Data | Azure Data Factory | Azure DatabricksContinuous learning | Flexible work arrangementsSenior-level Full TimeHyderabad, TG, IN12h ago
-
Senior AI Engineer INR 2500K-4800KAI auditability | AI guardrails | Accelerate | Access Controls | AdaptersSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Lead/Senior Software Engineer – User Foundations Platform INR 2500K-3500KAWS | Azure | CI/CD | Databases | Distributed SystemsSenior-level Full TimeIND - Bangalore - Ecoworld 6B …12h ago
-
AI Engineer (GDC)-65851 INR 60K-180KAWS | Agentic AI | CI/CD | Data Engineering | FastAPIFlexible work arrangements | Health and wellbeing benefits | Work-life balanceEntry-level Full Time(DEAI DS) IN Bengaluru - Residency …12h ago
-
AI Engineer I (Remote) USD 30K-39KAWS | Agentic Systems | Attention Mechanisms | BERT | CI/CDFull-time employment | Remote workEntry-level Full TimeIndia, Remote R20h ago
-
AI Engineer INR 2500K-5000KAPI Integration | Adversarial Testing | Agent systems | Airflow | Anthropic APISenior-level Full TimePune, Maharashtra22h ago
-
Agentic AI architect INR 2500K-4800KAPIs | AWS | Agent Orchestration | Autogen | AzureEmployee referral bonuses | Flexible work options | Fun culture | In-house technology training | Learning and development programsSenior-level Full TimeChennai, India22h ago
-
AI Developer (Python) INR 1800K-2500KCI/CD | Document parsing | ETL | FastAPI | Generative AIFlexible work options | In-house technology training | Learning and development programs | Medical insurance | Performance bonusesMid-level Full TimeChennai, India22h ago
-
AI Engineer INR 300K-300KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicInternal demos | Internal training sessionsEntry-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeBangalore, India1d ago
-
Senior-level Full TimeMumbai, Maharashtra, India1d ago
-
AI/ML Engineer INR 2500K-3000KAWS | Anomaly Detection | Automated retraining | Azure | ChromaCollaborative work environment | Competitive compensation | Continuous learning opportunities | Growth-oriented cultureMid-level Full TimeGujarat, Surat, India1d ago
-
AI Solution Engineer INR 900K-1000KAWS | C# | CI/CD | Containerization | Data PipelinesComprehensive health benefits | Flexible work environment | Generous time off | Global days of service | Hybrid work modelMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Associate Process Manager INR 2000K-2500KAPI Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Agent systemsMid-level Full TimePune, Maharashtra, India1d ago
-
Senior_AI_developer INR 3000K-4500KCI/CD | CNN | Computer Vision | Data Preprocessing | Deep learningSenior-level Full Timepune, India1d ago
-
Senior_AI_developer INR 3000K-4500KAI pipeline | API Orchestration | ASPICE | Agent behavior | CI/CDSenior-level Full Timebangalore, India1d ago
-
Lead Data Scientist INR 2516K-2829KAzure | Bias reduction | Cloud Computing | Data Modeling | Data PreparationEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-3300KAWS | AWS CDK | Agile | Airflow | BackfillSenior-level Full TimeHyderabad, Telangana, India1d ago
-
AI Solution Engineer INR 1000K-2000KAnthropic API | Automation | Data Enrichment | Data Privacy | EmbeddingsMid-level Full TimeBangalore, India1d ago
-
Lead Data Scientist INR 2500K-2829KAgentic AI | Artificial Intelligence | Azure Machine Learning | CI/CD | DatabricksEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India1d ago
-
Lead Data Scientist INR 2500K-2829KAKS | Agentic AI | Artificial Intelligence | Azure Machine Learning | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeMumbai, MH, India1d ago
-
Lead Data Scientist INR 2500K-4000K3D Geometry | Agile | Artificial Intelligence | C++ | Computer VisionContinuous learning opportunities | Flexible work environment | Supportive work cultureSenior-level Full TimeINDIA Home Office, India1d ago
-
Lead Data Scientist INR 2520K-4000KC plus plus | Computer Vision | CoreML | Deep learning | KerasCollaborative work culture | Exposure to global teams | Inclusive learning driven team | Professional growthSenior-level Full TimeMumbai, India1d ago