QA Lead - Manual, Automation & AI Testing
INR 1500K-3000K (estimate) Senior-level Full Time
Tasks
- Analyze production defects root cause
- Build automation frameworks
- Create test cases and scenarios
- Design test plans
- Develop test datasets for AI evaluation
- Establish quality metrics
- Evaluate AI responses accuracy relevance consistency completeness safety
- Implement preventive measures
- Lead automation testing
- Lead manual testing
- Mentor QA engineers
- Monitor production quality
- Own quality strategy
- Perform API testing
- Perform database testing
- Perform exploratory testing
- Perform functional testing
- Perform integration testing
- Perform performance testing
- Perform production sanity testing
- Perform regression testing
- Support release validation QA sign off
- Test AI hallucinations prompt injection data leakage bias edge cases
- Test RAG workflows document retrieval context relevance response grounding citation accuracy
- Validate LLM API integrations reliability latency error handling rate limits token usage cost
Perks/Benefits
- N/A
Skills/Tech-stack
AI Testing | API Integration | API Testing | Appium | Automation Testing | Automation frameworks | Bias Testing | CI/CD | Database Testing | Datadog | Dataset design | Defect Leakage | Distributed Systems | Docker | Error Handling | Event Driven | Event-driven architecture | Generative AI | Git | GitHub | GitHub Actions | GitLab | Grafana | Hallucination Testing | JMeter | Jenkins | Jira | K6 | Kafka | Kibana | Kubernetes | LLM | LLM Evaluation | Latency testing | Locust | Manual Testing | Microservices | Monitoring | Performance Testing | Playwright | Postman | Prompt Regression | Prompt Regression Testing | Prompt engineering | Pytest | Python | Python Requests | Quality metrics | RAG | REST Assured | Rate Limiting | Regression Suite | Regression testing | Release readiness | Retrieval-Augmented Generation | Robot Framework | SQL | SQL testing | Security Testing | Selenium | Test Automation Frameworks | Test Dataset | Test Dataset Design | Test automation | Token usage | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Related jobs
-
SW Architect - AI Engineering INR 2500K-5000KAPI Development | AWS | Azure | Cloud platform | Cost OptimizationContinuous learning opportunities | Hybrid work opportunities | Supportive, inclusive work environment | Training programsSenior-level Full TimePune - Maharashtra - India1d ago
-
AI Solutions Engineer – Quality & Digitalization INR 2500K-4500KAnomaly Detection | Artificial Intelligence | Azure | Bias Mitigation | Cloud ComputingMid-level Full TimeBangalore - Karnataka - India1d ago
-
Access Control | Agile | Alerting | Apache Airflow | AuditabilityContinuous professional development | Flexible working | Inclusive and diverse work environmentMid-level Full TimePune, Maharashtra, India1d ago
-
Senior Software Engineer, Google Cloud INR 2000K-3300KAgentic AI | CI/CD | Cloud Computing | Code review | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Mid-level Full TimeIndia1d ago
-
Lead Software Engineer - (SRE principles , AI tools, AWS) INR 3000K-6000KAIOps | API Gateway | AWS ECS | AWS Lambda | Amazon APISenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeMADURAI, TAMIL NADU, India1d ago
-
Senior AI Engineer INR 3264K-5000KAI Foundry | Access Control | Agent Frameworks | Authentication | AzureSenior-level Full TimeIndia1d ago
-
AI Engineer INR 2500K-4800KCloud Computing | Generative AI | Language Models | Large Language Models | MLOpsMid-level Full TimeIndia1d ago
-
Entry-level Full TimeBangalore, Karnataka, India1d ago
-
Platform Engineer INR 1500K-3900KADLS Gen2 | Azure | Azure Databricks | Azure Networking | Azure StorageSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer (Manager level) INR 1200K-2500KApache Spark | Azure AI | Azure CI | Azure CI/CD | Azure CognitiveMid-level Full TimeHyderabad, India1d ago
-
Senior Data Engineer | Offshore INR 1500K-2500KCI/CD | DBT | Data Dictionary | Data Quality | Dimensional ModelingSenior-level Full TimeIndia1d ago
-
Senior-level Full TimePune, MH, IN R1d ago
-
Python, Snowflake, AWS-6-9yrs-BLR INR 1500K-2700KAWS | Agile | Continuous integration | Database Development | ETLSenior-level Full TimeIndia1d ago
-
Consultant - Databricks Azure INR 1000K-2700KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India1d ago
-
Assistant Manager - Databricks Azure INR 1500K-2000KADLS | Amazon Kinesis | Apache Kafka | Apache Spark | Azure ADMid-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Consultant - Databricks Azure INR 1500K-2000KADLS | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India1d ago
-
Staff AI Engineer INR 4000K-5500KDeep learning | Graph Learning | Graphical Models | Linear Algebra | Machine LearningSenior-level Full TimeDelhi NCR1d ago
-
Senior/Staff Data Engineer INR 1500K-3000KAgile | Algorithms | Apache Druid | Cassandra | Data StructuresSenior-level Full TimeDelhi NCR1d ago
-
AI/ML Architect INR 4800K-6000KData Mining | Data Pipelines | Deep learning | Distributed Systems | Graph AnalysisSenior-level Full TimeDelhi NCR1d ago
-
Staff /Sr Staff/ Principal Engineer - Lakehouse INR 3500K-4800KAWS | Apache Flink | Apache Spark | Azure | CassandraSenior-level Full TimeDelhi NCR1d ago
-
Associate Consultant - Databricks AWS INR 1500K-2000KADLS | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India1d ago