Principal QA Engineer – GenAI Testing - Manager
Tasks
- Analyze business and technical specifications
- Automate web services
- Check model accuracy
- Create automated test scripts
- Design and execute LLM test plans
- Maintain automated tests
- Maintain bug tracking system
- Perform Agents testing
- Perform regression testing
- Report bugs
- Test AI workflow reliability robustness and integration quality
- Validate LLM safety compliance
- Validate prompts
- Verify fixes
- Write functional test cases
Perks/Benefits
- Employee networks
- Flexible work/life support
- Hybrid work model
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
Adversarial Testing | Artificial Intelligence | BDD | Benchmarking | CI/CD | Gherkin | Git | JMeter | Jenkins | Jira | Machine Learning | OpenAI evals | Postman | Prompt engineering | Pytest | Python | Ragas | Red Teaming | SOAPUI | Selenium | TDD
Education
N/A
Related jobs
-
Software Engineer II - Big Data (ETL) / DevOps Engineer + AWS INR 1500K-2500KAWS | Agent Frameworks | Apache Spark | Athena | AuroraMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Analyst-Data Science INR 2771K-4064KActive Learning | Algorithms | Apache Hive | Apache Spark | Bayesian MethodsEntry-level Full TimeGurugram, HR, India5h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Computing | Code review | ContainerizationSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
GCP Data Engineer INR 1500K-2000KAnsible | Cloud Bigtable | Cloud SQL | Cloud Spanner | Cloud platformProfessional growthMid-level Full TimeBengaluru, Pune6h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Native | Cloud-native development | Code reviewSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Software Engineer III - Java & Databricks INR 2200K-3500KAgile | Amazon Web Services | Angular | Application Resiliency | C#Senior-level Full TimeHyderabad, Telangana, India7h ago
-
AI Specialist (Technical) INR 1860K-3465KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeGurugram, HR, IN7h ago
-
Senior Robotics Engineer INR 1753K-2372KC++ | Java | Localization and mapping | MATLAB | Machine LearningFull Time Office Project Work | Relocation not provided | Travel for deployment and commissioningSenior-level Full TimeChennai, TN, IN7h ago
-
AI Specialist (ML & LLM) INR 2400K-4000KAI Search | Azure AI | Azure AI Search | Azure Functions | Azure Machine LearningMid-level Full TimeGurugram, HR, IN7h ago
-
AI Deployment Engineer INR 2000K-4800KCloud Architecture | Enterprise Architecture | Generative AI | JavaScript | Machine LearningHybrid work model | Relocation assistanceSenior-level Full TimeDelhi, India8h ago
-
Applied AI ML Associate Senior-Data Engineer INR 1000K-1800KApache Spark | CI/CD | Data Governance | Data Lineage | Data ModelingMid-level Full TimeBengaluru, Karnataka, India8h ago
-
AWS | AWS Machine Learning | Agent systems | Angular | AutogenSenior-level Full TimeChennai, TN, IN, 60003212h ago
-
AI Engineering INR 3584K-5000KAgentic Workflows | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeBangalore, KA, IN12h ago
-
Vice President (Performance and Rewards) Analytics INR 600K-2000KAnalytics | Compensation modeling | Data Modeling | Data Visualization | Data integrationExecutive-level Full TimeBangalore, KA, IN, 56007612h ago
-
IN_Manager_Data Analytics_AdvisoryCorporate_Advisory_ Bangalore INR 1200K-2300KArtificial Intelligence | Bloomberg | Capitaline | Data analytics | Microsoft ExcelFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India12h ago
-
Principal Engineer - - Generative AI Data & Analytics INR 3700K-4800KAI Observability | AIOps | Azure Data | Azure Data Engineer | Batch ProcessingSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India12h ago
-
Risk Analytics - Process Mining - Manager INR 1500K-2525KARIS | Apromore | Artificial Intelligence | Automation Anywhere | BPMNGlobal mobility | Inclusive cultureMid-level Full TimeGurgaon, HR, IN, 12201012h ago
-
Principal Engineer - Gen AI INR 3419K-5000KAI guardrails | Abuse detection | Agent architectures | Agentic AI | AuditabilitySenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India12h ago
-
EY - GDS Consulting - AI And DATA - Snowflake plus AWS - Manager INR 1500K-2600KAI Engineering | API Integration | AWS Data | AWS Data Engineering | Amazon AthenaClient impact | Flexible Work N/A | Global career support | Inclusive culture | MentoringMid-level Full TimeKolkata, WB, IN, 70009112h ago
-
Senior-level Full TimeChennai, IN12h ago
-
Senior Agentic AI Software Engineer INR 3242K-5000KAgile methodology | Amazon Web Services | Full Stack | Full-Stack Development | GeminiSenior-level Full TimeQ8 - Bangalore, India12h ago
-
Engineer Data Platform INR 1300K-2000KAPI Gateway | AWS CDK | AWS CloudFormation | AWS Identity | AWS Identity and Access ManagementFlexible work environment | Internal mobility | Volunteering opportunities | Welcoming and inclusive environment | Well-being supportMid-level Full TimeKA Bangalore, India12h ago
-
Generative AI Quality Engineer - Senior Associate INR 1860K-3000KArtificial Intelligence | BDD | Benchmarking | CI/CD | GherkinEmployee resource networks | Flexible work/life support | Hybrid work model | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India12h ago
-
Engineering Manager, AI Solutions INR 1860K-3814KAI machine learning | Agent Development | Agile | Artificial Intelligence | Behavioral TestingMid-level Full TimeBengaluru, KA, India1d ago
-
Data Science Manager INR 1500K-2100KAWS | Adversarial Networks | Attribution Modeling | Azure | Cloud ComputingMid-level Full TimePune1d ago