Principal QA Engineer – GenAI Testing - Manager
Tasks
- Analyze business and technical specifications
- Automate web services
- Check model accuracy
- Create automated test scripts
- Design and execute LLM test plans
- Maintain automated tests
- Maintain bug tracking system
- Perform Agents testing
- Perform regression testing
- Report bugs
- Test AI workflow reliability robustness and integration quality
- Validate LLM safety compliance
- Validate prompts
- Verify fixes
- Write functional test cases
Perks/Benefits
- Employee networks
- Flexible work/life support
- Hybrid work model
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
Adversarial Testing | Artificial Intelligence | BDD | Benchmarking | CI/CD | Gherkin | Git | JMeter | Jenkins | Jira | Machine Learning | OpenAI evals | Postman | Prompt engineering | Pytest | Python | Ragas | Red Teaming | SOAPUI | Selenium | TDD
Education
N/A
Related jobs
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream | ClusteringMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream analytics | ClusteringMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Software Engineer II - Big Data (ETL) / DevOps Engineer + AWS INR 1500K-2500KAWS | Agent Frameworks | Apache Spark | Athena | AuroraMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Senior Software Engineer-Data INR 2000K-4580KAI Foundry | Agent Orchestration | Apache Spark | Azure AI | Azure AI FoundrySenior-level Full TimeIndia, Telangana, Hyderabad4h ago
-
Analyst-Data Science INR 2771K-4064KActive Learning | Algorithms | Apache Hive | Apache Spark | Bayesian MethodsEntry-level Full TimeGurugram, HR, India5h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Computing | Code review | ContainerizationSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
GCP Data Engineer INR 1500K-2000KAnsible | Cloud Bigtable | Cloud SQL | Cloud Spanner | Cloud platformProfessional growthMid-level Full TimeBengaluru, Pune7h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Native | Cloud-native development | Code reviewSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Software Engineer III - Java & Databricks INR 2200K-3500KAgile | Amazon Web Services | Angular | Application Resiliency | C#Senior-level Full TimeHyderabad, Telangana, India8h ago
-
AI Specialist (Technical) INR 1860K-3465KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeGurugram, HR, IN8h ago
-
Senior Robotics Engineer INR 1753K-2372KC++ | Java | Localization and mapping | MATLAB | Machine LearningFull Time Office Project Work | Relocation not provided | Travel for deployment and commissioningSenior-level Full TimeChennai, TN, IN8h ago
-
AI Specialist (ML & LLM) INR 2400K-4000KAI Search | Azure AI | Azure AI Search | Azure Functions | Azure Machine LearningMid-level Full TimeGurugram, HR, IN8h ago
-
Manager - AI Application Development INR 2500K-5000KAI Foundry | Arize Phoenix | Autogen | Azure AI | Azure AI FoundrySenior-level Full TimeGurgaon, Haryana, India8h ago
-
Manager - AI Application Development INR 2500K-5000KAI Foundry | Agent systems | Arize Phoenix | Autogen | Azure AISenior-level Full TimeGurgaon, Haryana, India8h ago
-
AI Deployment Engineer INR 2000K-4800KCloud Architecture | Enterprise Architecture | Generative AI | JavaScript | Machine LearningHybrid work model | Relocation assistanceSenior-level Full TimeDelhi, India9h ago
-
Applied AI ML Associate Senior-Data Engineer INR 1000K-1800KApache Spark | CI/CD | Data Governance | Data Lineage | Data ModelingMid-level Full TimeBengaluru, Karnataka, India9h ago
-
AWS | AWS Machine Learning | Agent systems | Angular | AutogenSenior-level Full TimeChennai, TN, IN, 60003213h ago
-
AI Engineering INR 3584K-5000KAgentic Workflows | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeBangalore, KA, IN13h ago
-
Vice President (Performance and Rewards) Analytics INR 600K-2000KAnalytics | Compensation modeling | Data Modeling | Data Visualization | Data integrationExecutive-level Full TimeBangalore, KA, IN, 56007613h ago
-
IN_Manager_Data Analytics_AdvisoryCorporate_Advisory_ Bangalore INR 1200K-2300KArtificial Intelligence | Bloomberg | Capitaline | Data analytics | Microsoft ExcelFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India13h ago
-
Principal Engineer - - Generative AI Data & Analytics INR 3700K-4800KAI Observability | AIOps | Azure Data | Azure Data Engineer | Batch ProcessingSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
Risk Analytics - Process Mining - Manager INR 1500K-2525KARIS | Apromore | Artificial Intelligence | Automation Anywhere | BPMNGlobal mobility | Inclusive cultureMid-level Full TimeGurgaon, HR, IN, 12201013h ago
-
Principal Engineer - Gen AI INR 3419K-5000KAI guardrails | Abuse detection | Agent architectures | Agentic AI | AuditabilitySenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
EY - GDS Consulting - AI And DATA - Snowflake plus AWS - Manager INR 1500K-2600KAI Engineering | API Integration | AWS Data | AWS Data Engineering | Amazon AthenaClient impact | Flexible Work N/A | Global career support | Inclusive culture | MentoringMid-level Full TimeKolkata, WB, IN, 70009113h ago
-
Senior-level Full TimeChennai, IN13h ago