Principal QA Engineer – GenAI Testing - Manager
Tasks
- Analyze business and technical specifications
- Automate web service testing
- Check model accuracy
- Create automated test scripts
- Design test plans for Large Language Models
- Execute automated tests
- Maintain automated test suite
- Maintain bug tracking system
- Perform Agents testing
- Perform regression testing
- Perform safety compliance testing
- Report bugs
- Validate AI workflow reliability
- Validate AI workflow robustness
- Validate integration quality
- Validate prompts
- Verify fixes
- Write functional test cases
Perks/Benefits
Skills/Tech-stack
Artificial Intelligence | Behavior-Driven Development | Benchmarking | CI/CD | Fiddler | Gherkin | Git | JMeter | Jenkins | Jira | Language model testing | Large Language Model | Large Language Model Testing | Machine Learning | Model Testing | OpenAI evals | Postman | Prompt validation | Pytest | Python | Ragas | Red Teaming | SOAPUI | Safety testing | Selenium | Test-Driven | Test-Driven Development
Education
N/A
Related jobs
-
Consultant - Gen AI Engineer INR 550K-610KAPI Integration | Generative AI | Language Processing | Machine Learning | Natural LanguageEntry-level Full TimeBangalore, Karnataka, India6h ago
-
Gen AI Lead engineer INR 3000K-4800KAgentic Frameworks | CI/CD | Data Visualization | Git | LangchainSenior-level Full TimeChennai, Tamil Nadu, India6h ago
-
Full Stack Developer :: Acon INR 2500K-3500KAI Search | AI Studio | Application Security | Arize Phoenix | Azure AISenior-level Full TimeIndia7h ago
-
Lead Assistant Manager INR 2500K-4500KASR | AWS EC2 | Amazon ECS | Amazon SageMaker | Amazon Web ServicesSenior-level Full TimeNoida, Uttar Pradesh, India7h ago
-
Data Engineer INR 2755K-3500KAPI Development | AWS | Amazon Redshift | Azure | BashHybrid working | Inclusive culture | Learning and development programmesSenior-level Full TimeHyderabad, India7h ago
-
Assistant Manager-GDC INR 1500K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India9h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 2000K-3500K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSSenior-level Full TimePune, Maharashtra, India9h ago
-
Senior-level Full TimeBangalore, Karnataka, India10h ago
-
Artificial Intelligence | Generative AI | Machine Learning | Model OptimizationEntry-level Full TimePune, IN12h ago
-
Senior-level Full TimeBangalore, India13h ago
-
Mid-level Full TimeBangalore, India13h ago
-
Technical Fulfillment Specilaist INR 1500K-2400KAWS | Agile | Apache Airflow | Batch Processing | BigQueryGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India14h ago
-
Technical Fulfillment Specilaist INR 1500K-2400KAWS | Atlassian Confluence | Atlassian Jira | Batch Processing | BigQueryGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India14h ago
-
Site Reliability Engineer INR 1170K-1500KAlerting | Ansible | Bash | CI/CD | ChefCareer growth | Healthcare benefits | Hybrid work setting | Online learning platform | Paid time offEntry-level Full TimeIND-Pune-Equifax Analytics-PEC, India14h ago
-
Site Reliability Engineer - Intermediate INR 1800K-2345KAlerting | Ansible | Bash | Chef | Cloud CLIHealthcare | Hybrid work setting | Online learning platform | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India14h ago
-
APIs | CI/CD | Data Pipelines | Data Processing | MLOpsCareer development | Hybrid workSenior-level Full TimeHyderabad, IN, 50003214h ago
-
Lead Quantitative Analytics Specialist INR 2755K-2755KArtificial Intelligence | Credit Risk | Data Science | Machine Learning | Marketing AnalyticsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India14h ago
-
Mid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India14h ago
-
Abinitio | Autosys | Cloud platform | Code review | Data WarehouseAgile environment | Code review responsibilitySenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India14h ago
-
Principal Data Engineer INR 1800K-2040KAI machine learning | Compliance | Data Architecture | Data Governance | Distributed SystemsSenior-level Full TimeBangalore, India14h ago
-
Agentic AI | Artificial Intelligence | Data Analysis | Data Engineering | DatabricksCareer development | Inclusive workplace | Training opportunities | Wellbeing supportSenior-level Full TimeNew Delhi, National Capital Territory, IN, …14h ago
-
Senior Software Engineer, Python & Gen AI INR 2000K-3200KAPI | API Gateway | CI/CD | Continuous integration | Data GovernanceSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India14h ago
-
Senior-level Full TimeIndia - Remote R14h ago
-
Data Engineer INR 2400K-3380KAmazon Redshift | Data Engineering | Data Modeling | Data Warehousing | Data integrationSenior-level Full TimeHyderabad, HDC3B, India14h ago
-
Senior-level Full TimePune Cerebrum, India14h ago