Principal QA Engineer – GenAI Testing - Manager
Tasks
- Analyze business and technical specifications
- Automate web service testing
- Check model accuracy
- Create automated test scripts
- Design test plans for Large Language Models
- Execute automated tests
- Maintain automated test suite
- Maintain bug tracking system
- Perform Agents testing
- Perform regression testing
- Perform safety compliance testing
- Report bugs
- Validate AI workflow reliability
- Validate AI workflow robustness
- Validate integration quality
- Validate prompts
- Verify fixes
- Write functional test cases
Perks/Benefits
Skills/Tech-stack
Artificial Intelligence | Behavior-Driven Development | Benchmarking | CI/CD | Fiddler | Gherkin | Git | JMeter | Jenkins | Jira | Language model testing | Large Language Model | Large Language Model Testing | Machine Learning | Model Testing | OpenAI evals | Postman | Prompt validation | Pytest | Python | Ragas | Red Teaming | SOAPUI | Safety testing | Selenium | Test-Driven | Test-Driven Development
Education
N/A
Related jobs
-
Principal Consultant - GenAI Engineer INR 3000K-4144KAWS | Agentic AI | Azure | Azure OpenAI | Cloud ComputingSenior-level Full TimeIndia-Pune2h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4725KAWS | Agentic AI | Azure OpenAI | Cloud platform | Deep learningSenior-level Full TimeIndia-Kolkata2h ago
-
Actuarial - Data Science INR 1500K-3000KClassification | Data Preprocessing | Data Quality | Explainable AI | Feature EngineeringMid-level Full TimeBangalore, KA, India4h ago
-
Data Engineer II - Python, AWS & Pyspark INR 1500K-2200KAWS | Data Migration | Data Modeling | Data Warehouse | Data pipelineMid-level Full TimeHyderabad, Telangana, India6h ago
-
AWS | Alerting | Audit Logging | Azure | CI/CDSenior-level Full TimePune, MH, India6h ago
-
Consultant - Gen AI Engineer INR 550K-610KAPI Integration | Generative AI | Language Processing | Machine Learning | Natural LanguageEntry-level Full TimeBangalore, Karnataka, India7h ago
-
Apache Iceberg | Apache Spark | Avro | CI/CD | Cause analysisEntry-level Full TimeHyderabad, Telangana, India7h ago
-
Software Engineer III - Data Engineer, AWS, ETL, Python INR 2000K-3500KAWS | CI/CD | Data Governance | Data Lake | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Gen AI Lead engineer INR 3000K-4800KAgentic Frameworks | CI/CD | Data Visualization | Git | LangchainSenior-level Full TimeChennai, Tamil Nadu, India8h ago
-
Full Stack Developer :: Acon INR 2500K-3500KAI Search | AI Studio | Application Security | Arize Phoenix | Azure AISenior-level Full TimeIndia8h ago
-
Lead Assistant Manager INR 2500K-4500KASR | AWS EC2 | Amazon ECS | Amazon SageMaker | Amazon Web ServicesSenior-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Data Engineer INR 2755K-3500KAPI Development | AWS | Amazon Redshift | Azure | BashHybrid working | Inclusive culture | Learning and development programmesSenior-level Full TimeHyderabad, India9h ago
-
Director of Software Engineering - Big Data, Cloud INR 2000K-6000KAI machine learning | AWS | Agile | Azure | Big DataExecutive-level Full TimeMumbai, Maharashtra, India9h ago
-
Assistant Manager-GDC INR 1500K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India10h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 2000K-3500K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSSenior-level Full TimePune, Maharashtra, India11h ago
-
Software Engineer III - Databricks, SQL , Python INR 2000K-2800KApache Spark | Cloud technologies | Data Lake | Data Warehouse | DatabricksSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior-level Full TimeBangalore, Karnataka, India12h ago
-
Artificial Intelligence | Generative AI | Machine Learning | Model OptimizationEntry-level Full TimePune, IN13h ago
-
Senior-level Full TimeBangalore, India14h ago
-
Mid-level Full TimeBangalore, India14h ago
-
Technical Fulfillment Specilaist INR 1500K-2400KAWS | Agile | Apache Airflow | Batch Processing | BigQueryGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India15h ago
-
Technical Fulfillment Specilaist INR 1500K-2400KAWS | Atlassian Confluence | Atlassian Jira | Batch Processing | BigQueryGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India15h ago
-
Site Reliability Engineer INR 1170K-1500KAlerting | Ansible | Bash | CI/CD | ChefCareer growth | Healthcare benefits | Hybrid work setting | Online learning platform | Paid time offEntry-level Full TimeIND-Pune-Equifax Analytics-PEC, India15h ago
-
Site Reliability Engineer - Intermediate INR 1800K-2345KAlerting | Ansible | Bash | Chef | Cloud CLIHealthcare | Hybrid work setting | Online learning platform | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India15h ago
-
APIs | CI/CD | Data Pipelines | Data Processing | MLOpsCareer development | Hybrid workSenior-level Full TimeHyderabad, IN, 50003215h ago