Principal QA Engineer – GenAI Testing - Manager
Tasks
- Analyze business specifications
- Analyze technical specifications
- Check model accuracy
- Create test automation scripts
- Design test plans for Large Language Models
- Ensure reliability of integrations
- Execute automated tests
- Maintain automated tests
- Maintain bug tracking system
- Perform Agents testing
- Perform regression testing
- Perform safety compliance testing
- Report defects
- Test AI driven workflows
- Validate prompts
- Verify bug fixes
- Write functional test cases
Perks/Benefits
Skills/Tech-stack
BDD | CI/CD | Gherkin | Git | JMeter | Jenkins | Jira | Language model testing | Large Language Model | Large Language Model Testing | Machine Learning | Model Testing | OpenAI evals | Postman | Pytest | Python | Ragas | Red Teaming | SOAPUI | Safety validation | Selenium | TDD
Education
N/A
Related jobs
-
Senior Full-Stack AI Engineer- 3185 (Remote) INR 2000K-4500KAI Foundry | AWS Bedrock | Agile | Anthropic | Azure AIFlexible working hours | Learning and development programs | Recognition rewards | Remote workSenior-level Full TimeChennai, India R5h ago
-
Full-Stack AI Engineer - 3184 (Remote) INR 2000K-4500K.NET | AI Foundry | Agile | Azure AI | Azure AI FoundryFlexible working hours | L and D programs | Professional development | Remote work | Rewards and recognitionSenior-level Full TimeChennai, India R5h ago
-
Data Platform Engineer/Consultant Specialist INR 1500K-2500KAmazon S3 | Ansible | Atlassian Confluence | Atlassian Jira | AutomationFlexible workingMid-level Full TimeHyderabad, Telangana, India R5h ago
-
Associate Engineer - Azure Data engineer INR 747K-1039KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeBangalore - Karnataka, India - Kalyani …6h ago
-
Gen AI Developer INR 2000K-4500KData Engineering | Deep learning | Distributed Systems | GenAI | InferenceSenior-level Full TimeIN-MH-Pune6h ago
-
Senior-level Full Timebengaluru, India8h ago
-
API | AWS | Agile | CI/CD | CSSMid-level Full TimeHyderabad, Telangana, India8h ago
-
Senior Software Engineer I INR 2200K-2829KAPI Design | Airflow | Alerting | Apache Spark | Batch ProcessingCareer growth | Comprehensive health and wellbeing support | Leadership development | Learning opportunitiesSenior-level Full TimeChennai, TN, India10h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2500KAPIs | Alerting | Data Augmentation | Data Engineering | Data LineageSenior-level Full Timebangalore, India10h ago
-
Senior Data Engineer I INR 2040K-3500KAirflow | Analytics hub | Authorized Views | BigQuery | BigQuery EditionsSenior-level Full TimeChennai, TN, India10h ago
-
Software Engineer II INR 1000K-1700KApache Spark | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data FactoryMid-level Full TimeHyderabad, TS, IN10h ago
-
Staff GenAI Engineer INR 2500K-4800KAWS | Agentic Workflows | Azure | CI/CD | Data PipelinesCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India11h ago
-
Generative AI Engineer INR 1800K-3000KAI Foundry | AWS SageMaker | Amazon Bedrock | Anthropic | Azure AICollaborative team environment | Leadership development program | Training sessionsMid-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Mid-level Full TimeMumbai, Maharashtra, India11h ago
-
Mid-level Full TimeIndia11h ago
-
Senior Software Engineer INR 2000K-4500K.NET | Agile | Artificial Intelligence | Azure | Azure FunctionsSenior-level Full TimeBengaluru, KA, IN; Hyderabad, TS, IN11h ago
-
Agentic Frameworks | Artificial Intelligence | CCPA | Data Governance | Data IntegrityHybrid work | MentorshipSenior-level Full TimeBangalore, INDIA R12h ago
-
Gen AI INR 300K-420KGenerative AI | JSON | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeNoida, Uttar Pradesh, India13h ago
-
Associate Software Engineer - Spark/Scala INR 1500K-2000KApache Spark | CI/CD | Databricks | DevSecOps | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India13h ago
-
Software Engineer (Python, Pyspark, SQL) INR 1200K-2100KAWS | Azure | CI/CD | GCP | GitEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India13h ago
-
Azure Data Engineer- Consultant INR 1500K-2000KADLS | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India14h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2500KAWS | AWS Glue | AWS Lambda | AWS Redshift | Access policiesCorporate social responsibility programs | Discounts on products and services | Maternity and paternity leave | Networking opportunitiesMid-level Full TimeBangalore, Karnataka, India14h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2500KAWS | AWS Glue | Access policies | Airflow | Amazon QuickSightMid-level Full TimeBangalore, Karnataka, India14h ago