Principal QA Engineer – GenAI Testing - Manager
Tasks
- Analyze business and technical specifications
- Automate web services
- Check model accuracy
- Create automated test scripts
- Design and execute test plans for Large Language Models
- Ensure integration quality
- Ensure workflow reliability
- Ensure workflow robustness
- Maintain automated tests
- Maintain bug tracking system
- Perform Agents testing
- Perform regression testing
- Report bugs
- Test safety compliance
- Validate prompts
- Verify fixes
- Write functional test cases
Perks/Benefits
Skills/Tech-stack
AI Governance | Adversarial Testing | Artificial Intelligence | BDD | Bias detection | CI/CD | Fiddler | Gherkin | Git | JMeter | Jenkins | Jira | Language model testing | Large Language Model | Large Language Model Testing | Machine Learning | Model Testing | OpenAI evals | Postman | Prompt validation | Pytest | Python | Ragas | Red Teaming | SOAPUI | Safety testing | Selenium | TDD
Education
N/A
Related jobs
-
Software Engineering INR 1400K-1820KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeHyderabad, TS, IN4h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2000K-3630KAWS | Apache Spark | Azure | C++ | Convolutional Neural NetworksSenior-level Full Timebengaluru, India5h ago
-
Software Engineer - Spark, scala, Python, SQL, Databricks INR 1500K-2500KAirflow | Apache Spark | Automated testing | Azure Data | Azure Data LakeEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India6h ago
-
Senior Staff Machine Learning Engineer (Java + LLM) INR 2500K-3500KAlgorithms | Design Patterns | Java | Machine Learning | Object-OrientedSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Associate Engineer - Agentic AI Developer INR 2000K-3000KAgent systems | Azure | CI/CD | Docker | FastAPIMid-level Full TimeMumbai, MH, India7h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3000KAnthropic | Azure OpenAI | CI/CD | Code Analysis | CypressMid-level Full TimePune, Maharashtra, India7h ago
-
Azure | CSV | ETL | Python | SQLSenior-level Full TimeBangalore, India8h ago
-
FinOps Data Engineer INR 2000K-3000KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India10h ago
-
AWS Principal AI Specialist – GSI & ITES - India & SAARC Region INR 2000K-4000KAWS | Agentic AI | Amazon Bedrock | Amazon Q | Amazon SageMakerSenior-level Full TimeBengaluru, Karnataka, IND13h ago
-
Senior Data Engineer INR 1500K-2500KApache Airflow | Apache Hive | Apache Oozie | Apache Spark | BigQueryAdditional voluntary benefits | Disability programs | Flexible working hours | Life insurance | Private medical careSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India13h ago
-
GenAI Support Lead - Manager INR 2000K-3465KAI Agents | AI Governance | API Testing | Bias detection | CI/CDEmployee networks | Hybrid work model | Paid volunteer daysSenior-level Full TimeHyderabad, India13h ago
-
Generative AI Quality Engineer - Senior Associate INR 1500K-2600KArtificial Intelligence | BDD | CI/CD | Gherkin | GitEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India13h ago
-
Generative AI Quality Engineer - Senior Associate INR 1500K-2600KArtificial Intelligence | BDD | CI/CD | Fiddler | GherkinEmployee networks | Flexible work/life support | Hybrid work model | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
Mid-level Full TimeMumbai, India13h ago
-
Automation and AI Solutions Lead INR 2500K-3500KAWS Bedrock | Agent systems | Amazon AgentCore | Async Programming | CI/CDFlexible vacation | Headspace access | Hybrid work | Mental health days | Retirement savingsSenior-level Full TimeIndia, Bengaluru, Karnataka R13h ago
-
Senior Lead Data Engineer (Snowflake, DBT, Python)- 8 to 13 Years- Chennai & Bangalore INR 2755K-4000KApache Airflow | DBT | Data Modeling | Data Pipelines | ELTCollaboration and respect | Flexible work environment | International work environment | Personal development opportunities | Wellbeing benefitsSenior-level Full TimeIND CHNN 32 A&B 3FL STE …13h ago
-
Senior Lead Engineer (Embedded Platform Software) INR 1500K-2372KARM | Binary Analysis | Board Support | Board Support Package | BootloaderBackground check | Car lease program | Drug screen | Group health insurance | Group personal accident insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …13h ago
-
Senior Software Engineer INR 2139K-3500K.Net Framework | Agile | Asynchronous programming | Azure DevOps | C#Senior-level Full TimeIND Bangalore C 601, India13h ago
-
Sr Software Engineer III (IND) INR 2500K-4763KAutogen | CI/CD | Concurrency | CrewAI | Hugging FaceSenior-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India13h ago
-
Entry-level Full TimeIndia - Bangalore - 5th floor, …13h ago
-
Entry-level Full TimeBengaluru18h ago
-
Snowflake + Aws + dbt + sql Deputy Manager- DE INR 1500K-2000KAgile | CI/CD | DBT | Data Modeling | SQLAnnual appraisal | Free HMO coverage | Paid leaves | Safe work environment | Skills training opportunitiesMid-level Full TimeBengaluru, KA, India20h ago
-
Infrastructure & DevOps Engineer - AWS SageMaker Unified Studio INR 2000K-4000KAWS CloudFormation | AWS CloudWatch | AWS IAM | AWS Lambda | AWS SageMakerRemote workSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Entry-level Full TimePune, Maharashtra, India1d ago