Principal QA Engineer – GenAI Testing - Manager
Tasks
- Analyze business and technical specifications
- Automate web services
- Check model accuracy
- Create automated test scripts
- Design and execute LLM test plans
- Maintain automated tests
- Maintain bug tracking system
- Perform Agents testing
- Perform regression testing
- Report bugs
- Test AI workflow reliability robustness and integration quality
- Validate LLM safety compliance
- Validate prompts
- Verify fixes
- Write functional test cases
Perks/Benefits
- Employee networks
- Flexible work/life support
- Hybrid work model
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
Adversarial Testing | Artificial Intelligence | BDD | Benchmarking | CI/CD | Gherkin | Git | JMeter | Jenkins | Jira | Machine Learning | OpenAI evals | Postman | Prompt engineering | Pytest | Python | Ragas | Red Teaming | SOAPUI | Selenium | TDD
Education
N/A
Related jobs
-
Manager – Forward Deployed Engineer, Agentic AI INR 2000K-5000KAPIs | Agent memory | Asynchronous processing | Authentication | AuthorizationSenior-level Full TimeHyderabad, TS, India1d ago
-
Senior Software Engineer (Infra) INR 2400K-3500KC++ | Distributed Systems | Java | Networking | PythonSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer - Search INR 2500K-4200KInformation Retrieval | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeBengaluru, India1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Manager AI & Analytics INR 1800K-3000KAPIs | Amazon QuickSight | Artificial Intelligence | Business Intelligence | Data GovernanceMid-level Full TimeIndia Office1d ago
-
Senior BI & AI Engineer INR 3000K-4000KDAX | LLM | Langchain | Llamaindex | PandasAccess to Headspace app | Flexible vacation | Hybrid work model | Mental health days | Paid volunteer days offSenior-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
AI Architecture & Leadership Manager INR 2500K-5000KAI Governance | AI Security | AI guardrails | API Management | AWS BedrockDiversity and inclusion initiatives | Flexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India1d ago
-
Senior-level Full TimeBengaluru - GTP, India1d ago
-
AI / Generative AI Sr. Associate INR 2000K-4500KAI Governance | AI guardrails | AWS Bedrock | Agentic AI | Azure OpenAIFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India R1d ago
-
Senior-level Full TimeChennai, Tamil Nadu, India2d ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India2d ago
-
Anthropic Claude | Application Insights | Asynchronous programming | Automated testing | Azure Application InsightsFlexible working environment | Long-term engagement | Mentorship opportunities | Remote workSenior-level Contract Full TimeIndia R2d ago
-
Senior-level Full TimeHyderabad, Noida, Chennai, India2d ago
-
DATA Architect - Lead Systems Engineer INR 2771K-4132KAgile | Apache Airflow | Apache Kafka | Apache Spark | Audit LoggingSenior-level Full TimeIndia2d ago
-
Manager, Marketing Analytics and Data Science INR 900K-1000KA/B | A/B Testing | B testing | Data Governance | Data ModelingMid-level Full TimeBangalore, India2d ago
-
Lead Salesforce Full Stack AI Engineer INR 3715K-5449KAPI Design | Agile | Apex | Automated testing | Azure DevOpsFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeBangalore, India2d ago
-
AI Foundry | AWS | AWS SageMaker | Agentic AI | Amazon Bedrock401k match | Career development resources | Dental insurance | Flexible work arrangements | Health Savings Account medical planSenior-level Full TimeIndia2d ago
-
Engineer, Storage and Data Protection INR 1500K-2600KAlerting | Ansible | Automation | Backup | BashMid-level Full TimeGurugram, Haryana2d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India2d ago
-
Software Engineer - AI/ML INR 2400K-3465KDistributed Systems | Edge AI | GPU Utilization | Langchain | LanggraphAccess to cutting-edge technologies | Collaborative work environment | In office work week | Professional growth | Training and developmentEntry-level Full TimeBangalore - Karnataka, India - Kalyani …2d ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …2d ago
-
Senior-level Full TimeGurugram, India2d ago
-
Mid-level Full TimeHyderabad, India2d ago
-
AI Transformation Engineer INR 2000K-4408KAPI Integration | Agent Frameworks | Agents SDK | Automated testing | Backend DevelopmentMid-level Full TimeBengaluru, India2d ago
-
Senior Forward Deployed Engineer INR 1500K-2800KAI APIs | AWS | Apache Spark | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeBengaluru, India2d ago