Senior Lead Quality Engineer (Gen AI)
Bangalore, India
R
INR 2475K-4500K (estimate) Senior-level Full Time
Tasks
- Build AI scoring rubrics and dashboards
- Build AI specific KPIs
- Conduct rate limiting abuse testing
- Create benchmark datasets
- Define AI quality engineering strategy
- Define latency benchmarks and SLAs
- Design prompt engineering strategies
- Design quality gates and release readiness
- Enable continuous AI quality monitoring
- Enforce role-based access control
- Ensure PII protection
- Ensure backward compatibility
- Establish AI quality standards
- Evaluate agent workflows
- Implement human in the loop evaluation
- Integrate AI validation into CI CD pipelines
- Lead AI risk assessment
- Monitor token usage and cost efficiency
- Perform API security validation
- Perform scalability and concurrency testing
- Test OAuth authentication flows
- Test data isolation
- Validate RAG pipelines
- Validate WCAG accessibility compliance
- Validate fine tuned models
Perks/Benefits
- N/A
Skills/Tech-stack
API Security | API Testing | API security testing | AWS | Access Control | Agent workflows | CI/CD | GenAI testing | LLM Evaluation | OAuth | PII protection | Prompt engineering | Quality Engineering | RAG | Rate Limiting | Release governance | Role-Based Access | Role-Based Access Control | Security Testing | Test automation | WCAG
Education
N/A
Roles
Engineer | Lead | Lead Quality Engineer | Quality Engineer | Senior Quality Engineer
Related jobs
-
Sub Value Stream Technology Delivery Lead/Sr. Associate Director, Data and Analytics INR 1400K-2100KAgile | CI/CD | Cloud Native | Cloud platform | ComplianceMid-level Full TimePune, Maharashtra, India R1d ago
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Azure | CassandraBootcamp training | Broadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certificationsSenior-level Full TimeIndia - Remote R1d ago
-
Computer Scientist - I ( Backend Heavy - Full Stack ) INR 1000K-2300KAngular | Automation Testing | CI/CD | CSS | CloudMid-level Full TimeBangalore, India R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Senior-level Full TimeIndia, Bengaluru (Hybrid) R2d ago
-
Senior Staff Engineer, Gen AI with Java INR 2000K-4000KAI language | Agent Orchestration | Algorithms | Azure AI | Azure AI LanguageSenior-level Full TimeRemote, India R2d ago
-
Software Engineer (Backend Developer) INR 1500K-3500KAWS | Active Directory | Agile | Algorithms | Data StructuresMid-level Full TimeBangalore, India Office (BANGALORE) R2d ago
-
Agentic Engineer INR 2000K-2525KAPI Integration | Authentication | Debugging | Error Handling | IdempotencyMid-level Full TimeRemote - India R2d ago
-
Agentic Solution Engineer INR 2000K-3500KAPI Integration | Authentication | Data Mapping | Error Handling | Fault ToleranceSenior-level Full TimeRemote - India R2d ago
-
Principal Software Engineer - AI INR 2475K-3500KAgentic AI | Autogen | Continuous Delivery | Distributed Systems | GraphRAGSenior-level Full TimeBangalore - Carina, India R2d ago
-
Mid-level Full TimeIND GBS Bangalore - Office, India R2d ago
-
Automation and AI Solutions Lead INR 2475K-3465KAWS | AWS AgentCore | Agent systems | Amazon Bedrock | AsyncAccess to Headspace | Flexible work-life balance | Hybrid work model | Mental health days | Retirement savingsSenior-level Full TimeIndia, Hyderabad, Telangana R2d ago
-
Associate Director (MEAN/MERN Stack + GenAI) INR 1800K-2650KAPI Design | Agile | CI/CD | Cloud infrastructure | CrewAICompetitive benefits | Hybrid work | Professional developmentMid-level Full TimeGurugram - DLF Building, India R2d ago
-
Mid-level Full TimeBangalore, India R2d ago
-
DevOps Engineer II INR 2500K-3500KAnsible | ArgoCD | Bash | CI/CD | Cloud MonitoringDevelopment reimbursements | Employee referral program | Flexible working hours | Hybrid remote work | Life and accidental insuranceSenior-level Full TimeIndia - Remote R2d ago
-
AI Security Engineer INR 2000K-3500KAI Foundry | API Security | Access Management | Application Security | AzureGenerous annual leave policy | Medical insurance | Remote work flexibilitySenior-level Full TimeMumbai, MH, India R2d ago
-
Assistant Director,Collections Analytics Lead INR 2040K-2755KAWS | Alteryx | Audit compliance | Azure | BigQuerySenior-level Full TimeKolkata, West Bengal, India R3d ago
-
Senior Data Engineer INR 2520K-3500KAWS | Airflow | Azure | Cassandra | DBTBonuses for performance | Broadband reimbursement | Medical insurance for parents | Medical insurance for self and family | Paid certificationsSenior-level Full TimeIndia - Remote R3d ago
-
Senior-level Full TimeIndia, Bengaluru (Hybrid) R3d ago
-
Junior GenAI Developer INR 300K-350KAWS | Amazon Bedrock | Anthropic API | Chroma | EmbeddingsCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities, India R3d ago
-
Junior GenAI Developer INR 300K-350KAWS | Agentic Workflows | Amazon Bedrock | Anthropic | ChromaHealth insurance | Language courses | Mentorship | Professional development | Relocation programEntry-level Full TimeAll Cities, India R3d ago
-
Data Delivery lead/ Associate Director, Data and Analytics INR 700K-1200KAgentic AI | Agile | Apache Airflow | Apache Kafka | Apache NiFiMid-level Full TimeHyderabad, Telangana, India R3d ago
-
AI Engineer (Full Stack Development) INR 1800K-3000KAPI Integration | AWS | Anthropic | Authentication | Cloud FunctionsMid-level Full TimeMumbai, Maharashtra, India - Remote R3d ago
-
Entry-level Full TimeBangalore, India R3d ago
-
AWS | Alerting | Ansible | Apache HTTP | Apache HTTP ServerCareer development | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeSenior-level Full TimeIndia-Bangalore-Remote R3d ago