EY - GDS Consulting - AIA - Gen AI - Senior
INR 3799K-5000K (estimate) Senior-level Full Time
Tasks
- Assess AI solutions for bias hallucinations toxicity and safety risks
- Build evaluation frameworks for RAG systems retrieval pipelines and vector search
- Create quality dashboards metrics and defect reporting processes
- Design testing strategies for AI and Generative AI
- Develop AI test frameworks and automation suites
- Develop Python test frameworks for AI workflows and APIs
- Execute functional integration regression performance and scalability testing
- Improve operational reliability through quality governance and reusable testing assets
- Measure RAG retrieval quality and answer faithfulness using evaluation frameworks
- Perform AI security testing including prompt injection and jailbreak testing
- Validate AI integrations across APIs databases and cloud platforms
- Validate LLM outputs for accuracy consistency relevance safety and compliance
- Validate prompt engineering and agent workflows in Agentic AI
Perks/Benefits
- N/A
Skills/Tech-stack
AI Governance | AI Platform | AI Services | Adversarial Testing | Agentic AI | Azure AI | Azure AI Platform | Azure AI Services | Bias Evaluation | CI/CD | Embeddings | FastAPI | Functional testing | Generative AI | Hallucination detection | Injection testing | Integration Testing | Jailbreak testing | Language Models | Large Language Models | Penetration Testing | Performance Testing | Prompt Injection Testing | Prompt injection | Python | RAG | REST APIs | Ragas | Regression testing | Reliability testing | Responsible AI | Retrieval Pipelines | Scalability testing | Security Testing | Test automation | Vector Databases | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
AI | AI QA | AI QA Engineer | Engineer | QA Engineer | Quality Assurance | Quality Assurance Engineer
Related jobs
-
Staff Software Engineer, Geo, Agentic AI Engineering INR 2000K-3300KData Structures | Data Structures and Algorithms | Generative AI | Language Models | Large Language ModelsSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Software Engineer (Infra) INR 2400K-3500KC++ | Distributed Systems | Java | Networking | PythonSenior-level Full TimeBengaluru, India17h ago
-
Senior Software Engineer - Search INR 2500K-4200KInformation Retrieval | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeBengaluru, India17h ago
-
Senior Software Engineer - Data Platform INR 2500K-3584KAWS | Agentic AI | Apache Airflow | Apache Druid | Apache FlinkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India R18h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India19h ago
-
Tech Lead Software Engineer – AI Ops/Support INR 2500K-4500KAIOps | API Gateway | AWS | Amazon Bedrock | Amazon SageMakerSenior-level Full TimeIndia Office22h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India1d ago
-
Anthropic Claude | Application Insights | Asynchronous programming | Automated testing | Azure Application InsightsFlexible working environment | Long-term engagement | Mentorship opportunities | Remote workSenior-level Contract Full TimeIndia R1d ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE)1d ago
-
Senior-level Full TimeHyderabad, Noida, Chennai, India1d ago
-
DATA Architect - Lead Systems Engineer INR 2771K-4132KAgile | Apache Airflow | Apache Kafka | Apache Spark | Audit LoggingSenior-level Full TimeIndia1d ago
-
Lead Salesforce Full Stack AI Engineer INR 3715K-5449KAPI Design | Agile | Apex | Automated testing | Azure DevOpsFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeBangalore, India1d ago
-
AI Foundry | AWS | AWS SageMaker | Agentic AI | Amazon Bedrock401k match | Career development resources | Dental insurance | Flexible work arrangements | Health Savings Account medical planSenior-level Full TimeIndia1d ago
-
Engineer, Storage and Data Protection INR 1500K-2600KAlerting | Ansible | Automation | Backup | BashMid-level Full TimeGurugram, Haryana1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India1d ago
-
Software Engineer - AI/ML INR 2400K-3465KDistributed Systems | Edge AI | GPU Utilization | Langchain | LanggraphAccess to cutting-edge technologies | Collaborative work environment | In office work week | Professional growth | Training and developmentEntry-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Senior-level Full TimeGurugram, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
AI Transformation Engineer INR 2000K-4408KAPI Integration | Agent Frameworks | Agents SDK | Automated testing | Backend DevelopmentMid-level Full TimeBengaluru, India1d ago
-
Senior Forward Deployed Engineer INR 1500K-2800KAI APIs | AWS | Apache Spark | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer, AI/ML INR 2000K-5000K3D mathematics | Agent systems | Autonomous Agents | C plus plus | Computational GeometrySenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer (GCP, Azure) INR 1500K-2500KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Data PipelinesSenior-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago