EY - GDS Consulting - AIA - Gen AI - Senior
INR 3799K-5000K (estimate) Senior-level Full Time
Tasks
- Assess AI solutions for bias hallucinations toxicity and safety risks
- Build evaluation frameworks for RAG systems retrieval pipelines and vector search
- Create quality dashboards metrics and defect reporting processes
- Design testing strategies for AI and Generative AI
- Develop AI test frameworks and automation suites
- Develop Python test frameworks for AI workflows and APIs
- Execute functional integration regression performance and scalability testing
- Improve operational reliability through quality governance and reusable testing assets
- Measure RAG retrieval quality and answer faithfulness using evaluation frameworks
- Perform AI security testing including prompt injection and jailbreak testing
- Validate AI integrations across APIs databases and cloud platforms
- Validate LLM outputs for accuracy consistency relevance safety and compliance
- Validate prompt engineering and agent workflows in Agentic AI
Perks/Benefits
- N/A
Skills/Tech-stack
AI Governance | AI Platform | AI Services | Adversarial Testing | Agentic AI | Azure AI | Azure AI Platform | Azure AI Services | Bias Evaluation | CI/CD | Embeddings | FastAPI | Functional testing | Generative AI | Hallucination detection | Injection testing | Integration Testing | Jailbreak testing | Language Models | Large Language Models | Penetration Testing | Performance Testing | Prompt Injection Testing | Prompt injection | Python | RAG | REST APIs | Ragas | Regression testing | Reliability testing | Responsible AI | Retrieval Pipelines | Scalability testing | Security Testing | Test automation | Vector Databases | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
AI | AI QA | AI QA Engineer | Engineer | QA Engineer | Quality Assurance | Quality Assurance Engineer
Related jobs
-
Sr SDE (Java + AI) INR 3000K-5000KAI orchestration | AWS | Alerting | Automated testing | AzureDesign review leadership | MentorshipSenior-level Full TimePune City, India4h ago
-
AI Developer & Automation Tester – Document Intelligence INR 2000K-4200KGxP | IQ/OQ | IQ/OQ/PQ | LLM | LangchainSenior-level Full TimeIN-TN-Chennai4h ago
-
Embedded Software Development Engineer (8-10 Years) INR 3200K-4110KAUTOSAR | Agile | Assembly | Automated testing | Automotive SPICESenior-level Full TimeBengaluru, India10h ago
-
Data Scientist - GenAi-AgenticAi INR 2500K-5000KAI orchestration | AWS | Agentic AI | Crew AI | Data MiningSenior-level Full TimeIndia11h ago
-
Senior-level Full TimeMumbai, MH, IN, 40007215h ago
-
Senior AI Engineer – Data Science & Generative AI INR 2000K-5000KAPI Development | AWS | Agentic AI | Asynchronous programming | AutogenSenior-level Full TimeBengaluru, KA, IN15h ago
-
Lab and Center Data Engineer INR 938K-1408KAnsible | Bash | Enterprise Linux | Infrastructure as Code | KVMMid-level Full TimePune, Maharashtra, India22h ago
-
Lead Data Engineer INR 1500K-2500KApache Airflow | Apache Kafka | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia23h ago
-
Senior-level Full TimeHyderabad, IND-TG, India1d ago
-
Planview Administration 169576 INR 1500K-2500KData Governance | Data Modeling | Data Pipelines | Data Validation | ELTSenior-level Full TimeHyderabad, IND-TG, India1d ago
-
Senior-level Full TimeChennai, Tamil Nādu, India1d ago
-
AI / ML Developer / Engineer INR 2000K-3000KAI Agent | AI agent orchestration | Agent Orchestration | Artifact Registry | Backup and Disaster RecoveryMid-level Full TimeIndia1d ago
-
GCP Backend Developer / Engineer INR 3000K-5000KAgile | BigQuery | CI/CD | Cloud Functions | Cloud RunSenior-level Full TimeIndia1d ago
-
Software Engineer II INR 2771K-4000KAlgorithms | Amazon Web Services | Cloud platform | Data Structures | Distributed SystemsComprehensive health and wellbeing support | Learning and development opportunitiesEntry-level Full TimeGurugram, HR, India1d ago
-
Sr.DataOPS Developer INR 2000K-3000KAWS Greengrass | Airflow | Apache Flink | Apache Kafka | Apache Kafka StreamsSenior-level Full TimeBangalore, India1d ago
-
AI Engineer - India INR 1800K-3000KAzure APIM | Cloud platform | Cypher | Embeddings | FastAPICareer pathing | Flexi benefit plan | Focus time Fridays | Food at work | Group medical coverageMid-level Full TimeChennai R1d ago
-
Data Scientist - GenAi/Agentic-Ai INR 2000K-5000KAI orchestration | AWS | Advanced Analytics | Crew AI | Data MiningMentoring program | Training and coachingSenior-level Full TimeIndia1d ago
-
DevOps Track Sr.Engineer INR 3000K-4200KAccess Control | Access Control Lists | Azure | Azure Dashboards | Azure DataSenior-level Full TimeIndia1d ago
-
Data Scientist INR 3000K-5000KAWS | Airflow | Amazon SageMaker | Apache Spark | Azure Machine LearningSenior-level Full TimeIN-MH-Pune1d ago
-
Net Core Azure Cosmos DB Gen AI INR 1800K-3300K.NET | API Management | ASP.Net Core | App Service | Application InsightsMid-level Full TimeIN-KA-Bangalore1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior Developer INR 2000K-5000KA/B | A/B Testing | API Development | Asynchronous programming | B testingSenior-level Full TimeIN-MH-Pune1d ago
-
Data Platform Engineer- Azure Databricks INR 2000K-3900KAccess Management | Ansible | Apache Ranger | Azure Data | Azure Data LakeSenior-level Full TimeNoida, Uttar Pradesh, UTTAR PRADESH, India1d ago
-
Senior Applied AI/ML Engineer INR 3500K-5000KAgentic Systems | Autonomous Agents | Bias Mitigation | Data Analysis | Deep learningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Forward Deployed Engineer, Google Cloud Business Platform INR 2500K-5000KArtificial Intelligence | Content Security | Content Security Policy | Data Storage | Distributed ComputingSenior-level Full TimeBengaluru, Karnataka, India1d ago