EY - GDS Consulting - AIA - Gen AI - Senior
Mumbai, MH, IN, 400072
INR 3799K-5000K (estimate) Senior-level Full Time
Tasks
- Assess AI solutions for bias hallucinations toxicity and safety risks
- Build evaluation frameworks for RAG systems retrieval pipelines and vector search
- Create quality dashboards metrics and defect reporting processes
- Design testing strategies for AI and Generative AI
- Develop AI test frameworks and automation suites
- Develop Python test frameworks for AI workflows and APIs
- Execute functional integration regression performance and scalability testing
- Improve operational reliability through quality governance and reusable testing assets
- Measure RAG retrieval quality and answer faithfulness using evaluation frameworks
- Perform AI security testing including prompt injection and jailbreak testing
- Validate AI integrations across APIs databases and cloud platforms
- Validate LLM outputs for accuracy consistency relevance safety and compliance
- Validate prompt engineering and agent workflows in Agentic AI
Perks/Benefits
- N/A
Skills/Tech-stack
AI Governance | AI Platform | AI Services | Adversarial Testing | Agentic AI | Azure AI | Azure AI Platform | Azure AI Services | Bias Evaluation | CI/CD | Embeddings | FastAPI | Functional testing | Generative AI | Hallucination detection | Injection testing | Integration Testing | Jailbreak testing | Language Models | Large Language Models | Penetration Testing | Performance Testing | Prompt Injection Testing | Prompt injection | Python | RAG | REST APIs | Ragas | Regression testing | Reliability testing | Responsible AI | Retrieval Pipelines | Scalability testing | Security Testing | Test automation | Vector Databases | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
AI | AI QA | AI QA Engineer | Engineer | QA Engineer | Quality Assurance | Quality Assurance Engineer
Related jobs
-
Associate Director-HR AI Solutions Architect INR 1200K-2100KAPIs | Agentic Systems | Artificial Intelligence | Automation | Azure OpenAIEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeMumbai, MH, India1d ago
-
Senior GIS Enginer INR 900K-2500KAPI Integration | ArcGIS | Coordinate systems | Data Transformation | Data cleaningSenior-level Full TimeHyderabad, TS, IN / Hyderabad, Telangana, …1d ago
-
Test Lead - Data Automation INR 1500K-2500KCase design | ETL | Manual Testing | Python | Regression testingSenior-level Full TimeIndia1d ago
-
Staff Engineer (Snowflake, Apache Kafka, Oracle, AWS Lambda) INR 1500K-2500KAWS EC2 | AWS IAM | AWS Lambda | AWS VPC | Access ManagementSenior-level Full TimeGurugram, India1d ago
-
Staff Engineer (Datadog Engineer) INR 2000K-4000KAmazon Web Services | Application Performance Monitoring | Application performance | Automation | Azure DevOpsSenior-level Full TimeHyderabad, India1d ago
-
Staff Engineer (AI Security and DevSecOps ) INR 2500K-5000KAI RMF | AWS | AWS Secrets | AWS Secrets Manager | Abuse detectionSenior-level Full TimeHyderabad, India1d ago
-
Senior Software Engineer (Universal Robots, Bangalore - India) INR 2475K-3500KAgile | C++ | CI/CD | Clean Code | Code reviewExposure to Cutting Edge Robotics Technology | Flexible working conditions | Health insurance | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeBangalore, IN1d ago
-
Senior Software Engineer, Machine Learning INR 3264K-5400KA/B | A/B Testing | Aerospike | B testing | Bayesian analysisCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Flexible remote workSenior-level Full TimeBengaluru, India1d ago
-
Senior Cloud Storage Engineer – NetApp CVO on GCP, AVP INR 2755K-3500KAutomation | CI/CD | Cloud Security | Cloud platform | Cloud volumes ONTAPAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Gender neutral parental leaveSenior-level Full TimePune - Business Bay, India1d ago
-
Senior Software Engineer INR 2000K-2700KAgile | Cloud services | Code review | Data Modeling | Data WarehousingSenior-level Full TimePune, India2d ago
-
Artificial intelligence Developer (Pro Code) INR 2500K-4680KAI Foundry | APIs | Asynchronous processing | Autogen | Azure AISenior-level Full TimeThane, Maharashtra, India2d ago
-
Senior Data Engineer INR 3000K-4000KApache Spark | Batch Processing | DAX | Data Ingestion | Data ModelingFinancial consultations | Language courses | Legal consultations | Medical insurance | Mental health supportSenior-level Full TimeIndia2d ago
-
Manager Data and Analytics INR 1400K-2000KAmazon Redshift | Azure | BigQuery | Business Intelligence | Cloud platformMid-level Full TimeBangalore, Karnataka, India R2d ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-5000KAPI Integration | AWS SageMaker | Agent systems | Azure ML | CCPACompany paid medical insurance | Company-paid certifications | Financial and legal consultations | Internal workshops and meetups | Language coursesSenior-level Full TimeIndia2d ago
-
Senior Manager INR 2000K-5000KAI Agents | Cloud Native | Cloud Native Architecture | Document Question Answering | EmbeddingsSenior-level Full TimeGurugram, Haryana, India2d ago
-
Senior-level Full TimeChandigarh, India2d ago
-
Senior AI Engineer INR 3242K-4680KAWS EC2 | AWS ECS | AWS Lambda | AWS RDS | Amazon S3Financial consultation | Legal consultation | Medical insurance | Mental health support | Paid certificationsSenior-level Full TimeIndia2d ago
-
Lead Data Engineer INR 2771K-4064KAWS | Cloud Computing | Data Governance | Data Processing | Data StreamingSenior-level Full TimeBengaluru, Karnataka, India2d ago
-
Associate Engineer - AI/ML with Python INR 2500K-4000KAWS | Bitbucket | CI/CD | CSS | CeleryCollaborative work environment | Onsite work 5 days a week | Training and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …2d ago
-
Data Scientist – AI & Cybersecurity INR 2500K-4500KAPIs | AWS | Adversarial Testing | Amazon SageMaker | Anomaly DetectionGrowth opportunities | Mentorship programs | Training opportunitiesSenior-level Full TimeBangalore - Karnataka - India2d ago
-
Senior Python GenAI Engineer INR 2000K-4580KAWS | Angular | Anthropic | Azure | Azure OpenAIEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India2d ago
-
Senior Machine Learning (ML) Ops Engineer INR 3715K-5449KAWS | Airflow | Amazon SageMaker | Azure | CI/CDEquity compensation | Fully remote | Global & diverse team | Innovation culture | Part-timeSenior-level Full TimeMumbai, Maharashtra, India R2d ago
-
Senior Java Kafka Architect INR 2000K-2700KAmazon Web Services | Apache Kafka | CI/CD | Code Refactoring | Code reviewSenior-level Full TimeIN-AP-Hyderabad2d ago
-
Data Engineer INR 2000K-3000KAPI Design | Asynchronous programming | Caching | Celery | Clean architectureSenior-level Full TimeIN-KA-Bangalore2d ago
-
Azure Data Engineer INR 1500K-2500KApache Spark | Azure Data | Azure Data Lake | Azure Databricks | Data GovernanceMid-level Full TimeIN-KA-Bangalore2d ago