AI Quality Automation Engineer – Assistant Vice President
Location(s): Pune, Maharashtra, India
INR 1962K-6000K (estimate) Executive-level Full Time
Tasks
- Audit data pipelines and ETL for schema compliance
- Collaborate with data science and engineering stakeholders
- Design automated testing frameworks for AI systems
- Evaluate LLM outputs for hallucinations and answer relevance
- Execute adversarial testing for prompt injection and jailbreaking
- Implement observability for AI systems
- Integrate AI quality gates into CI CD pipelines
- Monitor model drift performance and latency in production
- Validate model accuracy using automated evaluation pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon ECS | Amazon SageMaker | Autosys | Avro | Cron | Dagster | Docker | Dspy | FastAPI | Flask | Git | HDFS | Hadoop | Harness | Hive | Hugging Face | Hugging Face Transformers | Iceberg | Java | Jenkins | Kafka | Keras | MLflow | Maven | MongoDB | MySQL | NLTK | Nginx | OpenShift | Oracle | Parquet | PostgreSQL | PySpark | PyTorch | Python | RabbitMQ | Ragas | Rasa | Scikit-learn | Shell Scripting | Spacy | Sqoop | Subversion | Tekton | TensorFlow | Udeploy | Vertex AI
Education
Related jobs
-
Databricks Data Engineer - Contract-to-Hire INR 1500K-3000KAWS | Apache Spark | Azure | Data Reconciliation | Data ValidationMedical insurance | Paid time off | Professional development trainingSenior-level Full TimePune, MH, India9h ago
-
Senior Databricks Data Engineer INR 1500K-3500KAWS | CI/CD | Databricks | Delta Lake | LakehouseMedical insurance | Paid time off | Performance incentives | Professional development trainingSenior-level Full TimePune, MH, India9h ago
-
Lead AI Specialist (Finance Operations) INR 3264K-5449KAccess Control | Agent Orchestration | Audit Logging | BigQuery | Change ManagementCollaborative culture | Growth opportunities | Work-life balance programsSenior-level Full TimeMumbai, MH, India9h ago
-
Senior-level Full TimeBengaluru, Karnataka, India R9h ago
-
Applied AI ML Associate INR 1400K-2400KAutomation | Data Quality | Data analytics | Data pipeline | DatabaseMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Applied AI ML Associate INR 1400K-2400KCause analysis | Credit Risk | Credit risk modeling | Data Analysis | Data DriftMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Lead Assistant Manager INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Storage | Cloud platformSenior-level Full TimePune, Maharashtra, India10h ago
-
Data Engineer Consultant Senior INR 3000K-4000KAgile | Alerting | Auditability | Automated testing | AzureBike to work | Career mentorship | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R11h ago
-
Data Engineer Consultant Principal INR 3000K-4000KAccess Control | Agile | Audit and compliance | Auditability | Automated testingBike to work | Career progression mentorship | Educational assistance | Employee assistance programme | Employee discount schemeSenior-level Full TimeBengaluru, KA, India R11h ago
-
Senior ML Operations Engineer INR 2500K-5000KAI Governance | AWS | Automated retraining | Azure | Azure MLSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Lead Software Engineer Data Engineer INR 2500K-3500KAWS | Agile | Cloud Native | Code review | Data Performance OptimizationSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Software Development Specialist INR 940K-940KAmazon CloudWatch | Amazon DynamoDB | Amazon S3 | Amazon Web Services | Azure DevOpsMid-level Full TimeBangalore, KA, IN R13h ago
-
VP - Sr Lead Data Engineer (Snowflake) INR 4000K-6000KAgile | Data Governance | Data Modeling | Data Pipelines | Data QualityExecutive-level Full TimeMumbai, Maharashtra, India13h ago
-
Senior Manager INR 1500K-2800KAWS Glue | AWS Secrets | AWS Secrets Manager | Adaptive Query | Adaptive query executionHybrid work modeSenior-level Full TimePune, Maharashtra, India R14h ago
-
Senior Consultant - Data Engineering- INR 2000K-3500KApache Kafka | Apache Spark | Cloud Computing | Data Modeling | Data PipelinesSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Mid-level Full TimeBengaluru, Pune14h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad14h ago
-
Senior Data Engineer INR 3000K-4200KAPI Management | AWS | Application Architecture | Azure API | Azure API ManagementSenior-level Full TimeIndia14h ago
-
Senior-level Full TimeGurugram, Haryana, India14h ago
-
Senior Workflow Engineer INR 1500K-3000KAzure DevOps | BPMN 2.0 | Collibra Data Intelligence | Collibra Data Intelligence Cloud | Collibra Data QualitySenior-level Full TimeChennai, TN, India16h ago
-
Data Science Chief Expert - Finance INR 3000K-4000KAWS | Azure | Cloud platform | Cypher | Data PreprocessingExecutive-level Full TimeBangalore, IN, 56006620h ago
-
IN_Manager_Agentic + Gen AI__ AI 50_ Advisory_Hyderabad INR 1000K-2500KAgentic AI | C plus plus | C# | CI/CD | DspyFlexibility programmes | MentorshipMid-level Full TimeHyderabad - Salarpuria, India20h ago
-
IN_Sr Associate_Java Full Stack Engineer_D&A_Advisory_Bangalore INR 1200K-2500KAngular | Apache Kafka | App Service | Azure | Azure AppFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India20h ago
-
IN_Senior Associate_ Data Scientist_D&A_Advisory_Bangalore INR 3000K-4000KBig Data | Causal Inference | Data Manipulation | Data Modeling | Data VisualizationSenior-level Full TimeBengaluru Millenia, India20h ago
-
EY - GDS Consulting - AIA - AI Engineer- Senior INR 2500K-5000KAI Foundry | AI Observability | AWS Bedrock | Access Controls | Asynchronous programmingCoaching and confidence | Continuous learning | Diverse and inclusive culture | Flexible tools and supportSenior-level Full TimeChennai, TN, IN, 60003220h ago