AI Model Quality Engineer
Bangalore, Karnataka, India (Hybrid)
R
INR 3000K-5000K (estimate) Senior-level Full Time
Tasks
- Build automated retraining feedback loops
- Conduct red teaming and safety checks
- Create golden datasets and adversarial test sets
- Define acceptance criteria for AI ML models
- Design and execute AI ML model test strategies
- Ensure HIPAA and FDA SaMD alignment
- Implement data sanity checks
- Implement drift detection and monitoring mechanisms
- Maintain model cards data sheets and audit documentation
- Own go no go release gating for model promotion
- Participate in model risk reviews audits and governance
- Perform API contract validation for model artifacts
- Set alert thresholds and rollback runbooks
- Test GenAI hallucination and unsafe output scenarios
- Validate RAG grounding citations and confidence scoring
- Validate accuracy bias robustness stability and safety
- Validate model explainability
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | Bias and fairness | Concept drift | Concept drift detection | Continuous Monitoring | Data Drift | Data Drift Detection | Drift Detection | Drift Remediation | EHR | FHIR | GenAI | Hallucination detection | Integrated gradients | LIME | LLM Testing | Leakage detection | Machine Learning | Model Explainability | Model Monitoring | Model Risk Management | Model risk | PII Leakage | PII leakage detection | Prediction Drift | Prediction Drift Detection | Prompt evaluation | Python | Quality Engineering | RAG | Red Teaming | Retrieval-Augmented Generation | Risk Management | Rollback strategies | SHAP | Test automation
Related jobs
-
AI Agents | AI Governance | API Security | Auditability | Cloud SecurityHybrid work | Onsite supportMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
AI/ML Engineering Manager INR 1900K-2800KAWS CDK | AWS Lambda | AWS SageMaker | Amazon ECS | Amazon EKSAccess to Headspace app | Flexible vacation | Hybrid work model | Mental health days | Mental physical and financial wellbeing resourcesMid-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
Senior AI Engineer (m/f/d) INR 3242K-5000KAPIs | AWS | Agents | Angular | AzureHome office setup budget | Learning and development budget | Relocation support | Visa support | Work from homeSenior-level Full TimeRemote EMEA, Remote India R1d ago
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R2d ago
-
API | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid workSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
API | Agile | Apache Hadoop | Apache Kafka | Apache SparkHybrid work | Technical research opportunities | Training supportSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid work | Training opportunitiesSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Senior-level Full TimePune, MH, IN R2d ago
-
AWS | Ansible | As-a-Service | Azure | BIOSSenior-level Contract Full TimeIndia - Remote R2d ago
-
Data Science & Engineering Lead INR 3000K-4500KAPI Gateway | AWS Glue | AWS Lambda | Airbyte | Amazon EC2Senior-level Full TimeIndia - Remote R2d ago
-
AI Agents | AI Data | AI data governance | API Security | Cloud SecurityMid-level Full TimeBengaluru, Karnataka, India R2d ago
-
AWS | AWS Glue | Agile | Amazon S3 | CI/CDSenior-level Full TimeHyderabad, Telangana, India - Remote R2d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KConvolutional Neural Networks | Data Mining | Data Preprocessing | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangements | Health and wellbeing benefits | Hybrid work schedule | Inclusion initiativesSenior-level Full TimeBengaluru, Karnātaka, India R2d ago
-
A/B | A/B Testing | AWS | Apache Spark | AzureFlexibility programmes | Hybrid work | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India R2d ago
-
A/B | A/B Testing | AIOps | AWS | Artificial IntelligenceFlexibility programmes | Hybrid work environment | MentorshipSenior-level Full TimeBengaluru Millenia, India R2d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KConvolutional Neural Networks | Data Mining | Data Modeling | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangement | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India R2d ago
-
Senior AI Engineer INR 2500K-5000KAPI Management | AWS | Agile | Application Programming | Application Programming InterfacesSenior-level Full TimeKolkata, West Bengal, India R2d ago
-
Client Partner - Head of AI Foundations for GCP INR 3000K-5000KBias monitoring | BigQuery | Cloud Storage | Cloud platform | Compute EngineClient travel 5 to 10 percent | Flexible work hours | Hybrid workSenior-level Full TimeBengaluru, India R2d ago
-
Developer, Java,Spark and GCP INR 2771K-4064KApache Hadoop | Apache Spark | Cloud platform | GCP | Google CloudHybrid work | Work-life flexibilitySenior-level Full TimeChennai, India R2d ago
-
Staff Software Engineer, AI/ML INR 2500K-5000KAgent systems | Autogen | Cloud Platforms | CrewAI | EmbeddingsRemote work | Vacation packageSenior-level Full TimeBangalore, India R2d ago
-
Staff Enterprise AI Engineer - Agentic Workflows & Productivity INR 2500K-5000KAI Governance | API Integration | CI/CD | Compliance | ConfluenceHybrid work model | Mentorship | Training supportSenior-level Full TimeBangalore, India R2d ago
-
Senior Salesforce Data Engineer INR 1800K-3500KAPEX Collections | Agile Scrum | Apex | BigQuery | Bulk APISenior-level Full TimeIN Bangalore Virtual, India R2d ago
-
Sr Engineer, Data Engineering INR 2040K-3900KAlloyDB | Apache Spark | Asset Inventory | Audit Logging | BigLakeHybrid work | In person collaboration time | Work from home flexibility | Work-life flexibilitySenior-level Full TimeBengaluru, India R2d ago
-
Process Data Engineer I - Pharmaceutical Product Development INR 1000K-1986KAPI Integration | AWS | Agile | CI/CD | DBTMid-level Full TimeHyderabad, India R2d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KBest practices | Convolutional Neural Networks | Data Mining | Data Modeling | Data VisualizationCareer Development Programs | Flexible work-life balance | Health and wellbeing benefits | Hybrid work scheduleSenior-level Full TimeBengaluru, Karnātaka, India R2d ago