AI Model Quality Engineer
Bangalore, Karnataka, India (Hybrid)
R
INR 3000K-5000K (estimate) Senior-level Full Time
Tasks
- Build automated retraining feedback loops
- Conduct red teaming and safety checks
- Create golden datasets and adversarial test sets
- Define acceptance criteria for AI ML models
- Design and execute AI ML model test strategies
- Ensure HIPAA and FDA SaMD alignment
- Implement data sanity checks
- Implement drift detection and monitoring mechanisms
- Maintain model cards data sheets and audit documentation
- Own go no go release gating for model promotion
- Participate in model risk reviews audits and governance
- Perform API contract validation for model artifacts
- Set alert thresholds and rollback runbooks
- Test GenAI hallucination and unsafe output scenarios
- Validate RAG grounding citations and confidence scoring
- Validate accuracy bias robustness stability and safety
- Validate model explainability
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | Bias and fairness | Concept drift | Concept drift detection | Continuous Monitoring | Data Drift | Data Drift Detection | Drift Detection | Drift Remediation | EHR | FHIR | GenAI | Hallucination detection | Integrated gradients | LIME | LLM Testing | Leakage detection | Machine Learning | Model Explainability | Model Monitoring | Model Risk Management | Model risk | PII Leakage | PII leakage detection | Prediction Drift | Prediction Drift Detection | Prompt evaluation | Python | Quality Engineering | RAG | Red Teaming | Retrieval-Augmented Generation | Risk Management | Rollback strategies | SHAP | Test automation
Related jobs
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R2h ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R18h ago
-
Mid-level Full TimeBangalore, Karnataka, India R19h ago
-
Senior Software Engineer - Data Platform INR 3500K-4580KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCompany holidays | Daily meals | Dental insurance | Family planning assistance | Fitness coachingSenior-level Full TimeBengaluru, Karnataka, India R21h ago
-
Mid-level Full TimeBangalore, Karnataka, India R21h ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R22h ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R23h ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Apache Spark | Azure | Cost Optimization | Data Governance | Data ModelingFully remote work setup | Professional growth opportunities | Supportive work cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer INR 3200K-5000KAPI Integration | AWS | Airflow | Azure | CI/CDMentorship | Remote workSenior-level Full TimeBangalore or Remote, KA, IN R1d ago
-
Mid-level Full TimeIndia - Remote R2d ago
-
Apache Spark | Automation | Azure Data | Azure Data Services | Data GovernanceRemote workSenior-level Full TimeIndia - Remote R3d ago
-
CCaaS | CRM | CTI | Embeddings | EvaluationFully remote | Learning opportunities | Startup environmentSenior-level Full TimeHyderabad R3d ago
-
Senior DevOps Engineer - Storage Platforms | India INR 3000K-4000KAnsible | Bash | Block Storage | CI/CD | CentOSSenior-level Full TimeIndia, Bengaluru (Hybrid) R3d ago
-
AWS | Airflow | Cloud platform | Data Pipelines | Deep learningAccess to Collaboration Platforms | Access to development tools | Continuous learning environment | Equity opportunities | Medical/Dental/Vision insuranceMid-level Full TimeIndia R3d ago
-
AWS | Apache Spark | Big Data | Hadoop | JavaRemote workSenior-level Full TimeBangalore, Karnataka, India R3d ago
-
API Development | C# | CI/CD | Cloud Computing | ContainerizationCareer development | Collaborative work environment | Fully remote | Local benefits packageSenior-level Full TimeIndia R4d ago
-
Lead Software Engineer INR 2500K-5000KAWS | Asynchronous programming | Authentication | Authorization | AutogenSenior-level Full TimeRemote, India R4d ago
-
Sr. AI Engineer - 2.00 pm to 11.00 pm IST (Remote, IND) INR 3242K-4580KAWS Bedrock | Alerting | Autogen | CI/CD | Configuration ManagementCompetitive vacation and holidays | Employee networks | Paid adoption leave | Paid parental leave | Paid time offSenior-level Full TimeIND MH Remote, India R4d ago
-
Machine Learning Engineer - 5 INR 3600K-5500KAWS | Airflow | Amazon SageMaker | Argo Workflows | Azure Machine LearningSenior-level Full TimeBangalore, India R4d ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2500KAWS Glue | Amazon Athena | Amazon EMR | Amazon S3 | Apache AirflowWork from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R4d ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R4d ago
-
Senior-level Full TimeAhmedabad, Gujarat, India R4d ago
-
Apache Hadoop | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataImmediate joinerMid-level Full TimeHyderabad, Telangana, India - Remote R5d ago
-
Agentic Outcome Engineer INR 1900K-4580KAdobe Experience | Adobe Experience Manager | Angular | Artificial Intelligence | CSSSenior-level Full TimeNoida, India R5d ago