AI Model Quality Engineer
Bangalore, Karnataka, India (Hybrid)
R
INR 3000K-5000K (estimate) Senior-level Full Time
Tasks
- Build automated retraining feedback loops
- Conduct red teaming and safety checks
- Create golden datasets and adversarial test sets
- Define acceptance criteria for AI ML models
- Design and execute AI ML model test strategies
- Ensure HIPAA and FDA SaMD alignment
- Implement data sanity checks
- Implement drift detection and monitoring mechanisms
- Maintain model cards data sheets and audit documentation
- Own go no go release gating for model promotion
- Participate in model risk reviews audits and governance
- Perform API contract validation for model artifacts
- Set alert thresholds and rollback runbooks
- Test GenAI hallucination and unsafe output scenarios
- Validate RAG grounding citations and confidence scoring
- Validate accuracy bias robustness stability and safety
- Validate model explainability
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | Bias and fairness | Concept drift | Concept drift detection | Continuous Monitoring | Data Drift | Data Drift Detection | Drift Detection | Drift Remediation | EHR | FHIR | GenAI | Hallucination detection | Integrated gradients | LIME | LLM Testing | Leakage detection | Machine Learning | Model Explainability | Model Monitoring | Model Risk Management | Model risk | PII Leakage | PII leakage detection | Prediction Drift | Prediction Drift Detection | Prompt evaluation | Python | Quality Engineering | RAG | Red Teaming | Retrieval-Augmented Generation | Risk Management | Rollback strategies | SHAP | Test automation
Related jobs
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R10h ago
-
Machine Learning Engineer - IV (Computer Vision) INR 1000K-1800KANN search | Airflow | Approximate Nearest Neighbor | CoreML | Data IngestionMid-level Full TimeIndia (remote) R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Data Engineer -6 Years-Remote INR 1500K-2500KA/B | A/B Testing | B testing | Data Analysis | PythonRemote workMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
Senior Software Engineer - Data Platform INR 3500K-4580KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCompany holidays | Daily meals | Dental insurance | Family planning assistance | Fitness coachingSenior-level Full TimeBengaluru, Karnataka, India R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R1d ago
-
AI-enabled | AI-enabled development | API Integration | Architecture | Data ModelingLaptop provided | Medical insurance | Mentorship | No weekend work | Remote workSenior-level Contract Full TimeDelhi R1d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Apache Spark | Azure | Cost Optimization | Data Governance | Data ModelingFully remote work setup | Professional growth opportunities | Supportive work cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer INR 3200K-5000KAPI Integration | AWS | Airflow | Azure | CI/CDMentorship | Remote workSenior-level Full TimeBangalore or Remote, KA, IN R1d ago
-
Senior AI/ ML Engineer INR 2000K-6000KArtificial Intelligence | CI/CD | Cloud Computing | Computer Vision | ContainersSenior-level Full TimeIndia - Remote R1d ago
-
Mid-level Full TimeIndia - Remote R2d ago
-
Apache Spark | Automation | Azure Data | Azure Data Services | Data GovernanceRemote workSenior-level Full TimeIndia - Remote R3d ago
-
CCaaS | CRM | CTI | Embeddings | EvaluationFully remote | Learning opportunities | Startup environmentSenior-level Full TimeHyderabad R3d ago
-
Senior DevOps Engineer - Storage Platforms | India INR 3000K-4000KAnsible | Bash | Block Storage | CI/CD | CentOSSenior-level Full TimeIndia, Bengaluru (Hybrid) R4d ago
-
AWS | Airflow | Cloud platform | Data Pipelines | Deep learningAccess to Collaboration Platforms | Access to development tools | Continuous learning environment | Equity opportunities | Medical/Dental/Vision insuranceMid-level Full TimeIndia R4d ago
-
AWS | Apache Spark | Big Data | Hadoop | JavaRemote workSenior-level Full TimeBangalore, Karnataka, India R4d ago
-
API Development | C# | CI/CD | Cloud Computing | ContainerizationCareer development | Collaborative work environment | Fully remote | Local benefits packageSenior-level Full TimeIndia R4d ago
-
Lead Software Engineer INR 2500K-5000KAWS | Asynchronous programming | Authentication | Authorization | AutogenSenior-level Full TimeRemote, India R4d ago
-
Sr. AI Engineer - 2.00 pm to 11.00 pm IST (Remote, IND) INR 3242K-4580KAWS Bedrock | Alerting | Autogen | CI/CD | Configuration ManagementCompetitive vacation and holidays | Employee networks | Paid adoption leave | Paid parental leave | Paid time offSenior-level Full TimeIND MH Remote, India R4d ago
-
Machine Learning Engineer - 5 INR 3600K-5500KAWS | Airflow | Amazon SageMaker | Argo Workflows | Azure Machine LearningSenior-level Full TimeBangalore, India R4d ago