Associate Lead - Testing (QA + MLOps)
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Assess bias and fairness
- Build reusable evaluation harnesses
- Create AI test automation frameworks
- Define AI ML testing strategy
- Design validation frameworks
- Detect data drift and concept drift
- Drive QA transformation programs
- Establish AI quality scorecards
- Generate synthetic data strategies
- Implement CI/CD quality gates
- Lead AI ML quality strategy workshops
- Mentor QA teams
- Own AI testing delivery end to end
- Perform AI risk and readiness assessments
- Perform safety and toxicity testing
- Present quality architecture to CXOs
- Test LLM based applications
- Test LLM hallucinations
- Test chatbot and voice bot conversations
- Test multi agent orchestration
- Test prompt robustness
- Validate API contract for LLM integrations
- Validate RAG retrieval accuracy
- Validate blue green releases
- Validate canary releases
- Validate conversation drift and fallback
- Validate deployment
- Validate end to end ML lifecycle
- Validate intent classification
- Validate model training and hyperparameter tuning
- Validate model versioning and registry
- Validate prompt engineering
Perks/Benefits
- N/A
Skills/Tech-stack
AI Quality Scorecard | AI quality | API Gateway | API Testing | AWS DevOps | AWS Glue | AWS Lambda | Amazon API | Amazon API Gateway | Amazon Bedrock | Amazon CloudWatch | Amazon Feature Store | Amazon IAM | Amazon Kinesis | Amazon Model Monitor | Amazon S3 | Amazon SageMaker | Amazon SageMaker Pipelines | Automation Testing | BLEU | Bias and fairness | Blue-Green Deployment | Blue/green | CI/CD | Canary Release | CloudFormation | CodeBuild | CodePipeline | Concept drift | Data Drift | Data Generation | Embedding similarity | Feature Store | Git | Infrastructure as Code | LLM | Langchain | Machine Learning | Observability | Prompt engineering | PyTorch | Python | RAG | ROUGE | Safety testing | Sagemaker Pipelines | Scikit-learn | Synthetic Data Generation | Synthetic data | TensorFlow | Terraform | Toxicity Testing | “as-code”
Education
N/A
Related jobs
-
Senior Data Engineer (Databricks) INR 1200K-2000KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS VPCSenior-level Full TimeMaharashtra, Pune, India4h ago
-
Mid-level Full TimeIndia-Bangalore5h ago
-
Manager, ML CV Ops Engineer INR 1000K-1400KAWS | Airflow | ArgoCD | Azure | CI/CDCareer growth | Mentorship | TrainingMid-level Full TimeIndia-Bangalore5h ago
-
Business Analyst - ML Engineer INR 2000K-2500KARIMA | Docker | Embeddings | Experimentation | FastAPIEntry-level Full TimeIndia-Gurugram5h ago
-
Software Engineer II - Python, Kubernetes, GenAI/ML INR 1000K-2000KAgile | Application Resiliency | CI/CD | Debugging | Development Life CycleMid-level Full TimeBengaluru, Karnataka, India5h ago
-
GEN AI Developer INR 3334K-5000KAI Services | AWS AI | AWS AI Services | AWS Machine Learning | Agentic AISenior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-KA-Bangalore5h ago
-
Mid-level Full TimeIN-KA-Bangalore5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Software Engineer III - Databricks, SQL , Python INR 2500K-3900KApache Spark | Data Lake | Data Warehouse | Databricks | ETLSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Senior Lead Software Engineer - DataBricks, SQL INR 2000K-3300KAWS | Apache Spark | Data Lake | Data Warehouse | DatabricksSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Tech Lead/Senior Tech Lead - Embedded Software Development INR 1170K-2156KARM | C# | C++ | CAN | Code AnalysisSenior-level Full TimePUNE, MAHARASHTRA, India7h ago
-
Technical Solutions Engineer, AI/ML INR 1800K-2500KAI/ML Platform | Algorithms | Artificial Intelligence | BigQuery | Cloud Compute EngineMid-level Full TimePune, Maharashtra, India; Bengaluru, Karnataka, India7h ago
-
(#1316 )- Python and Machine Learning Engineer INR 1800K-2500KClustering | Deep learning | Django | Flask | GitContinuous learningMid-level Full TimeAndhra Pradesh, Visakhapatnam, India7h ago
-
Senior Software Engineer, AI/ML, AI Garage INR 2500K-4725KApache Beam | BigQuery | Cause analysis | Cloud platform | Data ProcessingSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Data Engineer, Cross Play Intelligence INR 1500K-2000KAutomation | C++ | Data Analysis | Data Modeling | Data PreparationMid-level Full TimeBengaluru, Karnataka, India7h ago
-
AWS Data Engineer INR 1500K-2000KAWS Glue | AWS S3 | Amazon Athena | Amazon EMR | Apache SparkHybrid workMid-level Full TimeBengaluru, Karnataka, India7h ago
-
AWS | Apache Kafka | Apache NiFi | Apache Spark | Batch ProcessingHybrid workMid-level Full TimeBengaluru, INDIA, India8h ago
-
Sr. SW Test Engineer (3-5 years of experience in Big Data Testing, Pyspark, ETL Testing, SQL) INR 1536K-2500KCI/CD | Data Quality | ETL | Hive | PySparkHybrid workSenior-level Full TimeBengaluru, INDIA, India8h ago
-
Software Engineer III – SQL, Python, Spark, AWS INR 2000K-3200KAWS Glue | Amazon S3 | Amazon Web Services | Apache Spark | Application ResiliencySenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Senior Research Engineer - Applied AI/ML INR 2500K-3500KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowSenior-level Full TimeGurugram, India9h ago
-
Data Engineer III - Big Data, Java, Scala INR 2000K-2755KAWS | Agile | Apache Spark | Big Data | CI/CDSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Engineer III-( Java, AWS & Pyspark ) INR 2000K-2755KAWS | AWS Glue | AWS IAM | AWS Lake Formation | AWS LambdaSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Data Scientist- GenAI Engineer INR 2500K-3000KA/B | A/B Testing | B testing | Causal Inference | ClusteringMid-level Full TimeNoida, Uttar Pradesh, India10h ago
-
Assistant Manager-Business Analytics INR 1500K-2000KAI Agents | API Integration | BigQuery | Cloud platform | Data LakesMid-level Full TimeAhmedabad, Gujarat, India10h ago