Testing Lead-QA
Tasks
- Benchmark model performance
- Build Python test automation
- Build regression testing suites
- Create testing documentation
- Define end-to-end testing strategies
- Design RAG testing
- Design prompt engineering testing
- Develop testing frameworks
- Establish QA standards and governance
- Evaluate OCR
- Evaluate captioning
- Evaluate image text alignment
- Evaluate multimodal models
- Evaluate reasoning capabilities
- Generate quality reports and dashboards
- Identify model drift
- Integrate testing into CI/CD
- Integrate testing into MLOps pipelines
- Maintain golden datasets
- Mentor teams on QA best practices
- Monitor production performance
- Test long context model behavior
- Test multi turn conversations
- Validate hallucination control
Perks/Benefits
Skills/Tech-stack
CI/CD | Computer Vision | Data Validation | Deep learning | Deterministic testing | Embeddings | Generative AI | Langchain | Language Models | Large Language Models | Llamaindex | MLOps | MLflow | Machine Learning | Multimodal AI | Non-deterministic Testing | OCR | Prompt engineering | Python | RAG | Regression testing | Retrieval-Augmented Generation | Test automation | Transformer | Vector Databases | Vision Language Models | Vision-language
Education
N/A
Related jobs
-
Lead Data Analyst INR 3000K-4000KAPI Integration | Automation | Dashboarding | Data Visualization | Data analyticsSenior-level Full TimeBengaluru6h ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R20h ago
-
Lead Data Engineer (Databricks) INR 2400K-3900KAWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testingSenior-level Full TimeHybrid (Bengaluru, Karnataka, IN) R1d ago
-
GenAI Lead INR 2000K-5000KAI Governance | API Management | Agile | Azure API | Azure API ManagementHybrid work modeSenior-level Full TimeAmbattur, Chennai; Coimbatore, Tamil Nadu, India; …1d ago
-
Lead Software Engineer - Machine Learning INR 4500K-6000KAPI Design | Cross-validation | Data Pipelines | Distributed Systems | Low LatencySenior-level Full TimeChennai, India1d ago
-
GenAI Product Lead, EMAP INR 4000K-5000KAI Governance | Business case | Business case development | Case Development | Customer ValueExecutive-level Full TimeHyderabad, Telangana, India1d ago
-
GenAI Product Lead, EMAP INR 4000K-5000KAI Governance | Adoption measurement | Business case | Business case development | Case DevelopmentAnnual leave | Bank holidays | Discretionary bonus plan | Health insurance | PensionExecutive-level Full TimeMumbai, Maharashtra, India1d ago
-
Lead Data Platform Engineer INR 2800K-4064KAPI Integration | AWS DataZone | AWS Glue | AWS Lake Formation | AWS LambdaEnhanced medical benefits | Family wellbeing benefits | Hybrid Remote and In Office | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
Sr Technical Lead-Cloud & Infra Engg INR 2000K-5000KAWS | Agent Orchestration | Agentic AI | Azure | CI/CDSenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN1d ago
-
Lead AI ML Engineer INR 3000K-5000KAWS | Agents | Agile | Artificial Intelligence | AzureCareer development opportunities | Comprehensive benefitsSenior-level Full TimePrimary location: Noida, India1d ago
-
Senior-level Full TimeIndia - Bangalore IT Capability Centre1d ago
-
Product Lead - AI/ML (EAII Advisors) INR 2500K-4000KArtificial Intelligence | Computer Vision | Contract Management | Data Privacy | Development LifecycleAccidental insurance | Employee recognition | Generous leave | Health insurance | Life insuranceSenior-level Full TimeNew Delhi, Delhi, India1d ago
-
Data Analyst INR 3000K-4000KAmazon Web Services | Complex joins | Data Validation | Data profiling | DatabricksSenior-level Full TimeNoida, UP, IN1d ago
-
Senior-level Full TimeHyderabad, TS, India1d ago
-
Lead Performance Engineer INR 3584K-5000KAWS | Agile | Apache JMeter | Azure | CI/CDFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeHyderabad, India R1d ago
-
ETL Data Engineer INR 1500K-2500KAdvanced SQL | Amazon Kinesis | Apache Hudi | Apache Iceberg | Apache SparkMid-level Full TimeIN-TN-Chennai1d ago
-
Lead Data Scientist INR 3000K-4000KData Analysis | Databricks | Exploratory Data Analysis | Feature Engineering | Generalized Linear ModelsCar lease | Certification programs | Corporate pension scheme | Dental insurance | Education reimbursementSenior-level Full TimeBangalore, Karnataka, India2d ago
-
Sub Value Stream Technology Delivery Lead/Senior Associate Director, Data and Analytics INR 700K-2000KAgile methodologies | CI/CD | Cloud platform | Data Engineering | Data QualityMid-level Full TimePune, Maharashtra, India R2d ago
-
Senior Technical Lead, SMO INR 1600K-3500KApache Kafka | Backpressure | Cluster operations | Consumer groups | Dead LetterSenior-level Full TimePune2d ago
-
VP - KYC Operations Data Lead INR 3000K-4200KAPI Integration | Advanced Parameters | Agile | Anomaly Detection | Custom calculationsSenior-level Full TimeLocation(s): Mumbai, Maharashtra, India2d ago
-
VP - KYC Operations Senior AI Lead INR 3700K-5000KAgentic solutions | Agile | Compliance Management | Generative AI | Information securitySenior-level Full TimeLocation(s): Mumbai, Maharashtra, India2d ago
-
Wealth Reporting & Analytics Lead, VP (Hybrid) INR 1800K-3000KAt risk | Basel Committee | Basel Committee on Banking Supervision | Control Assessment | Credit RiskHybrid work schedule | Mentoring and developmentSenior-level Full TimeLocation(s): Mumbai, Maharashtra, India R2d ago
-
Mid-level Full TimePune, India2d ago
-
Lead Software Engineer- LLM, Gen AI, ML INR 3242K-4800KAWS | Anthropic | BERT | Cohere | Deep learningGrowth opportunities | Hybrid work environment | Performance-based recognition | Training and developmentSenior-level Full TimeChennai - DLF IT Park, India2d ago
-
AI Automation Lead-Vice President INR 3584K-5000KAI Agents | Auditability | CI/CD | Docker | ExplainabilitySenior-level Full TimeLocation(s): Haryana, India2d ago