AI Quality Engineer (Contract)
Hyderabad, Telangana, India
INR 2000K-4680K (estimate) Senior-level Contract
Tasks
- Collaborate with AI ML engineers to improve AI system quality
- Define AI evaluation criteria test datasets and quality metrics
- Evaluate relevance consistency factuality and hallucinations
- Perform regression testing for models prompts and AI workflows
- Test AI agents across edge and negative cases
- Test AI generated insights
- Validate LLM and RAG accuracy
- Validate RAG retrieval context grounding
Perks/Benefits
Skills/Tech-stack
AWS | Automated testing | Azure | CI/CD | DeepEval | GCP | LLM Evaluation | Langsmith | Observability | Pytest | Python | RAG | Ragas | Regression testing
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeMADURAI, TAMIL NADU, India1d ago
-
Senior AI Engineer INR 3264K-5000KAI Foundry | Access Control | Agent Frameworks | Authentication | AzureSenior-level Full TimeIndia1d ago
-
Entry-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer (Manager level) INR 1200K-2500KApache Spark | Azure AI | Azure CI | Azure CI/CD | Azure CognitiveMid-level Full TimeHyderabad, India1d ago
-
Consultant - Databricks Azure INR 1000K-2700KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India1d ago
-
Assistant Manager - Databricks Azure INR 1500K-2000KADLS | Amazon Kinesis | Apache Kafka | Apache Spark | Azure ADMid-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Consultant - Databricks Azure INR 1500K-2000KADLS | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Consultant - Databricks AWS INR 1500K-2000KADLS | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India1d ago
-
Consultant - Databricks AWS INR 1500K-2500KAWS Data | AWS Data Pipeline | AWS Glue | AWS Lake | AWS Lake FormationMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Data Engineer INR 1500K-2700KAWS Glue | AWS Kinesis | AWS Lake | AWS Lake Formation | AWS LambdaSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Competitive salary | Laid back environment | Remote-first cultureMid-level Full TimeKolkata, India1d ago
-
Developer II INR 2000K-5000KAWS EKS | Data Structures | Data Structures and Algorithms | Docker | FlaskSenior-level Full TimeBengaluru, KA, India1d ago
-
AI Architect INR 2500K-5000KAWS SageMaker | Azure Machine Learning | Cloud Computing | Data Governance | Deep learningCollaborative working environment | Continuous learning | Global organisationSenior-level Full TimePune, MH, India1d ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeGurgaon, India1d ago
-
Senior-level Full TimeDGS India - Bengaluru - Manyata …1d ago
-
AI Agents | AI Data | AI data governance | API Security | Cloud SecurityMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
AWS | AWS Glue | Agile | Amazon S3 | CI/CDSenior-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
Agent systems | Agentic AI | Anomaly Detection | Cloud Computing | Cloud platformCross-functional collaboration | Matrixed organization leadership | Mid-shift schedule | Onsite workSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
TTT - Full Stack .Net Developer - Gen AI - Staff INR 2400K-3217K.NET | ADO.NET | ASP.NET MVC | ASP.Net Core | AgileContinuous learning | Diverse and inclusive culture | Flexible tools and support | Transformative leadershipSenior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KConvolutional Neural Networks | Data Mining | Data Preprocessing | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangements | Health and wellbeing benefits | Hybrid work schedule | Inclusion initiativesSenior-level Full TimeBengaluru, Karnātaka, India R1d ago
-
AI Engineering Manager INR 2000K-4000KAPI Integration | Automated testing | Claude API | Continuous Deployment | Continuous integrationMid-level Full TimeIndia, Bengaluru (Hybrid) R1d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R1d ago
-
AI QA & Evaluation Engineer INR 3584K-4580KAWS | Artificial Intelligence | Azure | Benchmarking | CI/CDFlexible schedule | Health insurance | Parental leave | Vacation days | Volunteer timeMid-level Full TimeBangalore, India2d ago
-
Senior Snowflake Engineer INR 2000K-4200KAPI Development | AWS | Apache Airflow | Automated testing | AzureCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeAll Cities, India R2d ago