AI Test Engineer - VLabs

Bengaluru, India

INR 2500K-4800K (estimate) Senior-level Full Time

@ V...

Apply Save

Found 1d ago

Tasks

Build Python evaluation frameworks
Build and maintain ground truth datasets
Define classification and extraction accuracy standards
Define reusable AI evaluation patterns
Design adversarial and boundary test inputs
Design drift detection frameworks
Embed evaluation frameworks in CI CD pipelines
Ensure responsible AI data privacy and governance compliance
Establish regression thresholds
Implement AI as judge evaluation
Perform API testing of AI pipeline endpoints
Support auditability and traceability of AI outputs
Test end to end agentic workflows
Translate AI testing strategy into test scenarios
Translate evaluation results into actionable insights
Validate AI outputs against performance thresholds
Validate data persistence and integrity with SQL

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en Views: 1

Clicks: 0

Saves: 0

Related jobs

Agentic AI Data Engineer INR 2500K-5000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon Bedrock

Senior-level Full Time

Gurugram, Haryana, India

4h ago
Data Scientist INR 2500K-4200K

Amazon SageMaker | Azure AI | Azure Synapse | Azure Synapse Analytics | C++

Mid-level Full Time

Hyderabad, Telangana, India

7h ago
Data Engineer INR 1500K-2980K

API Security | AWS | Angular | CSS3 | Cypress

Employee assistance program | Employee discounts | Gym reimbursement | Healthcare coverage | Learning platform access

Mid-level Full Time

Bangalore, Karnataka, India

7h ago
Software Engineer - Tableau INR 2520K-4000K

A/B | A/B Testing | Agile | Attribution Modeling | Audience Segmentation

Flexible work model

Senior-level Full Time

Hyderabad, India

8h ago
Lead Engineer - Data INR 3600K-4720K

AWS | AWS Kinesis | Access Control | Agile | Apache Kafka

Senior-level Full Time

Pune, MH, India

9h ago
Data Engineer INR 2771K-4064K

Agile | Azure Data | Azure Data Services | Azure DevOps | Cloud Concepts

Learning and career development | Management training | Modern infrastructure | Online learning

Senior-level Full Time

Chennai, IN, 600 032

14h ago
AI Engineering INR 3242K-5000K

Agent workflows | Audit Logging | Authentication | Authorization | Automated testing

Senior-level Full Time

Bangalore, KA, IN

14h ago
Kafka Administrator INR 2800K-4200K

AWS EC2 | AWS Glue | AWS IAM | AWS MSK | AWS Secrets

Budget for courses and technical conferences | Career progression | Funded certification paths | Hybrid/Remote flexibility | Mentorship

Senior-level Full Time

Bengaluru, Karnataka, India

18h ago
Lead MySQL Database Engineer INR 2000K-3100K

AWS EC2 | AWS RDS | Amazon Aurora | Ansible | AppDynamics

In-office work culture | Mentoring and development

Senior-level Full Time

Bengaluru, Karnataka, India

18h ago
Senior Data Engineer INR 2000K-4000K

AWS Glue | AWS Lambda | Amazon EMR | Amazon RDS | Amazon S3

Senior-level Full Time

Hyderabad, India

23h ago
Senior Software Engineer INR 2800K-4200K

AWS | Bash | CI/CD | CICS | Cobol

Reward and recognition | Volunteering opportunities | Wellness | Work-life balance

Senior-level Full Time

Hyderabad, India

23h ago
Software Engineer III - Data Engineer INR 2500K-4000K

Agile | Application Resiliency | Artificial Intelligence | Automated testing | CI/CD

Senior-level Full Time

Hyderabad, Telangana, India

23h ago
Senior manager- Data Engineer INR 3000K-4000K

API Integration | AWS | Ads API | Agile | Batch data

Dental insurance | Employee discounts | Health insurance | Mental Health Awareness Days | Paid time off

Senior-level Full Time

Bangalore, India; Gurgaon, India

1d ago
Applied AI ML Lead INR 3799K-5572K

AWS Bedrock | AWS ECS | AWS Lambda | AWS SageMaker | Apache Spark

Senior-level Full Time

Bengaluru, Karnataka, India

1d ago
Product and Solutions Development Manager INR 2200K-3000K

Agile | Apache Kafka | Apache Spark | CI/CD | Containerization

Mid-level Full Time

Bangalore - Karnataka - India

1d ago
Senior Agentic AI Engineer - Bangalore INR 3000K-3500K

AI Workflow Orchestration | AI workflow | APIs | AWS | CI/CD

Mid-level Full Time

Bengaluru, Karnātaka, India

1d ago
Senior AI Architect INR 2500K-5000K

AWS | Agent Development | Agent Development Kit | Agent systems | Agentic AI

Senior-level Full Time

India

1d ago
Sr Data Engineer INR 1500K-2700K

Airflow | Ascend io | BigQuery | CI/CD | Cloud Composer

Senior-level Full Time

Hyderabad, India

1d ago
AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 100K-400K

AI Assisted Development | Claude Code | Cursor | JavaScript | OpenAI Codex

Senior-level Full Time

Miami

1d ago
Data Engineer, Cloud Supply Chain Data Engineering INR 1500K-2200K

BigQuery | Data Governance | Data Monitoring | Data Pipelines | Data Quality

Collaborative team environment | Mentoring opportunities

Mid-level Full Time

Bengaluru, Karnataka, India

1d ago
Senior Staff Software Engineer, Geo INR 2500K-3465K

Anomaly Detection | C++ | Continuous Learning | Data Governance | Data Infrastructure

Senior-level Full Time

Bengaluru, Karnataka, India

1d ago
Application Engineer, General Software Development INR 1500K-3500K

AI integration | Agentic integration | C++ | Cloud platform | Data exchange

Mid-level Full Time

Hyderabad, Telangana, India

1d ago
Senior Staff Software Engineer INR 3417K-4800K

.Net Core | AWS | Azure | CI/CD | Cloud Native

Enhanced medical benefits | Paid time off | Wellbeing programs

Senior-level Full Time

Hyderabad, India

1d ago
AWS Data Engineer INR 1500K-2500K

AWS Glue | Amazon Athena | Amazon EMR | Amazon S3 | Apache Spark

Mid-level Full Time

Pune, Maharashtra, India

1d ago
Lead Associate - AI/Engineering INR 1500K-3000K

.NET | AWS | Angular | Azure | C#

Mid-level Full Time

Pune

1d ago

AI Test Engineer - VLabs

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs