Senior Test Engineer - AI/ML
IN KA Bengaluru, India
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Assess response correctness consistency relevance grounding safety hallucinations and bias
- Automate API testing
- Create reusable automation frameworks libraries utilities
- Define AI quality validation strategies with stakeholders
- Design API automation test suites
- Design UI automation test suites
- Develop UI automation
- Develop automated validations for model outputs and prompt responses
- Develop functional integration regression and end to end test automation
- Execute database verification
- Implement quality gates
- Integrate test suites into CI/CD pipelines
- Manage defects and reporting
- Mentor junior engineers
- Perform end to end test planning and execution
- Use GenAI tools for test generation automation debugging and documentation
- Validate AI ML applications and generative AI solutions
- Validate LLM powered applications and intelligent workflows
- Validate RAG pipelines and chatbot conversations
- Validate backend data with SQL
Perks/Benefits
Skills/Tech-stack
AI Agents | API Gateway | AWS | Agile | Amazon Bedrock | Amazon SageMaker | CI/CD | ChatGPT | Chatbots | Claude | CloudWatch | Copilots | DeepEval | Docker | DynamoDB | EC2 | ECS | EKS | Git | GitHub Actions | GitHub Copilot | IAM | JMeter | Java | Jenkins | K6 | Kubernetes | Lambda | Langsmith | Language Models | Large Language Models | MLflow | Playwright | Postman | Prompt engineering | Promptfoo | Python | RAG | RDS | REST Assured | Ragas | S3 | SDLC | SQL | STLC | Scrum
Education
N/A
Language: en
Views: 0
Clicks: 0
Saves: 0
Related jobs
-
Access Control | Agile | Alerting | Apache Airflow | AuditabilityFlexible working | Inclusive diverse workplace | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India18h ago
-
Agile | BigQuery | CI/CD | Cloud Functions | Cloud RunContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R18h ago
-
Architect – Agentic AI Engineering INR 2500K-5000KAPI Design | AWS | Async/Await | Azure | Claude CodeSenior-level Full TimeHyderabad, India20h ago
-
Mid-level Full TimeSaidapet22h ago
-
Senior-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior Software Engineer - Optimization Topics INR 2200K-3465KAWS | AWS QuickSight | Agile | Amazon CloudWatch | AngularSenior-level Full TimePune - Maharashtra - India22h ago
-
Data Engineer(Snowflake + DBT) - Sub-Contractor INR 2040K-3880KDBT | Data Modeling | Data Pipelines | ETL | SQLPaid Holidays | Paid time offSenior-level Contract Full TimeBangalore, KARNATAKA, India23h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India23h ago
-
Software Engineer INR 346K-346KAPI Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimePune, MH, India23h ago
-
Staff Software Engineer, GenAI Gaming INR 2000K-5000K3D mathematics | Computer Vision | Data Processing | Diffusion Transformers | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Software Engineer, AI/ML GenAI, Google Ads INR 2500K-5000KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Entry-level Full TimePune, ASIA, India1d ago
-
Mid-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Part TimeGurugram, Haryana, India1d ago
-
AES - DE - Generative AI Application Developers INR 2500K-5000K.NET | AI Agents | AI Foundry | AI guardrails | ASP.Net CoreSenior-level Full TimePune, Maharashtra, India1d ago
-
Data Integration Specialist INR 1500K-2600KAPI Integration | AWS | Apache Kafka | Azure | Azure DataSenior-level Full TimeBengaluru, IN, 5601031d ago
-
Embedded C++ & PLC Automation Engineer-EPS1 INR 1716K-2700KBuild systems | C++ | C++17 | CAN | Cross-compilationSenior-level Full Timebangalore, India1d ago
-
Senior Cloud Engineer - AI-ML Platform INR 2500K-5000KAccess Control | Amazon Web Services | Apache Kafka | Azure DevOps | CloudFormationInclusion and belongingSenior-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Software Engineer INR 2500K-4200KAI Large Language Models | AWS Glue | Access Management | Amazon Web Services | CloudFormationSenior-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Agentic AI Platform Engineer INR 1900K-4000KA2A | API Security | Agent to Agent | Authentication | Azure DevOpsMid-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Software Technician (Robotics Software Operations) INR 3000K-4000KBash | Git | Linux | Python | SSHSenior-level Full TimePune, Maharashtra, India1d ago
-
Data Quality Engineer INR 3000K-4000KAlerting | Apache Airflow | Apache Spark | Automated testing | Cause analysisChildcare services | Employee assistance program | Medical insurance | Paid time offSenior-level Full TimeBangalore, Karnataka, India1d ago
-
AI Assisted Development | Algorithms | Amazon S3 | Apache Iceberg | Cloud ComputingFlexible work schedule | Remote work optionsSenior-level Full TimeHyderabad, India R1d ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R1d ago
-
ML Engineer INR 2400K-3000KClassification | Clustering | Computer Vision | Deep learning | DevOpsAnnual leave | Digital learning platforms | Employee assistance program | Flexible working arrangements | Learning & development opportunitiesMid-level Full TimeBangalore, IN1d ago