AI Software Development Engineer in Test (AI-SDET)
Tasks
- Automate testing for microservices and streaming
- Build automated LLM validation pipelines
- Champion AI testing tools and practices
- Create synthetic and benchmark datasets
- Define AI quality standards for SDLC
- Design AI evaluation frameworks
- Develop API automation frameworks
- Develop UI automation frameworks
- Identify QA process gaps and introduce AI solutions
- Integrate automation into CI/CD pipelines
- Measure AI latency token usage cost and throughput
- Monitor AI observability logging tracing
- Perform cloud testing and deployments
- Run workshops to upskill QA engineers
- Validate AI agents and orchestration frameworks
- Validate LLM outputs
- Validate RAG pipeline architectures
- Validate distributed system reliability
- Validate multi agent workflows
- Validate vector database and retrieval accuracy
Perks/Benefits
- Annual bonus
- Extra days off
- Health care benefits
- In-company English lessons
- Internet reimbursement
- LinkedIn Learning
- Referral program bonus
- Tuition reimbursement
- Work from home or hybrid options
- Work-life balance programs
Skills/Tech-stack
AI evals | API Testing | AWS | Agile Scrum | Autogen | Azure | Azure DevOps | CI/CD | ChromaDB | CrewAI | Cypress | Docker | Embeddings | Event Driven | Event-driven architecture | Faiss | Function Calling | GCP | GitHub Actions | GitLab CI | GitLab CI/CD | GraphQL | Jenkins | Kubernetes | Langchain | Langgraph | Language Models | Large Language Models | Logging | Micro Frontends | Microservices | Observability | OpenAI | Pinecone | Playwright | Prompt engineering | Python | Qdrant | RAG | REST APIs | Robot Framework | SQL | Selenium | Semantic Kernel | Semantic Scoring | Streaming | Structured outputs | Synthetic data | Tool-Calling | Tracing | UI Automation | Vector Databases | Weaviate | Webhooks
Related jobs
-
Senior Data & Analytics Engineer INR 3000K-4000KAWS | Apache Spark | Azure | CI/CD | Cloud platformSenior-level Full TimeBangalore, Karnataka, IN8h ago
-
Senior AI Solutions Engineer INR 2500K-4500KAPI Integration | Agent Orchestration | Autonomous Agents | Data Pipelines | Database ConnectionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN8h ago
-
Sr. Specialist , Data Engineering INR 2520K-3380KAgile | Airflow | BigQuery | CI/CD | Cloud FunctionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN8h ago
-
Airflow | BigQuery | Cloud Composer | Cloud Functions | Cloud RunCareer growth opportunities | Collaborative cross-functional environment | Continuous learning | Flexible or hybrid work arrangements | Health and wellness supportSenior-level Full TimeIndia11h ago
-
Senior Machine Learning Operations Engineer INR 2500K-3500KAWS | AWS Glue | AWS Lambda | Amazon SageMaker | AzureSenior-level Full TimeBangalore, INDIA R11h ago
-
Principal Engineer, SQL DBA INR 1500K-2700KADO.NET | Audit Logging | Azure | CI/CD | Change ManagementSenior-level Full TimeRemote, India R11h ago
-
Senior Data Engineer - Advertising Engineering INR 3000K-3880KAWS | Apache Airflow | Apache Spark | Azure | CI/CD401k retirement plan | Financial wellness support | Flexible remote work Fridays | Healthcare benefits | Hybrid work scheduleSenior-level Full TimeBengaluru, India13h ago
-
Lead Consultant - AI Architect INR 3000K-5000KAgent Orchestration | Agentic AI | Amazon Bedrock | Amazon Q | Amazon SageMakerSenior-level Full TimeIndia - Bangalore R17h ago
-
Lead Consultant - AI Architect INR 3584K-5500KAgent Orchestration | Agentic AI | Amazon Bedrock | Amazon Q | Amazon SageMakerSenior-level Full TimeIndia - Bangalore R17h ago
-
Software Development Specialist INR 3000K-3880KApp Insights | Azure | Azure App | Azure App Insights | Azure DataSenior-level Full TimeBengaluru, KA, IN17h ago
-
Software Engineering Lead Analyst - HIH - Evernorth INR 1500K-2500KAWS | Apache Airflow | Azure | Data Lake | Data WarehouseAgile environment | Continuous learning | Cross-functional collaboration | Technical documentation supportSenior-level Full TimeHIH - Hyderabad, India17h ago
-
Software Engineering Lead Analyst - HIH - Evernorth INR 1500K-2500KAWS | Apache Airflow | Azure | Data Lake | Data WarehouseSenior-level Full TimeHIH - Hyderabad, India17h ago
-
Software Engineering Advisor - HIH - Evernorth INR 1500K-2500KAPI Integration | AWS | AWS Lambda | Amazon EC2 | Amazon RedshiftMid-level Full TimeHIH - Hyderabad, India17h ago
-
Pentaho / Apache Hop INR 1200K-2000KAWS S3 | Apache Hadoop | Apache Hop | Apache Spark | Azure BlobMid-level Full TimeBengaluru, KA, IN17h ago
-
Senior ETL Abinitio Developer - Vice President INR 1632K-2500KAWS | Abinitio | Anomaly Detection | Apache Hadoop | Apache SparkSenior-level Full TimePLOT NO-1, S.NO. 77, India17h ago
-
Tech Risk-Senior INR 2520K-4000KAnalysis Services | Azure Data | Azure Data Factory | Azure DevOps | Azure LogicClient exposure | Cross-functional collaboration | Global career development | Inclusive culture | Learning cultureSenior-level Full TimeBengaluru, KA, IN, 56004817h ago
-
Azure Data Engineer INR 3000K-4000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePune - Hinjewadi (Ascendas), India17h ago
-
ARCHIVING SQUAD DATA ENGINEER-Contract-Senior INR 3000K-4000KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130117h ago
-
Software Engineer INR 1300K-2000KAgile | Cloud services | Code review | Data Modeling | Design PatternsMid-level Full TimePune, India1d ago
-
Forward Deployed AI Engineer INR 3000K-5000KAPI | AWS | Azure | CI/CD | Cloud platformFive days a week | Flexible working hours | Supportive work environmentSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Senior Software Engineer - AI Platform Engineer INR 4000K-6000KAWS | Argo Workflows | CI/CD | Custom Resource Definitions | Distributed tracingSenior-level Full TimeIndia1d ago
-
Tech Lead / Staff Forward-Deployed Engineer INR 2500K-5000KAI Observability | Agent systems | Amazon Web Services | Azure | CI/CDCollaborative work environment | Five days per week | Flexible working hoursSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Senior Software Engineer - Multi Cloud Efficiency INR 2400K-3500KAWS | Automated testing | Azure | Cloud Architecture | Cloud Cost OptimizationSenior-level Full TimeBengaluru, India1d ago
-
Staff Software Engineer - Multi Cloud Efficiency INR 2000K-2800KAWS | Azure | C++ | Cloud Computing | Cloud platformSenior-level Full TimeBengaluru, India1d ago
-
AWS Agentic AI INR 2000K-4800KAPI Integration | AWS Glue | AWS Lambda | AWS Step Functions | Agentic AISenior-level Full TimeIN-KA-Bangalore1d ago