AI Software Development Engineer in Test (AI-SDET)
Tasks
- Automate testing for microservices and streaming
- Build automated LLM validation pipelines
- Champion AI testing tools and practices
- Create synthetic and benchmark datasets
- Define AI quality standards for SDLC
- Design AI evaluation frameworks
- Develop API automation frameworks
- Develop UI automation frameworks
- Identify QA process gaps and introduce AI solutions
- Integrate automation into CI/CD pipelines
- Measure AI latency token usage cost and throughput
- Monitor AI observability logging tracing
- Perform cloud testing and deployments
- Run workshops to upskill QA engineers
- Validate AI agents and orchestration frameworks
- Validate LLM outputs
- Validate RAG pipeline architectures
- Validate distributed system reliability
- Validate multi agent workflows
- Validate vector database and retrieval accuracy
Perks/Benefits
- Annual bonus
- Extra days off
- Health care benefits
- In-company English lessons
- Internet reimbursement
- LinkedIn Learning
- Referral program bonus
- Tuition reimbursement
- Work from home or hybrid options
- Work-life balance programs
Skills/Tech-stack
AI evals | API Testing | AWS | Agile Scrum | Autogen | Azure | Azure DevOps | CI/CD | ChromaDB | CrewAI | Cypress | Docker | Embeddings | Event Driven | Event-driven architecture | Faiss | Function Calling | GCP | GitHub Actions | GitLab CI | GitLab CI/CD | GraphQL | Jenkins | Kubernetes | Langchain | Langgraph | Language Models | Large Language Models | Logging | Micro Frontends | Microservices | Observability | OpenAI | Pinecone | Playwright | Prompt engineering | Python | Qdrant | RAG | REST APIs | Robot Framework | SQL | Selenium | Semantic Kernel | Semantic Scoring | Streaming | Structured outputs | Synthetic data | Tool-Calling | Tracing | UI Automation | Vector Databases | Weaviate | Webhooks
Related jobs
-
Senior Data & Analytics Engineer INR 3000K-4000KAWS | Apache Spark | Azure | CI/CD | Cloud platformSenior-level Full TimeBangalore, Karnataka, IN7h ago
-
Senior AI Solutions Engineer INR 2500K-4500KAPI Integration | Agent Orchestration | Autonomous Agents | Data Pipelines | Database ConnectionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN7h ago
-
Sr. Specialist , Data Engineering INR 2520K-3380KAgile | Airflow | BigQuery | CI/CD | Cloud FunctionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN7h ago
-
Airflow | BigQuery | Cloud Composer | Cloud Functions | Cloud RunCareer growth opportunities | Collaborative cross-functional environment | Continuous learning | Flexible or hybrid work arrangements | Health and wellness supportSenior-level Full TimeIndia9h ago
-
Senior Machine Learning Operations Engineer INR 2500K-3500KAWS | AWS Glue | AWS Lambda | Amazon SageMaker | AzureSenior-level Full TimeBangalore, INDIA R10h ago
-
Principal Engineer, SQL DBA INR 1500K-2700KADO.NET | Audit Logging | Azure | CI/CD | Change ManagementSenior-level Full TimeRemote, India R10h ago
-
Senior Data Engineer - Advertising Engineering INR 3000K-3880KAWS | Apache Airflow | Apache Spark | Azure | CI/CD401k retirement plan | Financial wellness support | Flexible remote work Fridays | Healthcare benefits | Hybrid work scheduleSenior-level Full TimeBengaluru, India11h ago
-
Lead Consultant - AI Architect INR 3000K-5000KAgent Orchestration | Agentic AI | Amazon Bedrock | Amazon Q | Amazon SageMakerSenior-level Full TimeIndia - Bangalore R15h ago
-
Lead Consultant - AI Architect INR 3584K-5500KAgent Orchestration | Agentic AI | Amazon Bedrock | Amazon Q | Amazon SageMakerSenior-level Full TimeIndia - Bangalore R15h ago
-
Software Engineer INR 1300K-2000KAgile | Cloud services | Code review | Data Modeling | Design PatternsMid-level Full TimePune, India23h ago
-
Forward Deployed AI Engineer INR 3000K-5000KAPI | AWS | Azure | CI/CD | Cloud platformFive days a week | Flexible working hours | Supportive work environmentSenior-level Full TimeMumbai, Maharashtra, India23h ago
-
Tech Lead / Staff Forward-Deployed Engineer INR 2500K-5000KAI Observability | Agent systems | Amazon Web Services | Azure | CI/CDCollaborative work environment | Five days per week | Flexible working hoursSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Senior Software Engineer - Multi Cloud Efficiency INR 2400K-3500KAWS | Automated testing | Azure | Cloud Architecture | Cloud Cost OptimizationSenior-level Full TimeBengaluru, India1d ago
-
Staff Software Engineer - Multi Cloud Efficiency INR 2000K-2800KAWS | Azure | C++ | Cloud Computing | Cloud platformSenior-level Full TimeBengaluru, India1d ago
-
AWS Agentic AI INR 2000K-4800KAPI Integration | AWS Glue | AWS Lambda | AWS Step Functions | Agentic AISenior-level Full TimeIN-KA-Bangalore1d ago
-
Gen AI INR 2000K-3500KAI Agent | AI Governance | AI agent evaluation | AWS CodePipeline | Agent OrchestrationMid-level Full TimeIN-AP-Hyderabad1d ago
-
Sr Database Engineer - Oracle INR 1500K-3000KAccess Control | Backup and Recovery | Capacity Planning | Change Control | ClusteringOn-call support | Travel less than 5 percentSenior-level Full TimePune, India1d ago
-
Senior-level Full TimePune, MH, India1d ago
-
Senior Data Engineer INR 3264K-4995KAWS | Agile | DBT | Data Governance | Data ModelingFlexible work options | Life leave days | Professional development days | Retirement savings options | Vacation timeSenior-level Full TimePune, MH, India1d ago
-
Senior-level Full TimeNoida,Uttar Pradesh,India1d ago
-
Data Engineer INR 1500K-2000KApache Airflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud FunctionsMid-level Full TimeIndia-Telangana-Hyderabad1d ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)1d ago
-
Data Scientist Associate INR 1400K-2400KAnalytics | Artificial Intelligence | Compliance | Data Analysis | Fraud DetectionMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)1d ago
-
Data Engineer INR 1500K-2000KAPI Integration | AWS | ETL | NumPy | PandasHybrid work | Remote workMid-level Full TimeGreater Delhi Area R1d ago