Senior AI SDET
Tasks
- Benchmark LLM performance
- Build RAG pipelines
- Build hybrid validation frameworks
- Create golden datasets
- Define AI testing standards
- Develop autonomous agents
- Engineer prompts to reduce hallucinations
- Implement eval as code
- Integrate tests into regression pipelines
- Orchestrate AI tests in MLOps
- Run non deterministic LLM testing
- Write production automation suites
Perks/Benefits
Skills/Tech-stack
Agile | Anthropic | Asynchronous processing | Autogen | CrewAI | JMeter | Kafka | LLM Evaluation | Langchain | Langgraph | Llama | Llamaindex | Locust | MLOps | Microservices | Milvus | Mistral | NumPy | OpenAI | Pandas | Pinecone | Prompt engineering | Python | REST APIs | RabbitMQ | Retrieval-Augmented Generation | Test automation | Vector Databases | Weaviate
Education
N/A
Roles
AI | AI Test Engineer | Engineer | QA Engineer | Senior QA | Senior QA Engineer | Senior Software Engineer | Software Engineer | Test Engineer
Related jobs
-
Senior Data Platform Engineer INR 1500K-2400KAWS Glue | AWS IAM | AWS Lake Formation | AWS Lambda | AWS S3Senior-level Full TimeBangalore, India3h ago
-
Data Platform Engineer INR 1400K-2000KAPI Integration | AWS CloudWatch | AWS CodePipeline | AWS Glue | AWS IAMMid-level Full TimeBangalore, India3h ago
-
AI Search | AKS | API Management | App Service | Azure AISenior-level Full TimeIndia-Noida3h ago
-
Senior-level Full TimeMaharashtra, Pune, India3h ago
-
Senior-level Full TimeIndia, West Bengal, Kolkata4h ago
-
Mid-level Full TimeIndia, West Bengal, Kolkata4h ago
-
Data Engineer INR 1500K-2000KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Azure DataMid-level Full TimeIndia, West Bengal, Kolkata4h ago
-
Senior Software Engineer - Data License Analytics, Pune INR 3000K-4512KAWS | Apache Airflow | Apache Iceberg | Databricks | Distributed SystemsSenior-level Full TimePune4h ago
-
Business Data Scientist INR 1400K-2400KAI Agents | Data Pipelines | Data Transformation | Database querying | Hypothesis TestingMid-level Full TimeHyderabad, Telangana, India5h ago
-
Senior Databricks Engineer INR 1500K-2040KCI/CD | Databricks | Databricks API | Databricks SDK | ELTSenior-level Full TimeMaharashtra, Pune, India6h ago
-
Senior - Gen AI INR 2500K-3500KDeep learning | Docker | Generative AI | Language Processing | MLOpsSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeBangalore, Karnataka, India7h ago
-
Analytics Solution Associate INR 900K-1475KAWS Glue | AWS Lambda | Agile | Data Governance | Data IngestionMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Software Engineer III - Python & Databricks INR 2050K-3500KAWS S3 | Agile | CI/CD | Cloud Computing | DatabricksSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Senior-level Full TimePune, MH, India8h ago
-
Senior-level Full TimeMumbai, Maharashtra, India9h ago
-
Staff Software Engineer (Python) INR 2500K-3800KAPIs | AWS | Authentication | Batch Processing | Data PipelinesCollaborative team environment | Leadership development | Training programsSenior-level Full TimeMumbai, MH, India9h ago
-
Mid-level Full TimeNoida, UP, IN9h ago
-
Data Engineer INR 2400K-3356KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeHyderabad, TG, IN9h ago
-
Staff Engineer (Python/AWS) INR 2500K-4000KAWS | Aurora MySQL | CI/CD | Code review | DebuggingDevelopment opportunities | Reward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India10h ago
-
Generative AI Engineer INR 1800K-2500KAWS | AWS Bedrock | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development programs | Opportunity to lead AI projects | Training sessionsMid-level Full TimeMumbai, Maharashtra, India10h ago
-
Senior-level Full TimeMumbai, Maharashtra, India10h ago
-
Senior Lead Software Engineer - Java, PySpark, and AWS INR 1800K-2300KAWS Glue | AWS Glue Catalog | AWS KMS | AWS Lake Formation | AWS LambdaSenior-level Full TimeHyderabad, Telangana, India10h ago
-
API Design | Automated testing | Elasticsearch | GraphQL | JavaEntry-level Full TimeBengaluru, Karnataka, India10h ago
-
A/B | A/B Testing | Airflow | Apache Spark | B testingCareer growth support | Family support benefits | Flexible work arrangements | Learning and development opportunities | Medical/Dental/Vision insuranceSenior-level Full TimeIndia11h ago