Staff Software Development Test Engineer
Bengaluru, Karnataka, India
INR 2000K-3500K (estimate) Senior-level Full Time
Tasks
- Audit data ingestion transformation and feature store pipelines
- Build automated testing suites for LLM evaluations
- Build test automation frameworks for APIs and backend services
- Create prompt regression frameworks
- Define and track AI quality KPIs
- Design test beds for multi agent workflows
- Embed AI evaluation and data QA into MLOps and CI CD pipelines
- Implement automated evaluations for RAG systems
- Implement monitoring scripts for data and concept drift
- Run conversation simulations for agent stress testing
- Statistically validate AI data outputs
- Track ML metrics and deep learning loss curves
- Validate vector database indexing embeddings similarity and retrieval latency
- Verify quality diversity and privacy compliance of synthetic datasets
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Anthropic API | Azure | CI/CD | Cypress | Data Generation | DeepEval | Docker | GitHub Actions | Google Cloud | Grafana | Hugging Face | Hugging Face API | Hypothesis Testing | JMeter | Jenkins | Kibana | Kubernetes | Langchain | Langsmith | Llamaindex | Locust | MLOps | MLflow | NumPy | OpenAI API | OpenTelemetry | Pandas | Playwright | Postman | PyTorch | Pytest | Python | REST Assured | Ragas | Requests | SQL | Scikit-learn | Statistical Hypothesis Testing | Synthetic Data Generation | Synthetic data | TensorFlow | Terraform | TruLens | Vector Database
Education
N/A
Related jobs
-
AI Engineer (M/F/D) INR 2500K-4000KAgents SDK | Azure | CI/CD | Docker | FastAPICareer development | Flexible working models | International networking | Learning opportunitiesMid-level Full TimeHyderabad, IN7h ago
-
Architect Data Products(M/F/D) INR 2000K-2800KAPIs | Automation | Azure | Azure Data | Azure Data FactoryCareer development | Flexible working models | Inclusive work environment | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN7h ago
-
Cloud Data Engineer(M/F/D) INR 1500K-2000KAPIs | Automation | Azure | Azure Data | Azure Data FactoryCareer development | Flexible working hours | Inclusive work environment | International networking | Learning opportunitiesMid-level Full TimeHyderabad, IN7h ago
-
Junior Agentic AI Engineer (m/f/d) INR 302K-360KAI Foundry | AKS | Azure AI | Azure AI Foundry | DatabricksFlexible workingEntry-level Full TimeHyderabad, IN7h ago
-
Senior Agentic AI Engineer (M/F/D) INR 2500K-5000KAI Foundry | Asyncio | Azure | Azure AI | Azure AI FoundryCareer development | Flexible working models | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN7h ago
-
Assistant Forward Deployment Data Engineer INR 2200K-3500KAWS | Backup and Recovery | Bash | CI/CD | Configuration ManagementFrequent travel | On-site work | Temporary RelocationEntry-level Full TimeNew Delhi, Delhi, India15h ago
-
Data Engineer INR 1500K-2500KBuild tool | Data Build | Data Build Tool | Data Governance | Data ModelingMid-level Full TimeGurugram, DDC5E, India16h ago
-
Entry-level Full TimeBellandur, Karnataka, India18h ago
-
CCaaS | CRM | CTI | Embeddings | EvaluationFully remote | Learning opportunities | Startup environmentSenior-level Full TimeHyderabad R18h ago
-
Staff Data Engineer (HPC cluster software such as Slurm, NC, LSF or Grid Engine) experience with 9 to 13 years INR 1500K-3000KAccess Control | Ansible | Backup Management | Docker | Grid EngineSenior-level Full TimeBengaluru, KA, India22h ago
-
Entry-level Full TimePune City, India23h ago
-
Lead Software Engineer - Pyspark, AWS, Databricks INR 3000K-5000KAWS | Agile | Apache Kafka | Application Resiliency | Automated testingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Sr Lead Software Engineer - Agentic AI INR 3500K-5000KA2A SDK | APIs | AWS Lambda | Amazon EKS | Amazon S3Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
AWS DE- Gen AI INR 2000K-3300KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Identity and Access Management IAM | AWS LambdaSenior-level Full TimeIN-TN-Chennai1d ago
-
Data Engineer INR 1600K-2500KAmazon Web Services | Apache Spark | Cloud platform | Docker | Google CloudSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior Data Science Engineer - Automation INR 3000K-4000KAgent systems | Amazon Web Services | Apache Airflow | Cloud platform | Decision TreesAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon1d ago
-
Senior DevOps Engineer - Storage Platforms | India INR 3000K-4000KAnsible | Bash | Block Storage | CI/CD | CentOSSenior-level Full TimeIndia, Bengaluru (Hybrid) R1d ago
-
Senior-level Full TimeIndia - Mumbai1d ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1000K-2000KAPIs | Apache Airflow | Apache Beam | Auditability | Batch ProcessingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Apache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeIndia - Mumbai1d ago
-
Lead Software Engineer - Lead Data Architect INR 3000K-5000KAWS | CI/CD | Cassandra | Data Governance | Data LineageSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Lead Data Engineer - Strategic Data Provisioning Data Engineer INR 3845K-5000KAI for Data | AI/ML | AWS | Agile | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India1d ago