Senior Software Development Test Enigneer
Bengaluru, Karnataka, India
INR 2000K-4000K (estimate) Senior-level Full Time
Tasks
- Audit data ingestion transformation feature store pipelines for schema drift data corruption
- Build automated testing suites for LLM hallucination bias toxicity prompt injection
- Build scalable test automation frameworks for APIs backend services model endpoints
- Create prompt regression frameworks to measure prompt changes impact output consistency
- Define and track AI quality KPIs and communicate release readiness
- Design test beds for multi agent workflows tool calling multi step reasoning memory autonomous loops
- Detect data drift and concept drift on live inference endpoints
- Implement automated evaluations for RAG context relevance groundedness answer faithfulness
- Integrate AI evaluation and data QA suites into MLOps and CI CD pipelines
- Maintain automated suites tracking ML metrics and deep learning loss curves
- Run automated conversation simulations to stress test agent behavior
- Statistically validate AI data outputs distributions precision recall error pattern analysis
- Validate vector database indexing embedding similarity retrieval latency
- Verify synthetic dataset quality diversity privacy compliance
Perks/Benefits
- N/A
Skills/Tech-stack
Anthropic API | DeepEval | Docker | GitHub Actions | Grafana | Hugging Face | Hugging Face API | Jenkins | Kibana | Langchain | Langsmith | Llamaindex | MLflow | NumPy | OpenAI API | OpenTelemetry | Pandas | Postman | PromptFlow | Pytest | Python | REST Assured | Ragas | Requests | SQL | TruLens | Vector Databases
Education
N/A
Related jobs
-
AI Engineer (M/F/D) INR 2500K-4000KAgents SDK | Azure | CI/CD | Docker | FastAPICareer development | Flexible working models | International networking | Learning opportunitiesMid-level Full TimeHyderabad, IN6h ago
-
Architect Data Products(M/F/D) INR 2000K-2800KAPIs | Automation | Azure | Azure Data | Azure Data FactoryCareer development | Flexible working models | Inclusive work environment | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN6h ago
-
Cloud Data Engineer(M/F/D) INR 1500K-2000KAPIs | Automation | Azure | Azure Data | Azure Data FactoryCareer development | Flexible working hours | Inclusive work environment | International networking | Learning opportunitiesMid-level Full TimeHyderabad, IN6h ago
-
Junior Agentic AI Engineer (m/f/d) INR 302K-360KAI Foundry | AKS | Azure AI | Azure AI Foundry | DatabricksFlexible workingEntry-level Full TimeHyderabad, IN6h ago
-
Senior Agentic AI Engineer (M/F/D) INR 2500K-5000KAI Foundry | Asyncio | Azure | Azure AI | Azure AI FoundryCareer development | Flexible working models | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN6h ago
-
Assistant Forward Deployment Data Engineer INR 2200K-3500KAWS | Backup and Recovery | Bash | CI/CD | Configuration ManagementFrequent travel | On-site work | Temporary RelocationEntry-level Full TimeNew Delhi, Delhi, India14h ago
-
Data Engineer INR 1500K-2500KBuild tool | Data Build | Data Build Tool | Data Governance | Data ModelingMid-level Full TimeGurugram, DDC5E, India14h ago
-
Entry-level Full TimeBellandur, Karnataka, India17h ago
-
CCaaS | CRM | CTI | Embeddings | EvaluationFully remote | Learning opportunities | Startup environmentSenior-level Full TimeHyderabad R17h ago
-
Staff Data Engineer (HPC cluster software such as Slurm, NC, LSF or Grid Engine) experience with 9 to 13 years INR 1500K-3000KAccess Control | Ansible | Backup Management | Docker | Grid EngineSenior-level Full TimeBengaluru, KA, India21h ago
-
Entry-level Full TimePune City, India22h ago
-
Lead Software Engineer - Pyspark, AWS, Databricks INR 3000K-5000KAWS | Agile | Apache Kafka | Application Resiliency | Automated testingSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Sr Lead Software Engineer - Agentic AI INR 3500K-5000KA2A SDK | APIs | AWS Lambda | Amazon EKS | Amazon S3Senior-level Full TimeBengaluru, Karnataka, India23h ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India23h ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
AWS DE- Gen AI INR 2000K-3300KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Identity and Access Management IAM | AWS LambdaSenior-level Full TimeIN-TN-Chennai1d ago
-
Data Engineer INR 1600K-2500KAmazon Web Services | Apache Spark | Cloud platform | Docker | Google CloudSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior Data Science Engineer - Automation INR 3000K-4000KAgent systems | Amazon Web Services | Apache Airflow | Cloud platform | Decision TreesAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon1d ago
-
Senior DevOps Engineer - Storage Platforms | India INR 3000K-4000KAnsible | Bash | Block Storage | CI/CD | CentOSSenior-level Full TimeIndia, Bengaluru (Hybrid) R1d ago
-
Senior-level Full TimeIndia - Mumbai1d ago
-
Apache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeIndia - Mumbai1d ago
-
Lead Software Engineer - Lead Data Architect INR 3000K-5000KAWS | CI/CD | Cassandra | Data Governance | Data LineageSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Lead Data Engineer - Strategic Data Provisioning Data Engineer INR 3845K-5000KAI for Data | AI/ML | AWS | Agile | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Software Development Test Engineer INR 2000K-3500KAWS | Anthropic API | Azure | CI/CD | CypressSenior-level Full TimeBengaluru, Karnataka, India1d ago