Senior Software QA Engineer
Tasks
- Conduct API performance load and stress testing
- Define track and scale test coverage metrics
- Design testing strategies for non deterministic systems
- Develop end to end automation test frameworks
- Evaluate LLM outputs for accuracy bias safety and hallucination rates
- Integrate automated test suites into CI/CD pipelines
- Monitor model performance metrics in production
- Perform prompt regression testing
- Simulate adversarial inputs to test AI feature security
Perks/Benefits
Skills/Tech-stack
API Testing | AWS | Azure | CI/CD | Coverage metrics | Cypress | Docker | Embeddings | GCP | JavaScript | Kubernetes | LLM Evaluation | Load Testing | Playwright | Postman | Prompt Regression | Prompt Regression Testing | Pytest | Python | Regression testing | RestAssured | Selenium | Stress Testing | Test Coverage | Test coverage metrics | TypeScript | Vector Databases
Education
Related jobs
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
Senior-level Full TimeIN-MH-Pune6h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Distributed Systems | Generative AI | Language Models | Large Language ModelsSenior-level Full TimeIN-MH-Pune6h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Deep learning | Distributed Systems | GenAI | LLMSenior-level Full TimeIN-MH-Pune6h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Distributed Systems | Generative AI | LLM | Machine LearningSenior-level Full TimeIN-MH-Pune6h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Distributed Systems | Generative AI | Inference | LLMSenior-level Full TimeIN-MH-Pune6h ago
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
PL/SQL Developer INR 1200K-2400KBackup & Recovery | CI/CD | Data Modeling | Data Quality | Database InternalsSenior-level Full TimeIN-TN-Chennai6h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Deep learning | Distributed Systems | GenAI | LLM-OpsSenior-level Full TimeIN-MH-Pune6h ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseHybrid work modeSenior-level Full TimeNoida, Uttar Pradesh, India7h ago
-
Software Engineer III - (ADLC , Python) INR 3000K-4000KAWS | Agile | Architecture | CI/CD | Data VisualizationSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Data Engineer, Global Affairs INR 1500K-2500KArtificial Intelligence | Big Data | C++ | Cloud platform | Data PipelinesMid-level Full TimeHyderabad, Telangana, India8h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R8h ago
-
DE&A - Core - Big Data Engineering - Hadoop Ecosystem INR 3000K-4200KAPI | AWS | Apache Hadoop | Apache Spark | AzureSenior-level Full TimePune, Maharashtra, India8h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3500KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | Cost controlsMid-level Full TimePune, Maharashtra, India9h ago
-
AI/ML Engineer INR 2500K-3885KAzure | Deep learning | DeepSpeed | Distributed Systems | DockerCar lease | Certification programs | Corporate pension scheme | Dental & vision coverage | Education reimbursementMid-level Full TimeBangalore, Karnataka, India9h ago
-
Principal Engineer, Machine Learning INR 4000K-5000KArtificial Intelligence | Computer Vision | Deep learning | Docker | Foundation ModelsSenior-level Full TimeRemote, India R9h ago
-
Associate Principal Engineer, Machine Learning INR 1800K-3300KAdversarial Networks | Agent Orchestration | Agent systems | Computer Vision | Deep learningMid-level Full TimeRemote, India R9h ago
-
Data Engineer INR 3000K-4000KAWS | Data Architecture | Data Governance | Data Modeling | Data MonitoringBike to work | Career progression | Educational assistance | Employee assistance program | Employee discountMid-level Full TimeBengaluru, KA, India9h ago
-
Senior-level Full Time Part Timebangalore, India10h ago
-
Mid-level Full TimeIndia10h ago
-
Lead Software Engineer - Java, Spring boot, AWS Cloud & AI/ML (REST APIs, System Design, SDLC) INR 3500K-5000KAI Assisted Development | API Gateway | AWS Athena | AWS Glue | AWS KinesisSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Consultant - Data Engineer INR 1500K-2000KAzure | Azure Databricks | Compliance | Data Modeling | Data SecurityMid-level Full TimeKochi, Kerala, India12h ago