Senior QA Engineer (AI Solutions)
EUR 51K-69K (estimate) Senior-level Full Time
Tasks
- Build and maintain automated test suites
- Collaborate with engineering on quality improvements
- Conduct SAST DAST security checks
- Define agent behavior quality criteria
- Design LLM and agent evaluation harnesses
- Establish deployment gates with evidence
- Implement AI assisted failure triage and root cause analysis
- Implement LLM as judge scoring with rubrics
- Maintain golden datasets and regression suites
- Own end to end QA strategy for AI agent platform
- Perform AI assisted test generation and exploratory testing
- Run performance load and chaos testing
- Shift left with requirements and design testing
- Shift right with production observability based regression
- Test guardrails prompt injection defenses and tool restrictions
- Use logs metrics and traces for testing and monitoring
Perks/Benefits
- Anniversary bonus
- Employee Share Purchase Plan ESPP
- Employee Stock Options Grant
- Flexible working hours
- Full medical checkup
- Growth and development opportunities
- Hybrid work
- Learning and development budget
- Learning and growth opportunities
- Multi-sport card
- Performance bonus
- Referral bonus
- Remote work
Skills/Tech-stack
API Testing | AWS | Accessibility testing | Azure | Azure DevOps | CI/CD | Chaos Testing | Contract testing | DAST | Event Driven | Event-driven architecture | GitHub Actions | GitLab CI | Golden Dataset | Hallucination | JMeter | JUnit | Java | K6 | LLM Evaluation | LLM-as-judge | Load Testing | Locust | Logs | Metrics | Microservices | Observability | Performance Testing | Playwright | Prompt engineering | Prompt injection | Pytest | Python | RAG | Red Teaming | Regression testing | RestAssured | Retrieval-Augmented Generation | Rubric Based Scoring | SAST | Security Testing | Service virtualization | Traces | TypeScript | Visual regression
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
API Integration | Anomaly Detection | Data Modeling | Data Pipelines | DockerCareer growth | Flexible schedule | International team culture | Remote workMid-level Full TimeCroatia R21h ago
-
Accelerate | Deep learning | Diffusers | GPU | Generative AIAutonomy and ownership | Career growth opportunities | Continuous learning | Flexible, distributed work environment | Fully remote workMid-level Full TimeCroatia R1d ago
-
AWS | Computer Vision | Data Ingestion | Data Processing | Data labelingFlexible scheduling | Fully remote | Inclusive, diverse team culture | Paid training opportunities | Professional development supportMid-level Full TimeCroatia R5d ago
-
AI Engineer EUR 25K-33KAPI Gateway | AWS IAM | AWS Lambda | AWS Step Functions | Agent OrchestrationExtra vacation days | Flexible working hours | Hybrid or remote work | Meal allowance | Multisport card covered by employerEntry-level Full TimeZagreb, Croatia (Hybrid) R14d ago
-
Senior Python Developer (AI Integration) EUR 54K-84KAWS | Anthropic API | Azure | Azure OpenAI | CachingFlexible working hours | Indefinite contract | Knowledge sharing sessions | Mentorship | Professional development supportSenior-level Full TimeZagreb (Remote), Croatia (Hybrid) R19d ago
-
Python Data Engineer (m/ž) EUR 16K-24KAI Agents | AI Pipelines | BigQuery | CI/CD | Cloud RunChild gift | Christmas bonus | Easter bonus | Flexible working hours | Google Cloud certificationsEntry-level Full TimeZagreb, Hrvatska (Hybrid) R22d ago
-
Senior Data Engineer EUR 48K-70KAWS | Agile | Azure | Cloud Security | Data IngestionAnniversary bonus | Employee Share Purchase Plan ESPP | Employee Stock Options Grant | Flexible working hours | Full medical checkupSenior-level Full TimeRijeka or Zagreb, Croatia (Hybrid) R1mo ago
-
Data Engineer EUR 42K-70KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure SynapseCareer development plan | Child benefits | Health checks | Lunch compensation | MentorshipSenior-level Full TimeZagreb, Rijeka, Osijek, Croatia (Hybrid) R1mo ago