Senior QA Engineer (AI Solutions)
EUR 51K-69K (estimate) Senior-level Full Time
Tasks
- Build and maintain automated test suites
- Collaborate with engineering on quality improvements
- Conduct SAST DAST security checks
- Define agent behavior quality criteria
- Design LLM and agent evaluation harnesses
- Establish deployment gates with evidence
- Implement AI assisted failure triage and root cause analysis
- Implement LLM as judge scoring with rubrics
- Maintain golden datasets and regression suites
- Own end to end QA strategy for AI agent platform
- Perform AI assisted test generation and exploratory testing
- Run performance load and chaos testing
- Shift left with requirements and design testing
- Shift right with production observability based regression
- Test guardrails prompt injection defenses and tool restrictions
- Use logs metrics and traces for testing and monitoring
Perks/Benefits
- Anniversary bonus
- Employee Share Purchase Plan ESPP
- Employee Stock Options Grant
- Flexible working hours
- Full medical checkup
- Growth and development opportunities
- Hybrid work
- Learning and development budget
- Learning and growth opportunities
- Multi-sport card
- Performance bonus
- Referral bonus
- Remote work
Skills/Tech-stack
API Testing | AWS | Accessibility testing | Azure | Azure DevOps | CI/CD | Chaos Testing | Contract testing | DAST | Event Driven | Event-driven architecture | GitHub Actions | GitLab CI | Golden Dataset | Hallucination | JMeter | JUnit | Java | K6 | LLM Evaluation | LLM-as-judge | Load Testing | Locust | Logs | Metrics | Microservices | Observability | Performance Testing | Playwright | Prompt engineering | Prompt injection | Pytest | Python | RAG | Red Teaming | Regression testing | RestAssured | Retrieval-Augmented Generation | Rubric Based Scoring | SAST | Security Testing | Service virtualization | Traces | TypeScript | Visual regression
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Sr AI Engineer | Remote - Europe | TS/Vue/NodeJS GBP 80K-120KAPI Design | Agent architecture | Anthropic | Chat completion | Chunking401k match | Course budget | Dental coverage | Equity | HackathonsSenior-level Full TimeBerlin Office R5d ago
-
AI Tech Lead (m/f) EUR 56K-79KAPI Design | AWS | Authentication | Authentication Protocols | Authorization1-on-1 mentorship | Conferences | Ergonomic workstations | Flexible working hours | GPU compute accessSenior-level Full TimeZagreb, Croatia (Hybrid) R6d ago
-
Context window | Context window optimization | Data labeling | Dataset cleaning | Direct Preference Optimization1 1 psychologist sessions | AI tools access | Annual in-person meetup | Co-working space budget | Company-provided equipmentSenior-level Full TimeCroatia R7d ago
-
Senior Data Engineer EUR 54K-77KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure Synapse25 vacation days | Benefits for children of employees | Career development plan | Health checks | Lunch compensationSenior-level Full TimeZagreb, Rijeka, Osijek, Croatia (Hybrid) R8d ago
-
Mid-level Full TimeZagreb, Hrvatska (Hybrid) R11d ago
-
Senior Data Engineer USD 140K-177KAWS | Access Control | Agile | Airflow | Amazon RedshiftEquity participation | Flexible work arrangements | Internal L and D programs | Location-specific benefits | Remote work optionSenior-level Full TimeCroatia, Serbia, Bulgaria, Romania R12d ago
-
Senior Software Engineer – Database Optimizer EUR 78K-108KArgoCD | C++ | ClickHouse | Database tuning | EnvoyConference access | Equipment budget | Equity options | Extra days off | Flexible scheduleSenior-level Full TimeBulgaria; Croatia; Greece; Lithuania; Poland; Romania; … R18d ago
-
AI Engineer EUR 25K-33KAPI Gateway | AWS IAM | AWS Lambda | AWS Step Functions | Agent OrchestrationExtra vacation days | Flexible working hours | Hybrid or remote work | Meal allowance | Multisport card covered by employerEntry-level Full TimeZagreb, Croatia (Hybrid) R1mo ago
-
Senior Python Developer (AI Integration) EUR 54K-84KAWS | Anthropic API | Azure | Azure OpenAI | CachingFlexible working hours | Indefinite contract | Knowledge sharing sessions | Mentorship | Professional development supportSenior-level Full TimeZagreb (Remote), Croatia (Hybrid) R1mo ago
-
Python Data Engineer (m/ž) EUR 16K-24KAI Agents | AI Pipelines | BigQuery | CI/CD | Cloud RunChild gift | Christmas bonus | Easter bonus | Flexible working hours | Google Cloud certificationsEntry-level Full TimeZagreb, Hrvatska (Hybrid) R1mo ago
-
Senior Data Engineer EUR 48K-70KAWS | Agile | Azure | Cloud Security | Data IngestionAnniversary bonus | Employee Share Purchase Plan ESPP | Employee Stock Options Grant | Flexible working hours | Full medical checkupSenior-level Full TimeRijeka or Zagreb, Croatia (Hybrid) R1mo ago