Senior QA Automation Engineer (AI & LLM Testing)
Tasks
- Build end to end UI automation with Playwright
- Collaborate with product managers, developers, and stakeholders
- Create prompt tests
- Define test strategies and communicate risks
- Develop automated test suites
- Evaluate LLM outputs for accuracy relevance consistency hallucinations
- Implement page object models
- Integrate tests with CI/CD pipelines
- Maintain Postman collections
- Maintain automated tests for web applications
- Participate in agile ceremonies
- Perform API testing
- Write Python scripts for test automation and evaluation
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | Agile | CI/CD | GitHub Copilot | Kanban | LLM Evaluation | Object model | Page Object | Page Object Model | Playwright | Postman | Prompt testing | Python | REST API | Scrum | Test automation
Education
N/A
Related jobs
-
Data Engineer-1 PLN 276K-276KAWS | AWS Glue | Apache Airflow | Azure Data | Azure Data FactoryEmployer supported pension plan | Extra paid holidays | Flexible benefits | Home-office allowance | Hybrid workMid-level Full TimeWarszawa, Mazowieckie, PL R3h ago
-
Computer Vision | Django | Edge AI | Flutter | PythonRemote work | Unpaid internshipEntry-level Full Time InternshipWarsaw, Poland (Remote) R18h ago
-
Application development | Asset Management | Data Analysis | Data Automation | Data ModelingDisability programs | Flexible working hours | Hybrid work model | Life insurance | Performance-based bonusSenior-level Full TimePL-PDK-WARSAW-ALEJA KRAKOWSKA 110/114 BLD 3014613, Poland R1d ago
-
Embedded Software Engineer (Poland) PLN 180K-338KAWS | Automated testing | Azure | BLE | BashEnglish teachers | Internal training programs | Medical insurance | Remote workSenior-level Full TimeKraków, Poland R2d ago
-
Senior Cloud Data Engineer (GCP) PLN 216K-300KApache Beam | CI/CD | Cloud Build | Cloud Functions | Cloud loggingAI tools | Certification support | Cloud training paid | Remote workSenior-level Full TimeGliwice R2d ago
-
Senior ML Ops Engineer PLN 267K-384KAWS | Azure | CI/CD | ClickHouse | Data PipelinesFlexible working hours | Fully remote | High impact | International team | Ship early ship oftenSenior-level Contract Full TimeWarsaw, Poland - Remote R2d ago
-
Entry-level Full TimeRemote - Poland R2d ago
-
AWS | Azure | Data Pipelines | ETL | Infrastructure as CodeEU time zones | Full-time | Fully remoteMid-level Full TimeWarszawa, Poland R2d ago
-
Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeWrocław, Lower Silesian Voivodeship, Poland R3d ago
-
Data Engineer (Azure Databricks) PLN 276K-276KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Big DataCertification programs | Health insurance | Internal mobility programs | Mentorship programs | Professional developmentMid-level Full TimeKraków, Lesser Poland Voivodeship, Poland R3d ago
-
Data Engineer (Azure Databricks) PLN 276K-276KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CDCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeWarsaw, Masovian Voivodeship, Poland R4d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internship opportunities | Mentorship | Professional development | Relocation programMid-level Full TimeKatowice, Silesian Voivodeship, Poland R4d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional development opportunitiesMid-level Full TimePoznań, Greater Poland Voivodeship, Poland R4d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional development programsMid-level Full TimeŁódź, Łódź Voivodeship, Poland R4d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeWrocław, Lower Silesian Voivodeship, Poland R4d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Mentorship | Professional development | Relocation program | Work from anywhereMid-level Full TimeWarsaw, Masovian Voivodeship, Poland R4d ago
-
Senior Data Engineer PLN 189K-328KAnomaly Detection | Auditing | Azure | Batch data | Batch data pipelinesPaid public holidays | Paid vacation | Private medical insurance | Professional growth opportunitiesSenior-level Full TimePoland - Remote R4d ago
-
Agent systems | Data Ingestion | Deep learning | Evaluation metrics | Fine TuningInternal mobility | Remote-friendly culture | Work/life balance focusSenior-level Full TimePoland, REMOTE, Poland R7d ago
-
Senior AI Engineer - Freelance USD 120K-130KAgent Orchestration | Agent systems | Amazon Bedrock | Conversational AI | Deterministic EvaluationAgile collaboration | Code review | Continuous integration | Flexibility | Growth opportunitiesSenior-level Contract FreelancePoland - Remote R8d ago
-
Analytics Engineer II PLN 226K-346KAlerting | Cost Optimization | DBT | Data Lineage | Data TestingDental insurance | Employee resource groups | Flexible spending wallets | Health insurance | Learning and development programsMid-level Full TimeRemote Poland R9d ago
-
Analytics Engineer (m/f/d) PLN 211K-320KDAX | Data Query | Data Query Optimization | Data Visualization | DatabricksCross functional international environment | Remote work option | Technology monitoring and choices | Training opportunitiesSenior-level Full TimeWarszawa, Województwo mazowieckie, Poland R9d ago
-
AI Agents | API Integration | AWS | Agent Orchestration | Backend DevelopmentEqual opportunity workplace | Remote workSenior-level Full TimePoland - Remote R10d ago
-
Data Engineer PLN 183K-320KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaAgile/Scrum environment | Flexible schedule | Flexible working hours | Hybrid workplace | Remote workplaceSenior-level Full TimePoland - Remote R10d ago
-
Data Engineer (m/f/d) PLN 276K-276KAWS | Ansible | Apache Airflow | Apache Kafka | Apache SparkInternational cross functional environment | Remote work option | Training opportunitiesMid-level Full TimeWarszawa, Województwo mazowieckie, Poland R10d ago
-
Mid/Senior AI engineer with networking experience PLN 250K-374KAPI Integration | Agentic Workflows | CI/CD | Data Validation | Deep learningFlexible working hours | Hybrid work | Professional training | Remote work | Training budgetSenior-level Full TimeWarszawa, Poland R10d ago