QA Testing Specialist Data Engineer
Tasks
- Define test scope and risk based coverage
- Design and execute test cases for ETL pipelines
- Develop Python validation scripts with PySpark and Pandas
- Develop SQL queries for data validation
- Investigate pipeline failures and data quality issues
- Log and manage defects in Jira
- Monitor Databricks jobs and workflow executions
- Perform end-to-end data validation
- Perform regression testing
- Provide release readiness quality communication and escalation
- Reconcile data completeness and accuracy
- Validate Databricks medallion architecture transformations
- Validate source-to-target mappings
Perks/Benefits
Skills/Tech-stack
Azure | CI/CD | Data Quality | Data Validation | Data Warehouse | Data warehouse testing | Databricks | ETL | Git | Jira | Pandas | PySpark | Python | Regression testing | SQL | Test automation | Warehouse testing
Education
N/A
Roles
Related jobs
-
Werkstudent KI & Data Science (m/w/d) EUR 12K-18KAgile | Cloud Run | Cloud platform | Docker | GitCompany bike | Employee discount | Flexible work | Open team culture | Public transport discountEntry-level Part TimeMünster, NRW, Germany19h ago
-
AI Agents | API | AWS | AWS Bedrock | Access ControlAsynchronous collaboration | Distributed international team | Flexible parental leave | Fully remote | Mental health supportSenior-level Full TimeIreland R1d ago
-
Senior Data Engineer-Product Data Quality EUR 66K-85KAWS | Airflow | CI/CD | Cloud Architecture | Data EngineeringCommuter tickets | Cycle to work scheme | Dental insurance | Employee shares program | Ergonomic workstation allowanceSenior-level Full TimeDublin, Ireland1d ago
-
Senior Data Engineer EUR 80K-125KAgile | Airflow | Azure Blob | Azure Blob Storage | Azure DataCareer development | Comprehensive benefits | Hybrid work modelSenior-level Full TimeDublin, Leinster, IRELAND; Letterkenny, Ulster, IRELAND1d ago
-
Machine Learning Engineer EUR 45K-70KAWS Bedrock | AWS Lambda | AWS SageMaker | Apache Airflow | Automated testingIncome protection insurance | Learning initiatives | Life assurance | Pension | Private healthcareMid-level Full TimeDublin, Leinster, Ireland R1d ago
-
API Development | Automated testing | Backend Development | CI/CD | Cloud infrastructureFoundational ownership | Full-time position | Fully remote work | High autonomyMid-level Full TimeIreland R1d ago
-
Senior AI Engineer PLN 230K-250KAPIs | Agile | Alerting | Azure | Azure DevOpsAccess to learning university | Annual paid leave | Hybrid work model | Remote work flexibility | Volunteering daysSenior-level Full TimeDublin, Co. Dublin, Ireland1d ago
-
Automated Workflows | CI/CD | Cloud Computing | Computer Vision | Data LineageCollaborative environment | Inclusive workplace | Opportunity to work on advanced ML challenges | Professional growth opportunitiesSenior-level Full TimeIreland1d ago
-
Azure | Azure Data | Azure Data Factory | Azure DevOps | BashCollaborative work environment | Exposure to infrastructure as code and automation | Hands on experience with Databricks and Azure | Professional growthMid-level Full TimeIreland1d ago
-
Senior AI/ML Computational Scientist EUR 53K-58KAlerting | Big Data | C++ | Cloud Computing | Computer ArchitectureSenior-level Full TimeDublin, 1 Grand Canal Square, Ireland2d ago
-
AWS | Angular | Cloud Resource Management | Data Analysis | Data PipelinesRemote workEntry-level Full TimeIR, Dublin, Ireland R2d ago
-
Staff Engineer, Compute EUR 100KAWS | Azure | Capacity Planning | Distributed Systems | GoBuddy program | Career development | Employee stock purchase plan | Hybrid work environment | Inclusive workplace cultureSenior-level Full TimeDublin, Ireland; Madrid, Spain; Paris, France R2d ago
-
Staff Data Engineer - GTM GBP 70K-85KApache Airflow | CCPA | Clay | Crawling | DBTComprehensive health insurance | Cycle to work scheme | Dental insurance | Flexible paid time off | Hybrid work policySenior-level Full TimeDublin, Ireland; London, England R2d ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible environment | Impactful product | Remote-friendlyMid-level Full TimeDublin, Ireland3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible, hands-off management | Opportunity to work on learning focused products | Supportive team environmentMid-level Full TimeGalway, Ireland3d ago
-
Staff Robotics Test Engineer, AI/ML Software EUR 54K-72KABAQUS | ANSYS | C++ | COMSOL | Data GenerationSenior-level Full TimeIreland, Limerick3d ago
-
Principal AI/ML Engineer (Robotics) EUR 54K-75KCI/CD | Computer Vision | Decision Making | Decision making under uncertainty | DockerSenior-level Full TimeIreland, Limerick3d ago
-
Manager, PDS BI&T - AI Engineering & Enablement EUR 65K-92KAWS | AWS Lambda | Agile | Amazon Bedrock | Amazon EKSAnnual bonus | Annual leave | Family health insurance | Hybrid work | Life assuranceMid-level Full TimeEXMFG - Dublin, Ireland R3d ago
-
Senior-level Full TimeDublin, Ireland3d ago
-
Senior AI Engineer EUR 73K-86KAI Agent | AWS | Adversarial Prompt Injection | Agent architecture | AzureAnnual company offsite | Dedicated team offsite | Health insurance | Paid time off | Stock optionsSenior-level Full TimeRemote R3d ago
-
Airflow | Computer Vision | DBT | Dagster | Data PipelinesFully Remote Working Environment | Meaningful ownership of machine learning products | Production ML systems focus | Remote cross time zone collaborationSenior-level Full TimeIreland R3d ago
-
Senior Analytics Engineer EUR 65K-102KData Modeling | Data Observability | Data Quality | Data Visualization | Data profilingCareer development opportunities | Comprehensive benefits | Flexible work hours | Hybrid work arrangementSenior-level Full TimeDublin, Leinster, IRELAND; Letterkenny, Ulster, IRELAND4d ago
-
Data Engineer EUR 78K-117KAPI Integration | CI/CD | Data Governance | Data Ingestion | Data LakesCareer development opportunities | Comprehensive benefits | Flexible work arrangements | Hybrid work model | TelecommutingMid-level Full TimeLetterkenny, Ulster, IRELAND; Dublin, Leinster, IRELAND4d ago
-
Senior AI Engineer EUR 40K-58KAWS Bedrock | Azure Cognitive | Azure Cognitive Search | Azure ML | Azure OpenAIHybrid work | Relocation assistanceSenior-level Full TimeIRL Cork Albert Quay, Ireland R7d ago
-
Senior Machine Learning Engineer EUR 64K-79KAWS | AWS CloudFormation | Amazon SageMaker | Apache Airflow | Apache KafkaFlexible schedule | Remote friendly overlap hoursSenior-level Full TimeDublin, Ireland7d ago