QA Testing Specialist Data Engineer
Tasks
- Define test scope and risk based coverage
- Design and execute test cases for ETL pipelines
- Develop Python validation scripts with PySpark and Pandas
- Develop SQL queries for data validation
- Investigate pipeline failures and data quality issues
- Log and manage defects in Jira
- Monitor Databricks jobs and workflow executions
- Perform end-to-end data validation
- Perform regression testing
- Provide release readiness quality communication and escalation
- Reconcile data completeness and accuracy
- Validate Databricks medallion architecture transformations
- Validate source-to-target mappings
Perks/Benefits
Skills/Tech-stack
Azure | CI/CD | Data Quality | Data Validation | Data Warehouse | Data warehouse testing | Databricks | ETL | Git | Jira | Pandas | PySpark | Python | Regression testing | SQL | Test automation | Warehouse testing
Education
N/A
Roles
Related jobs
-
ADK | APIs | Agent Development | Agent Development Kit | Agent systemsAccess to research and engineering experts | Collaborative culture | Travel opportunitiesSenior-level Full TimeDublin, Ireland1d ago
-
AI Data | AI Data Security | AISPM | AWS | AzureLong-term contract | Onsite work in DublinMid-level Full TimeDublin, Ireland1d ago
-
API Integration | Cloud Data | Cloud Data Warehouse | Data Contracts | Data IngestionCollaborative environment | Flexible working hours | Fully remote | High autonomy | Professional growth opportunitiesSenior-level Full TimeIreland R1d ago
-
Software Senior Engineer (Performance) EUR 82K-124KAI | API Design | Anomaly Detection | C# | C++Bonus programs | Career development opportunities | Employee benefits | Employee resource groups | Flexible work arrangementsSenior-level Full TimeCork, Co. Cork, Ireland1d ago
-
AI Research Engineer/Scientist (OpenVINO, NNCF) EUR 76K-120KDeep learning | Network Compression | Neural Network | Neural Network Compression | OpenVINOHybrid work model | On site and off site work optionMid-level Full TimeIRL - Leixlip, Ireland1d ago
-
Agentic AI - Lead Software Engineer EUR 48K-62KAI SDK | Agentic AI | Agents SDK | Automation | CI/CDSenior-level Full TimeDublin, Ireland1d ago
-
Agentic AI - Senior Software Engineer EUR 48K-62KAI SDK | AI orchestration | Agentic AI | Agents SDK | AutomationSenior-level Full TimeDublin, Ireland1d ago
-
Senior Engineer, Embedded Software EUR 54K-72KARM | Abstraction layer | Agile | Automated testing | BashCareer growth | Mentorship | Technical leadershipSenior-level Full TimeIreland, Cork1d ago
-
Embedded Software Test Engineer EUR 43K-70KAgile | Automated testing | Bitbucket Pipelines | Bug tracking | C#Career growth | Comprehensive benefits package | Flexible work schedulesMid-level Full TimeGalway, Ireland1d ago
-
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3Continuous learning | Flexible work arrangements | High ownership | Professional growthSenior-level Full TimeIreland2d ago
-
API | API Design | Backend architecture | Command Line | Command-line InterfaceCompany-provided equipment | Continuous learning allowance | Flexible working hours | Fully remote | Health insurance allowanceSenior-level Full TimeIreland R2d ago
-
Data Engineer EUR 54K-65KAzure Data | Azure Data Factory | Azure Databricks | Azure Pipelines | Data FactoryHybrid work | Paid time offEntry-level Full TimeIE - Dublin - Warrington Plc, …2d ago
-
APIs | AWS | Angular | Azure | Cloud ComputingChildcare | Company health insurance | Continuing education | Convert Pay To Time Off | Flexible working hoursMid-level Full TimeMünster, DE2d ago
-
Lead, Finance Analytics & Enablement AI/ML EUR 50K-61KAmplitude | Business Intelligence | Cloud platform | Data Modeling | Data ScienceFlexdesk Access Pass | Travel stipend | Work from homeSenior-level Full TimeIreland - Remote R3d ago
-
Machine Learning Engineer EUR 69K-100KAPI Integration | Algorithms | Amazon S3 | Apache Spark | Azure DataMid-level Full TimeDublin, Ireland3d ago
-
A/B | A/B Testing | AWS | Alerting | AzureFully remote Europe | Healthcare coverage | Paid parental leave | Professional growth | Relocation assistanceMid-level Full TimeIreland R3d ago
-
Mid-level Full TimeDublin, Ireland3d ago
-
AI engineer II EUR 49K-67KAPIs | Data Preparation | Deep learning | Distributed Systems | ExperimentationMid-level Full TimeDublin, Ireland3d ago
-
AWS | Automated testing | Azure | Data Pipelines | Experiment trackingSenior-level Full TimeDublin, Ireland3d ago
-
APIs | AWS | Automated testing | Azure | Cloud PlatformsSenior-level Full TimeDublin, Ireland3d ago
-
AWS | Access Control | Alerting | Automated testing | CI/CDSenior-level Full TimeDublin, Ireland3d ago
-
AI Native SW Engineer EUR 48K-62KAgent Orchestration | Anthropic API | Autogen | Braintrust | CI/CDEntry-level Full TimeDublin, 1 Grand Canal Square, Ireland3d ago
-
Forward Deployed Engineer EUR 50K-74KAPI Development | Agentic AI | Anthropic | Artificial Intelligence | CI/CDMid-level Full TimeDublin, 1 Grand Canal Square, Ireland3d ago
-
Cloud Backend Engineer (Database) PLN 220K-338KAWS RDS | Apache Druid | Apache Kafka | Apache Pinot | CassandraSenior-level Full TimeDublin, Ireland; Krakow, Poland3d ago
-
Data Engineer III (Databricks) EUR 64K-101KAWS | CI/CD | Configuration Management | Data Modeling | Data PipelinesCareer growth | Collaboration | Continuous improvementSenior-level Full TimeDublin, Ireland3d ago