Senior Data Engineer
Tasks
- Analyze production issues and conduct root cause analysis
- Define and implement data quality frameworks metrics and controls
- Develop and validate data pipelines with PySpark and Databricks
- Execute source to target reconciliation
- Identify investigate and resolve data anomalies
- Implement proactive monitoring and automated quality checks
- Optimize data processing jobs for performance and scalability
- Perform end to end data pipeline validation
- Track and manage data defects through resolution
- Validate and monitor data across Databricks Lakehouse architecture
- Validate business rules and transformation logic
- Write advanced SQL for data profiling reconciliation and root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Web Services | Apache Airflow | Apache Kafka | Azure | CI/CD | Data Lakes | Data Observability | Data Quality | Data Warehousing | Databricks | Delta Lake | Dimensional Modeling | ELT | ETL | Google Cloud | HDFS | Hadoop | Hive | Lakehouse | PySpark | Python | SQL | Snowflake Schema | Spark | Star Schema | Unity Catalog | Web Services
Education
N/A
Roles
Data Engineer | Data Quality | Data Quality Engineer | Engineer | Quality Engineer
Related jobs
-
Lead AI Solutions Delivery Engineer EUR 80K-120KAI orchestration | API Integration | Autonomous Agents | C++ | Cloud SecuritySenior-level Full TimeDublin, Ireland R17h ago
-
Associate Technical Services Engineer II EUR 57K-80KAWS | Benchmarking | C Sharp | C plus plus | C#Mid-level Full TimeDublin, Ireland; Ireland2d ago
-
Databricks Expert EUR 93K-139KAWS | AWS IAM | AWS Lambda | Amazon EC2 | Amazon ECSEducational support | Health and wellness benefits | Professional development opportunitiesSenior-level Full TimeCork, Co. Cork, Ireland3d ago
-
Bash | Block Storage | CSI | Distributed Storage | File systemsCareer growth | Cross-functional exposure | Flexible work model | Inclusive equal opportunity | International diverse working environmentSenior-level Full TimeIreland R3d ago
-
Database Site Reliability Engineer EUR 49K-67KBackup and Recovery | Cloud Platforms | Database Administration | Database monitoring | Database performanceEntry-level ContractDublin, Ireland3d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Portfolio and LinkedIn optional | Remote/distributed workMid-level Full TimeCork, Ireland3d ago
-
Senior Embedded Software Engineer EUR 65K-98KADC | Bare Metal | C# | C++ | CI/CDFlexible benefits | Short-term incentive planSenior-level Full TimeIRL-G Galway Michael Collins, Ireland3d ago
-
Senior Embedded Software Engineer EUR 65K-98KADC | Bare Metal | C# | C++ | CI/CDFlexible benefits package | Short-Term IncentiveSenior-level Full TimeIRL-G Galway Michael Collins, Ireland3d ago
-
Lead Site Reliability Engineer (AI/ML) EUR 65K-75KAutomation | CI/CD | Cause analysis | Cloud | ContainerizationSenior-level Full TimeDublin, Ireland3d ago
-
API Development | AWS | Agile | Artificial Intelligence | CI/CDAnnual bonus | Annual leave | Family health insurance | Flexible work model | Inclusion and wellbeing initiativesSenior-level Full TimeEXMFG - Dublin, Ireland R3d ago
-
Senior Embedded Software Engineer EUR 65K-98KADC | Bare Metal | C# | C++ | CI/CDFlexible benefits packageSenior-level Full TimeIRL-G Galway Michael Collins, Ireland3d ago
-
Senior Embedded Software Engineer EUR 65K-98KADC | Bare Metal | C# | C++ | CI/CDFlexible benefits package | Short-term incentive plan (MIP)Senior-level Full TimeIRL-G Galway Michael Collins, Ireland3d ago
-
Senior AI Engineer – Notebooks EUR 56K-85KBackend Services | Evaluation | Go | LLM | Machine LearningCommunity guilds | Employee stock purchase plan | Hybrid workplace | Inclusion talks | Mentor programSenior-level Full TimeBordeaux, France; Dublin, Ireland; France, Remote; … R4d ago
-
Cassandra | Concurrency | Continuous integration | Data Structures | ElasticsearchDonation matching | Flexible location | Flexible schedules | Health coverage | Parental leaveSenior-level Full TimeIreland4d ago
-
Access Control | Anomaly Detection | CI/CD | Classification | Data GovernanceRemote working modelSenior-level Full TimeIreland4d ago
-
AI Security | API Development | Agent systems | Claude API | FastAPIContract engagement | Fully remote work | Hands On Advanced AI Platform Experience | International Technology FocusSenior-level Full TimeIreland R4d ago
-
Anomaly Detection | Apache Airflow | Azure Monitor | Cause analysis | Change PointSenior-level Full TimeCork, Co. Cork, Ireland4d ago
-
Adobe Campaign | Braze | Census | Consent Management | Cost OptimizationFixed-term contract | Learning opportunities | Meetups and events | Professional development opportunities | Remote-first workSenior-level Contract Full TimeIreland R4d ago
-
Senior AI Engineer EUR 39K-48KAI Agents | APIs | AWS Bedrock | AWS Lambda | Amazon ECS25 days annual leave | Charity and community activities | Flexible working arrangements | Hybrid work | IT CertificationsSenior-level Full TimeCarlow, Carlow, IRE, Ireland4d ago
-
Staff AI/ML Robotics Engineer EUR 54K-74KC++ | Domain Randomization | Inertial Measurement Units | Isaac Sim | LidarSenior-level Full TimeIreland, Limerick4d ago
-
Senior Analytics Engineer GBP 91K-110KAmazon Redshift | BigQuery | DBT | Data Modeling | Data MonitoringCorporate discounts | Dog friendly HQ | Flexible hours | Local meetups | Referral bonusesSenior-level Full TimeUnited Kingdom Remote R5d ago
-
Agentic AI Engineer EUR 75K-90KAgentic AI | BigQuery | Cloud Monitoring | Cloud Run | Cloud SchedulerAnnual learning budget | Equity participation | Health care | Home-office allowance | Leisure time insuranceMid-level Full TimeDublin R5d ago
-
Senior Machine Learning Engineer EUR 70K-80KBERT | Clustering | Computer Vision | Data Cleansing | Data ManipulationHybrid workSenior-level Full TimeDublin, Ireland R5d ago
-
Senior Data Engineer EUR 64K-96KAWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Data IntegrityComprehensive benefits package | Professional development opportunities | Work-life balanceSenior-level Full TimeIreland - Donegal Town : R2675d ago
-
ARM | C# | C++ | CI/CD | CMakeEntry-level Contract Full Time TemporaryTUAM - TUA1, Ireland5d ago