Data Engineering Lead
Tasks
- Build and optimize data pipelines for analytics and machine learning
- Collaborate on distributed systems and cloud based data platforms
- Define and evolve data architecture for scalability reliability performance
- Design and maintain reusable data products and frameworks
- Develop and maintain ETL and ELT pipelines
- Drive automation across data engineering and data science workflows
- Ensure data quality, reliability, and consistency
- Ensure engineering best practices and coding standards
- Integrate data from structured and unstructured sources
- Lead design and implementation of scalable data engineering solutions
- Mentor data engineers
- Optimize data processing performance
- Promote agile delivery and collaborative engineering
- Simplify complex systems and improve platform efficiency
- Support production deployment of data engineering solutions
- Translate business requirements into scalable technical solutions
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Apache Spark | Azure | Data Architecture | Databricks | Distributed Systems | ELT | ETL | Hadoop | Hive | Impala | Java | Nifi | NoSQL | Oozie | PySpark | Python | Relational databases | SQL | Scala | Sqoop
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Lead Data Analytics & AI Engineer EUR 78K-117KAPI | AWS | Amazon Kinesis | Apache Airflow | Apache FlinkHealth insurance | Hybrid work | Long-term illness protection | Pension | Referral bonusSenior-level Full TimeIE Dublin, Ireland R1d ago
-
Senior Manager of Data Engineering EUR 64K-89KAWS | Access Control | Apache Spark | CI/CD | Data GovernanceSenior-level Full TimeDublin, Ireland3d ago
-
FS Technology Consulting - AI and Data - AI Architecture & Engineering Lead- Senior Manager - Dublin EUR 63K-80KAI Act | AWS | Agentic AI | Audit Logging | AzureAdditional annual leave purchase | Bike to work scheme | Discounted health insurance | Flexible working | Free Unlimited Online GP ConsultationsSenior-level Full TimeDublin 2, IE3d ago
-
AWS | Agile | Apache Spark | Azure | Data ArchitectureCareer progression | Exposure to big data cloud and analytics ecosystems | Leadership opportunity | Work on enterprise scale platformsSenior-level Full TimeDublin, Ireland6d ago
-
.NET | AI Act | AI Foundry | Access Control | Audit LoggingBike to work | Career progression | Educational assistance | Employee Pension Matching | Employee assistance programmeSenior-level Full TimeDublin, County Dublin, Ireland7d ago
-
Lead Software Engineer (Big Data) EUR 70K-105KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaInclusive team culture | Mentorship | Remote work flexibilitySenior-level Full TimeDublin, Ireland7d ago
-
Alerting | Auditing | Backend systems | Batch Processing | CI/CDContinuous improvement | Cross-functional collaboration | Engineering excellence culture | Flexibility across Europe | Leadership opportunitiesMid-level Full TimeIreland8d ago
-
Automation | Big Data | CI/CD | Cloud infrastructure | Cloud platformFlexibility to work from anywhere | Leadership ownership of critical systems | Remote-first work environment | Work-life balance cultureExecutive-level Full TimeIreland R8d ago
-
Applied AI Lead - Risk EUR 70K-105KCredit Risk | Data Pipelines | Deep learning | Experimentation | Language ProcessingSenior-level Full TimeIRL Dublin, Ireland8d ago
-
Lead Machine Learning Engineer EUR 82K-120KComputer Vision | Data Processing | Data cleaning | Deep learning | Document UnderstandingContinuous learning support | Hybrid work scheduleSenior-level Full TimeDublin, Ireland10d ago
-
Head of AI Innovation Lab EUR 93K-128KAI Governance | Algorithms | Artificial Intelligence | BQML | Code QualityContributory pension | Cycle to work | Discounted travel | Discounts | Enhanced maternity payExecutive-level Full TimeIRL - Dublin, Ireland10d ago
-
Data & Analytics Lead - Manager EUR 38K-50KAnalytics | Artificial Intelligence | Data Governance | Data Management | Data QualitySenior-level Full TimeDublin - One Spencer Dock, Ireland10d ago
-
Principal Data Engineer EUR 60K-74KAI Assisted Development | AWS | Code Quality | Compliance | Data ArchitectureAccredited training courses | Dental insurance | Enhanced leave | Family-friendly policies | Learning and development opportunitiesSenior-level Full TimeDublin, D, Ireland15d ago
-
Senior Software Engineer, Analytics Platform EUR 56K-88KAWS | Ansible | Apache Druid | Apache Flink | Apache KafkaCareer development | Dental plan | Hybrid work options | Mentoring | Paid Maternity LeaveSenior-level Full TimeVirtual Office (Ireland) R16d ago
-
Senior-level Full TimeDublin, Ireland17d ago
-
Lead Data Scientist EUR 57K-81KA/B | A/B Testing | B testing | Clustering | ExcelBonus | Company sharesave scheme | Hybrid work | Learning fund | Paid volunteering timeSenior-level Full TimeDublin, Ireland21d ago
-
Data Engineering Team Lead - Databricks EUR 64K-74KAPI Development | AWS Glue | AWS Lambda | AWS S3 | AgilePermanent contractSenior-level Full TimeDublin, County Dublin, Ireland22d ago
-
Director, Data engineering USD 170K-305KAWS | Apache Kafka | Apache Spark | DBT | Data ArchitectureExecutive-level Full TimeDublin, Ireland (Mountain View)29d ago
-
Senior-level Full TimeDublin, Ireland1mo ago
-
Director of Data Engineering EUR 140K-200KAI Integrated Data Processing | Automation | Cloud Budgeting | Cost Optimization | Data EngineeringExecutive-level Full TimeDublin, Ireland1mo ago
-
Electrical maintenance | Industrial robotics | Logistics | Materials handling | Mechanical maintenanceSenior-level Full TimeDublin, County Dublin, Ireland1mo ago
-
AI Foundry | AKS | API Management | ARM Templates | AWS24 days holiday allowance | Bike to work | Career progression mentorship | Educational assistance | Employee assistance programSenior-level Full TimeDublin, County Dublin, Ireland1mo ago
-
Analytics Team Lead EUR 85K-128KAI Assisted Development | API Development | API Gateway | AWS | AWS CloudFormationFlexible working arrangements | Training and education supportSenior-level Full TimeDublin, Co. Dublin, Ireland1mo ago
-
Head of Data Governance, Anonymization and Quality EUR 101K-112KArtificial Intelligence | Bioinformatics | Biostatistics | Clinical data | Data ArchitectureExecutive-level Full TimeDublin (NOCC), Ireland1mo ago