Data Engineering Lead
Tasks
- Build and optimize data pipelines for analytics and machine learning
- Collaborate on distributed systems and cloud based data platforms
- Define and evolve data architecture for scalability reliability performance
- Design and maintain reusable data products and frameworks
- Develop and maintain ETL and ELT pipelines
- Drive automation across data engineering and data science workflows
- Ensure data quality, reliability, and consistency
- Ensure engineering best practices and coding standards
- Integrate data from structured and unstructured sources
- Lead design and implementation of scalable data engineering solutions
- Mentor data engineers
- Optimize data processing performance
- Promote agile delivery and collaborative engineering
- Simplify complex systems and improve platform efficiency
- Support production deployment of data engineering solutions
- Translate business requirements into scalable technical solutions
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Apache Spark | Azure | Data Architecture | Databricks | Distributed Systems | ELT | ETL | Hadoop | Hive | Impala | Java | Nifi | NoSQL | Oozie | PySpark | Python | Relational databases | SQL | Scala | Sqoop
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Lead Data Scientist EUR 57K-81KA/B | A/B Testing | B testing | Clustering | ExcelBonus | Company sharesave scheme | Hybrid work | Learning fund | Paid volunteering timeSenior-level Full TimeDublin, Ireland1d ago
-
Data Engineering Team Lead - Databricks EUR 64K-74KAPI Development | AWS Glue | AWS Lambda | AWS S3 | AgilePermanent contractSenior-level Full TimeDublin, County Dublin, Ireland2d ago
-
AI Observability | AWS | Azure | CI/CD | Cloud ArchitectureCareer advancement | Collaborative engineering culture | Exposure to emerging technologies | Fully remote work | Leadership opportunitiesSenior-level Full TimeIreland R7d ago
-
Lead Data Engineer – AI & Foundation Models EUR 49K-69KAccess Control | Apache Spark | Audit Logging | CI/CD | Data GovernanceSenior-level Full TimeDublin, Ireland8d ago
-
Director, Data engineering USD 170K-305KAWS | Apache Kafka | Apache Spark | DBT | Data ArchitectureExecutive-level Full TimeDublin, Ireland (Mountain View)9d ago
-
Access Controls | Artificial Intelligence | Dashboard Development | Data Governance | Data LiteracyComprehensive health benefits | Mentorship | Professional growth opportunitiesSenior-level Full TimeCork, IRL - 3300 Cork Airport …14d ago
-
Senior-level Full TimeDublin, Ireland15d ago
-
Director of Data Engineering EUR 140K-200KAI Integrated Data Processing | Automation | Cloud Budgeting | Cost Optimization | Data EngineeringExecutive-level Full TimeDublin, Ireland17d ago
-
Electrical maintenance | Industrial robotics | Logistics | Materials handling | Mechanical maintenanceSenior-level Full TimeDublin, County Dublin, Ireland18d ago
-
AI Foundry | AKS | API Management | ARM Templates | AWS24 days holiday allowance | Bike to work | Career progression mentorship | Educational assistance | Employee assistance programSenior-level Full TimeDublin, County Dublin, Ireland20d ago
-
Lead AI Engineer EUR 67K-93KAI | CI/CD | Docker | ETL | KubernetesFlexible work environment | Hybrid work 3 days per week on site | Professional development opportunities | Supportive leadersSenior-level Full TimeDublin - Charlotte, Ireland R24d ago
-
Lead Analyst, Data Analytics EUR 54K-70KBusiness Intelligence | Data Analysis | Data Visualization | Microsoft Excel | Power BICorporate bonus | Healthcare | Hybrid working | Life assurance | PensionSenior-level Full TimeCork, Carrigtwohill IDA Business & Technology …24d ago
-
Director of Data (Analytics Engineering), Monopoly GO! GBP 145K-184KAI | Analytics engineering | Data Engineering | Data Modeling | Data WarehouseHybrid work options | Remote work flexibilityExecutive-level Full TimeES - Spain; GB - United … R25d ago
-
Analytics Team Lead EUR 85K-128KAI Assisted Development | API Development | API Gateway | AWS | AWS CloudFormationFlexible working arrangements | Training and education supportSenior-level Full TimeDublin, Co. Dublin, Ireland1mo ago
-
Head of Data Governance, Anonymization and Quality EUR 101K-112KArtificial Intelligence | Bioinformatics | Biostatistics | Clinical data | Data ArchitectureExecutive-level Full TimeDublin (NOCC), Ireland1mo ago
-
Media Insights & Analytics Lead GBP 70K-90KAttribution Modeling | Experimentation | Identity resolution | Incrementality testing | Marketing MixConference Courses Books Development | Health benefits | Mental health care program | Paid time off | Parental leave programSenior-level Full TimeIreland; United Kingdom R1mo ago
-
Senior-level Full TimeDublin, 1 Grand Canal Square, Ireland1mo ago
-
Engineering Manager, Data Engineering EUR 68K-84KAmazon Redshift | Apache Airflow | BigQuery | CI/CD | DBTCompany events | Health & dental care | Hybrid work | Paid parental leave | Paid sabbaticalMid-level Full TimeGalway, Ireland1mo ago
-
Lead Data Scientist (Brightflag) EUR 57K-85KAWS | Bash | CI/CD | DBSCAN | Docker25 days holidays | Flexible work location | Flexible work patterns | Health insurance | Life insuranceSenior-level Full TimeIRL-Dublin-Le Pole House-Ship Street Great, Ireland R1mo ago
-
Team Lead - Databricks Engineer EUR 70K-90KAWS | Data Modeling | Databricks | Delta Lake | Delta Live TablesEducation support | Flexible working arrangements | Training supportSenior-level Full TimeDublin, Co. Dublin, Ireland1mo ago