Data Engineering Team Lead - Databricks
Dublin, County Dublin, Ireland
EUR 64K-74K (estimate) Senior-level Full Time
Tasks
- Apply IAM best practices
- Build ETL/ELT pipelines
- Configure and tune Spark jobs
- Design lakehouse data solutions
- Document technical designs
- Drive code reviews
- Drive design reviews
- Ensure Agile Scrum delivery
- Implement structured streaming workflows
- Lead data engineering team
- Maintain data security and governance
- Mentor data engineers
- Monitor data quality
- Monitor pipeline performance
- Promote continuous improvement
- Provision infrastructure with Terraform
- Use Delta Live Tables
- Use Unity Catalog
Perks/Benefits
Skills/Tech-stack
API Development | AWS Glue | AWS Lambda | AWS S3 | Agile | Apache Spark | Data Governance | Data Modeling | Data Security | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Git | IAM | Lakehouse Architecture | Python | SQL | Scrum | Structured Streaming | Terraform | Unity Catalog
Education
N/A
Related jobs
-
Apache Airflow | BI platforms | CRM Data Platforms | CRM data | Customer DataCollaborative culture | Continuous learning culture | Flexible work location | Inclusive workplace | Professional growthSenior-level Full TimeIreland11h ago
-
Senior Data Engineer EUR 75K-111KAlerting | CI/CD | Data Architecture | Data Catalog | Data EngineeringSenior-level Full TimeDublin, Ireland1d ago
-
Lead Data Analytics & AI Engineer EUR 78K-117KAPI | AWS | Amazon Kinesis | Apache Airflow | Apache FlinkHealth insurance | Hybrid work | Long-term illness protection | Pension | Referral bonusSenior-level Full TimeIE Dublin, Ireland R1d ago
-
AWS | Amazon Redshift | BigQuery | DBT | Data ModelingAnnual leave | Home office setup | Inclusive culture | Pension contribution | Regular offsitesSenior-level Full TimeIreland2d ago
-
EMEA Data & Digital Program Manager EUR 44K-55KAI Vision | AWS CDK | AWS CloudFormation | AWS Glue | AWS LambdaMid-level Full TimeDublin, IRL2d ago
-
AWS | Analytics | Apache Hive | Apache Kafka | Apache SparkBike to work scheme | Flexible working | Free gym membership | Health insurance | Hybrid workingSenior-level Full TimeDublin 2, IE2d ago
-
GMP Data Governance & Engagement Lead EUR 67K-119KArticulate | CGMP | CGMP compliance | Data Governance | Data IntegritySenior-level Full TimeLimerick, Ireland2d ago
-
Senior Manager of Data Engineering EUR 64K-89KAWS | Access Control | Apache Spark | CI/CD | Data GovernanceSenior-level Full TimeDublin, Ireland3d ago
-
FS Technology Consulting - AI and Data - AI Architecture & Engineering Lead- Senior Manager - Dublin EUR 63K-80KAI Act | AWS | Agentic AI | Audit Logging | AzureAdditional annual leave purchase | Bike to work scheme | Discounted health insurance | Flexible working | Free Unlimited Online GP ConsultationsSenior-level Full TimeDublin 2, IE3d ago
-
Biological Structures Data Engineer I/II EUR 51K-76KAWS | Biology Data | CIF | Cloud Computing | Code reviewHoliday allowances | Hybrid work | Modern collaborative work environment | Pension contributionsMid-level Full TimeDublin Office6d ago
-
AWS | Agile | Apache Spark | Azure | Data ArchitectureCareer progression | Exposure to big data cloud and analytics ecosystems | Leadership opportunity | Work on enterprise scale platformsSenior-level Full TimeDublin, Ireland6d ago
-
.NET | AI Act | AI Foundry | Access Control | Audit LoggingBike to work | Career progression | Educational assistance | Employee Pension Matching | Employee assistance programmeSenior-level Full TimeDublin, County Dublin, Ireland7d ago
-
Quantitative Data Engineer EUR 55K-70KApache Spark | Cloud Architecture | DBT | Dagster | Data ArchitectureMid-level Full TimeDublin7d ago
-
Lead Software Engineer (Big Data) EUR 70K-105KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaInclusive team culture | Mentorship | Remote work flexibilitySenior-level Full TimeDublin, Ireland7d ago
-
Senior Data Analytics & AI Engineer EUR 65K-98KAPIs | AWS | Apache Airflow | CI/CD | DBTBonus plan | Health insurance | Hybrid work | Long-term illness protection | PensionSenior-level Full TimeIE Dublin, Ireland R7d ago
-
Alerting | Auditing | Backend systems | Batch Processing | CI/CDContinuous improvement | Cross-functional collaboration | Engineering excellence culture | Flexibility across Europe | Leadership opportunitiesMid-level Full TimeIreland8d ago
-
Senior Technical Solutions Consultant, Data Engineering EUR 120K-123KApache Flume | Apache Spark | Business Intelligence | Cloud Dataflow | Data EngineeringSenior-level Full TimeDublin, Ireland8d ago
-
Automation | Big Data | CI/CD | Cloud infrastructure | Cloud platformFlexibility to work from anywhere | Leadership ownership of critical systems | Remote-first work environment | Work-life balance cultureExecutive-level Full TimeIreland R8d ago
-
Applied AI Lead - Risk EUR 70K-105KCredit Risk | Data Pipelines | Deep learning | Experimentation | Language ProcessingSenior-level Full TimeIRL Dublin, Ireland8d ago
-
Senior-level Full TimeBengaluru, Karnataka, India; London, England, United …8d ago
-
Senior-level Full TimeIreland - Dublin - Hybrid R9d ago
-
Apache Airflow | BigQuery | Cloud platform | DBT | DataflowAnnual company off site events | Co-working space membership | ESOP equity participation | Flexible schedule | Fully remoteSenior-level Full TimeIreland R10d ago
-
Lead Machine Learning Engineer EUR 82K-120KComputer Vision | Data Processing | Data cleaning | Deep learning | Document UnderstandingContinuous learning support | Hybrid work scheduleSenior-level Full TimeDublin, Ireland10d ago
-
Head of AI Innovation Lab EUR 93K-128KAI Governance | Algorithms | Artificial Intelligence | BQML | Code QualityContributory pension | Cycle to work | Discounted travel | Discounts | Enhanced maternity payExecutive-level Full TimeIRL - Dublin, Ireland10d ago
-
Data & Analytics Lead - Manager EUR 38K-50KAnalytics | Artificial Intelligence | Data Governance | Data Management | Data QualitySenior-level Full TimeDublin - One Spencer Dock, Ireland10d ago