Data Engineering Team Lead - Databricks
Dublin, County Dublin, Ireland
EUR 64K-74K (estimate) Senior-level Full Time
Tasks
- Apply IAM best practices
- Build ETL/ELT pipelines
- Configure and tune Spark jobs
- Design lakehouse data solutions
- Document technical designs
- Drive code reviews
- Drive design reviews
- Ensure Agile Scrum delivery
- Implement structured streaming workflows
- Lead data engineering team
- Maintain data security and governance
- Mentor data engineers
- Monitor data quality
- Monitor pipeline performance
- Promote continuous improvement
- Provision infrastructure with Terraform
- Use Delta Live Tables
- Use Unity Catalog
Perks/Benefits
Skills/Tech-stack
API Development | AWS Glue | AWS Lambda | AWS S3 | Agile | Apache Spark | Data Governance | Data Modeling | Data Security | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Git | IAM | Lakehouse Architecture | Python | SQL | Scrum | Structured Streaming | Terraform | Unity Catalog
Education
N/A
Related jobs
-
AWS | Agile | Apache Spark | Azure | Data ArchitectureCareer progression | Exposure to enterprise scale platforms | Guidance and tools | Leadership opportunitySenior-level Full TimeDublin, Ireland1d ago
-
Lead Data Scientist EUR 57K-81KA/B | A/B Testing | B testing | Clustering | ExcelBonus | Company sharesave scheme | Hybrid work | Learning fund | Paid volunteering timeSenior-level Full TimeDublin, Ireland1d ago
-
Senior Data Engineer, Healthcare Economics EUR 66K-120KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkEmployee donations matching | Lunch provided | Matching Pension Contribution | Private health insurance | Training opportunitiesSenior-level Full TimePrimary location: Dublin, Leinster1d ago
-
Senior-level Full TimeDublin, County Dublin, Ireland2d ago
-
Senior Data Engineer - Agents Systems GBP 97K-136KApache Flink | Data Contracts | Data Processing | Data Quality | Feature StoreSenior-level Full TimeUnited Kingdom3d ago
-
Senior Data Engineer - AI Infrastructure GBP 101K-136KApache Flink | Data Contracts | Data Pipelines | Data Quality | Feature StoreSenior-level Full TimeUnited Kingdom3d ago
-
AWS Glue | AWS S3 | AWS Step Functions | Amazon Athena | Amazon EMRAutonomy | International collaborative environment | Remote friendly working within EuropeMid-level Full TimeIreland3d ago
-
AI tools | Batch Processing | DBT | Data Engineering | Data MigrationAutonomy | Career growth opportunities | Inclusive culture | Learning and development | Supportive environmentSenior-level Full TimeIreland3d ago
-
Bash | Data Ingestion | Data Pipelines | Distributed Systems | DockerAccess to cutting edge AI and data technologies | Autonomy | Collaborative engineering culture | Distributed first work environment | Fully remoteMid-level Full TimeIreland R3d ago
-
Data Engineer EUR 56K-79KAWS Fargate | AWS Glue | AWS Lambda | Amazon Aurora | Amazon Aurora ServerlessAnnual leave | Career development | Company laptop | Company pension | E-learningSenior-level Full TimeDublin4d ago
-
SAS Data Engineer, Dublin EUR 49K-68KBase SAS | Batch scheduling | Cassandra | Change Management | DB2Employee assistance programme | Family leave options | Healthcare Scheme | Hybrid work option | Pension schemeMid-level Full TimeDublin, IE, IE4d ago
-
Data Engineer, 3P Geo Data Operations EUR 94K-96KData Analysis | Data Infrastructure | Data Modeling | Data Pipelines | DataflowMid-level Full TimeDublin, Ireland6d ago
-
AI Observability | AWS | Azure | CI/CD | Cloud ArchitectureCareer advancement | Collaborative engineering culture | Exposure to emerging technologies | Fully remote work | Leadership opportunitiesSenior-level Full TimeIreland R6d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunities | Laid-back atmosphere | Remote friendly distributed setupMid-level Full TimeDublin, Ireland7d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPMid-level Full TimeGalway, Ireland7d ago
-
Senior Data Engineer EUR 70K-81KAWS Glue | Apache Hadoop | Apache NiFi | Apache Spark | AzureEnhanced leave options | Health and wellbeing supports | Hybrid work model | Pension and savings options | Training and coachingSenior-level Full TimeDublin, Ireland7d ago
-
Lead Data Engineer – AI & Foundation Models EUR 49K-69KAccess Control | Apache Spark | Audit Logging | CI/CD | Data GovernanceSenior-level Full TimeDublin, Ireland8d ago
-
Director, Data engineering USD 170K-305KAWS | Apache Kafka | Apache Spark | DBT | Data ArchitectureExecutive-level Full TimeDublin, Ireland (Mountain View)9d ago
-
Senior-level Full TimeDublin, IRL, Ireland10d ago
-
Senior Data Engineer EUR 72K-100KAI Model Deployment | AI model | Agile | Apache Airflow | Architecture patternsSenior-level Full TimePrimary location: Dublin, Leinster10d ago
-
Data Quality Lead EUR 93K-139KData Controls | Data Governance | Data Lineage | Data Management | Data MonitoringEmployee assistance programme | Family leave options | Healthcare Scheme | Hybrid working | Pension schemeSenior-level Full TimeDublin, IE, IE13d ago
-
AI Lead, Manufacturing & Supply Chain EUR 84K-84KALCOA plus | Anomaly Detection | Artificial Intelligence | CSA | CSVHybrid work | In office minimum three days per week | Reasonable accommodationsSenior-level Full TimeIreland - Dublin College Park14d ago
-
Access Controls | Artificial Intelligence | Dashboard Development | Data Governance | Data LiteracyComprehensive health benefits | Mentorship | Professional growth opportunitiesSenior-level Full TimeCork, IRL - 3300 Cork Airport …14d ago
-
Senior-level Full TimeIreland - Dublin College Park14d ago
-
Senior Data Engineer, Cybersecurity EUR 84K-126KAWS CDK | AWS Glue | AWS Step Functions | Alation | Amazon EMRFlexible work schedule | Hybrid work arrangementSenior-level Full TimeIreland, Dublin15d ago