Team Lead - Databricks Engineer
Dublin, Co. Dublin, Ireland
EUR 70K-90K (estimate) Senior-level Full Time
Tasks
- Apply Unity Catalog and IAM best practices for security
- Build structured streaming pipelines for real time processing
- Collaborate on knowledge sharing
- Conduct code and design reviews
- Configure and optimize Databricks clusters and Spark jobs
- Design and develop Databricks lakehouse solutions
- Develop and optimize ETL/ELT pipelines
- Drive Agile Scrum SDLC process
- Implement Delta Live Tables for ingestion and transformations
- Implement monitoring for pipeline performance and data quality
- Lead and mentor data engineers
- Manage infrastructure and resource provisioning with Terraform
Perks/Benefits
Skills/Tech-stack
AWS | Data Modeling | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Git | Glue | IAM | Lakehouse | Lambda | Python | S3 | SQL | Spark | Streaming | Structured Streaming | Terraform | Unity Catalog
Education
N/A
Roles
Data Engineer | Engineer | Lead | Team Lead
Related jobs
-
AI Coding Assistants | AI coding | Alerting | BigQuery | CI/CDCollaborative supportive culture | Flexible work location | Fully remote | High autonomy and trust | Knowledge sharingSenior-level Full TimeIreland R1h ago
-
Forward Deployed Engineer, Google Cloud Consulting EUR 122K-126KAPI Integration | Agent systems | Cloud platform | Data Pipelines | Evaluation PipelinesMid-level Full TimeDublin, Ireland19h ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Laid-back atmosphere | Portfolio and learning support | Remote first distributed teamMid-level Full TimeDublin, Ireland1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible remote settingMid-level Full TimeCork, Ireland1d ago
-
Sr. Software Eng, Data Platforms EUR 70K-90KABAC | Amazon S3 | Apache Airflow | Apache Flink | Apache IcebergCareer development | Conference support | Global benefits | Hybrid remote friendly | Learning resources supportSenior-level Full TimeDublin, Ireland1d ago
-
Senior Data Engineer, Cybersecurity EUR 84K-126KAWS CDK | AWS Glue | AWS Step Functions | Alation | Amazon EMRFlexible work schedule | Hybrid work arrangementSenior-level Full TimeIreland, Dublin1d ago
-
Data Engineer - Microsoft Fabric EUR 50K-65KAgile | Data Cataloguing | Data Engineering | Data Governance | Data ModelingBike to work | Career progression | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeDublin, County Dublin, Ireland1d ago
-
Senior Machine Learning Engineer EUR 78K-102KAgent systems | Cloud Computing | Data Analysis | Data Visualization | Data WarehousingBuy and sell leave | Contributory pension | Cycle to work | Dining and leisure discounts | Discounted travel optionsSenior-level Full TimeIRL - County Wexford - Wexford, …2d ago
-
C# | MATLAB | NumPy | Pandas | PythonPaid per project | Part time project based engagementSenior-level Full TimeIreland - Remote R2d ago
-
Analytics Engineer EUR 54K-67KAmazon Redshift | BigQuery | Business Intelligence | CTE | Continuous integrationAnnual leave | Bike to work scheme | Employee referral program | Flexible working hours | Health insuranceMid-level Full TimeGalway Ireland2d ago
-
Mid-level Full TimeParkmore East Business Park, Galway Ireland3d ago
-
ASIC design | CAD | Graph Neural Networks | MLOps | Machine LearningBicycle Purchase Scheme | Education assistance | Employee Run Clubs | Employee stock purchase scheme | Employee wellness programsSenior-level Full TimeCork, Ireland3d ago
-
Entry-level Full TimeSun Life Ireland3d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible hours | Freelance project-based | Part-time | Remote workSenior-level FreelanceIreland - Remote R3d ago
-
Entry-level Full TimeSun Life Ireland3d ago
-
CI/CD | ClearML | Git | Go | KubeflowSenior-level Full TimeRemote Ireland R3d ago
-
Mid-level Full TimeParkmore East Business Park, Galway Ireland3d ago
-
AWS Aurora | Backup and Recovery | Capacity Planning | Database security | Database tuningAnnual retreats | Flexible working hours | High-quality equipment | Paid annual leave | Referral bonusesMid-level Full TimeIreland3d ago
-
AI GenAI Solution Lead EUR 54K-79KAI orchestration | AWS | Artificial Intelligence | Azure | Cloud ArchitectureSenior-level Full TimeAthlone,Westmeath,Ireland3d ago
-
AI Agents | APIs | Automation tools | Language Models | Large Language ModelsExposure to cutting-edge technologies | Fast paced learning experimentation culture | Fully remote | High autonomy | Location flexibilityMid-level Full TimeIreland R3d ago
-
Electrical maintenance | Industrial robotics | Logistics | Materials handling | Mechanical maintenanceSenior-level Full TimeDublin, County Dublin, Ireland4d ago
-
Sr Machine Learning Engineer EUR 69K-100KAWS | Azure | Data Modeling | Data Quality | Data WarehousingHealthcare coverage | Mental health resources | Paid time offSenior-level Full TimeIRL - County Dublin - Dublin …4d ago
-
Clinical Data Analytics Lead EUR 65K-70KAnomaly Detection | Clinical Data Interchange Standards | Clinical data | Clinical data management | Clinical trialsHybrid work | Onsite days 12 per monthSenior-level Full TimeDublin (NOCC), Ireland4d ago
-
Clinical Data Analytics Lead EUR 70K-70KAnomaly Detection | Clinical data | Clinical data management | Clinical programming | Data GovernanceHybrid work | Onsite days per monthSenior-level Full TimeDublin (NOCC), Ireland4d ago
-
Senior Azure DevOps Engineer (MLOps) EUR 75K-95KAzure DevOps | Azure Kubernetes | Azure Kubernetes Service | Azure Machine Learning | Azure MonitorEmployee discount | Flexible working | Gym discounts | Life assurance | Mentorship coachingSenior-level Full TimeDublin, County Dublin, Ireland6d ago