Lead Data Engineer
Tasks
- Build high performance data models
- Collaborate with API and analytics teams
- Coordinate offshore delivery
- Define tasks and review deliverables
- Design batch data pipelines
- Develop real-time data pipelines
- Drive coding standards testing and CI CD
- Ensure high availability and reliability
- Implement ETL and ELT frameworks
- Implement data quality validation and observability
- Optimize Lakehouse architectures
- Perform performance tuning and optimization
- Provide technical leadership for data engineering team
- Troubleshoot production data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | CI/CD | Confluent | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Skew | Databricks | ELT | ETL | Kafka | Lakehouse | Partitioning | Performance Tuning | Python | SQL | Scala | Spark SQL | Streaming
Education
N/A
Roles
Related jobs
-
Cloud Computing | Data poisoning | Deep learning | Distributed Computing | Hugging FaceLife insurance options | Mental health support | Private medical coverageSenior-level Full TimeDublin, County Dublin, Ireland21h ago
-
AI/ML Agent Engineer — Front-End Focus EUR 60K-76KAngularJS | Authentication | Authorization | CI/CD | ClaudeMid-level Full TimeDublin, Ireland21h ago
-
Attention Mechanism | CUDA | Custom Kernels | Distributed Training | FP8Career development | Collaborative innovation driven culture | Continuous learning | Flexible work environment | High autonomySenior-level Full TimeIreland1d ago
-
AWS | AWS Glue | AWS Kinesis | AWS Lake Formation | AWS LambdaAutonomy and ownership | Career growth | Collaborative cross-functional environment | Exposure to cutting edge AWS data and AI ML technologies | Flexible work cultureSenior-level Full TimeIreland R4d ago
-
API Integration | Agentic Workflows | Conversational AI | Distributed Systems | Error HandlingClient delivery ownership | Fully remote | High technical autonomy | Startup environment | Work flexibilitySenior-level Full TimeIreland R4d ago
-
AI Coding Assistants | AI coding | Alerting | BigQuery | CI/CDCollaborative supportive culture | Flexible work location | Fully remote | High autonomy and trust | Knowledge sharingSenior-level Full TimeIreland R4d ago
-
Forward Deployed Engineer, Google Cloud Consulting EUR 122K-126KAPI Integration | Agent systems | Cloud platform | Data Pipelines | Evaluation PipelinesMid-level Full TimeDublin, Ireland5d ago
-
Senior Security Engineer - Cloud SIEM EUR 60K-79KAI-powered workflows | AWS | Artificial Intelligence | Azure | Cloud SecurityCommunity guilds | Employee resource groups | Employee stock purchase plan | Inclusive culture | Mental health benefitsSenior-level Full TimeDublin, Ireland; Madrid, Spain; Paris, France5d ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Laid-back atmosphere | Portfolio and learning support | Remote first distributed teamMid-level Full TimeDublin, Ireland5d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible remote settingMid-level Full TimeCork, Ireland5d ago
-
Sr. Software Eng, Data Platforms EUR 70K-90KABAC | Amazon S3 | Apache Airflow | Apache Flink | Apache IcebergCareer development | Conference support | Global benefits | Hybrid remote friendly | Learning resources supportSenior-level Full TimeDublin, Ireland5d ago
-
Senior Data Engineer, Cybersecurity EUR 84K-126KAWS CDK | AWS Glue | AWS Step Functions | Alation | Amazon EMRFlexible work schedule | Hybrid work arrangementSenior-level Full TimeIreland, Dublin5d ago
-
AI & Data - AI Lab: AI Engineer - Agentic & Generative Intelligence - Senior/Assistant Manager EUR 60K-75KAWS | Azure | Azure OpenAI | CI/CD | Cloud platformAdditional annual leave purchase | Bike to work scheme | Career development | Cash incentives for referrals | Discounted health insuranceSenior-level Full TimeDublin 2, IE5d ago
-
Mid-level Full TimeIreland - Dublin5d ago
-
Assembly | C# | C++ | CMake | GerritBicycle Purchase Scheme | Education assistance | Employee Run Clubs | Employee stock purchase scheme | Income insuranceSenior-level Full TimeCork, Ireland5d ago
-
Mid-level Full TimeCork City, IE, T23 YY095d ago
-
Senior-level Full TimeDublin, Ireland5d ago
-
Senior-level Full TimeDublin, Ireland5d ago
-
Data Engineer - Microsoft Fabric EUR 50K-65KAgile | Data Cataloguing | Data Engineering | Data Governance | Data ModelingBike to work | Career progression | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeDublin, County Dublin, Ireland6d ago
-
Senior Machine Learning Engineer EUR 78K-102KAgent systems | Cloud Computing | Data Analysis | Data Visualization | Data WarehousingBuy and sell leave | Contributory pension | Cycle to work | Dining and leisure discounts | Discounted travel optionsSenior-level Full TimeIRL - County Wexford - Wexford, …6d ago
-
Hadoop Software Engineer EUR 56K-77KApache Spark | Concurrency | Data Structures | Data structures algorithms | HBaseMaternal leave | Paid sabbatical | Paternal LeaveMid-level Full TimeDublin, Ireland6d ago
-
C# | MATLAB | NumPy | Pandas | PythonPaid per project | Part time project based engagementSenior-level Full TimeIreland - Remote R6d ago
-
Analytics Engineer EUR 54K-67KAmazon Redshift | BigQuery | Business Intelligence | CTE | Continuous integrationAnnual leave | Bike to work scheme | Employee referral program | Flexible working hours | Health insuranceMid-level Full TimeGalway Ireland7d ago
-
Cloud Cost Optimization Engineer - 12 Month FTC EUR 65K-68KAWS | Azure | Cloud Cost Management | Cloud KPIs | Cloud OperationsSenior-level Contract Full Time TemporaryLimerick, Ireland7d ago
-
Mid-level Full TimeParkmore East Business Park, Galway Ireland7d ago