Lead Data Platform Engineer | PGIM
IDA Business Park, Letterkenny, Co Donegal, Ireland
EUR 60K-72K (estimate) Senior-level Full Time
Tasks
- Build Fabric Lakehouse architectures
- Build star schemas and DAX measures
- Create conformed dimensions and fact tables
- Design and optimize Power BI semantic models
- Design end-to-end data pipelines
- Develop data transformation logic with PySpark and Spark SQL
- Document data models and operational runbooks
- Enforce data governance and access controls
- Implement data quality checks and validation
- Implement incremental loads and CDC
- Implement row level security and sensitivity labels
- Ingest and model marketing and customer data
- Mentor junior engineers
- Optimize storage formats and performance
- Perform data cleansing enrichment and deduplication
- Set up monitoring logging and alerting
- Support production support and on call rotations
Perks/Benefits
Skills/Tech-stack
Anomaly Detection | Azure CI | Azure CI/CD | CDC | CI/CD | DAX | Data Factory | Data Governance | Data Modeling | Data Quality | Data Validation | Delta Lake | Incremental loading | Lakehouse | Microsoft Fabric | Parquet | Power BI | PySpark | RLS | Row Level Security | SQL | Snowflake Schema | Spark SQL | Star Schema
Education
N/A
Related jobs
-
AI Agents | Agent workflows | CI/CD | Evaluation Frameworks | Language ModelsEquipment onboarding budget | Equity participation | Family-friendly benefits | Fully remote | Health insuranceMid-level Full TimeIreland R17h ago
-
Senior Expert (AI Engineering) EUR 63K-117KCloud deployment | Cross-validation | Deep learning | Distributed Training | Experiment trackingGlobal recognition programs | Hybrid work options | Insurance plans | Paid parental leave | Retirement plansSenior-level Full TimeDublin (NOCC), Ireland19h ago
-
Senior Data Engineer - Agents Systems GBP 97K-136KApache Flink | Data Contracts | Data Processing | Data Quality | Feature StoreSenior-level Full TimeUnited Kingdom1d ago
-
Senior Data Engineer - AI Infrastructure GBP 101K-136KApache Flink | Data Contracts | Data Pipelines | Data Quality | Feature StoreSenior-level Full TimeUnited Kingdom1d ago
-
AI DevOps Engineer EUR 71K-90KAPI Development | AWS CloudFormation | AWS IAM | AWS Lambda | Access ControlCareer development | Educational supportSenior-level Full TimeDublin, Co. Dublin, Ireland1d ago
-
Senior Expert Data Science, Scientific Innovation EUR 63K-117KArtificial Intelligence | Data Visualization | Deep learning | Machine Learning | PandasGlobal recognition programs | Hybrid work | Insurance plans | Paid parental leave | Retirement plansSenior-level Full TimeDublin (NOCC), Ireland1d ago
-
AWS Glue | AWS S3 | AWS Step Functions | Amazon Athena | Amazon EMRAutonomy | International collaborative environment | Remote friendly working within EuropeMid-level Full TimeIreland2d ago
-
Agentic AI - Senior Software Engineer EUR 54K-75KAI SDK | AI System Design | Agentic AI | Agents SDK | AutomationSenior-level Full TimeDublin, Ireland2d ago
-
SAS Data Engineer, Dublin EUR 49K-68KBase SAS | Batch scheduling | Cassandra | Change Management | DB2Employee assistance programme | Family leave options | Healthcare Scheme | Hybrid work option | Pension schemeMid-level Full TimeDublin, IE, IE2d ago
-
Data Engineer, 3P Geo Data Operations EUR 94K-96KData Analysis | Data Infrastructure | Data Modeling | Data Pipelines | DataflowMid-level Full TimeDublin, Ireland4d ago
-
AI Observability | AWS | Azure | CI/CD | Cloud ArchitectureCareer advancement | Collaborative engineering culture | Exposure to emerging technologies | Fully remote work | Leadership opportunitiesSenior-level Full TimeIreland R5d ago
-
Senior Analytics Engineer (AI & Quality) EUR 44K-57KCloud platform | Data Governance | Data Modeling | Data Quality | GitHubInternational team collaboration | Remote work | Supportive work environmentSenior-level Full TimeDublin, Ireland R5d ago
-
Senior Data Engineer EUR 70K-81KAWS Glue | Apache Hadoop | Apache NiFi | Apache Spark | AzureEnhanced leave options | Health and wellbeing supports | Hybrid work model | Pension and savings options | Training and coachingSenior-level Full TimeDublin, Ireland5d ago
-
Agentic Workflows | Context learning | Data Engineering | Deep learning | Diffusion ModelsContribution to open source community | On-site hybrid work | Open publication policyMid-level Full TimeDublin, 1 Grand Canal Square, Ireland6d ago
-
Lead Data Engineer – AI & Foundation Models EUR 49K-69KAccess Control | Apache Spark | Audit Logging | CI/CD | Data GovernanceSenior-level Full TimeDublin, Ireland6d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFlexible schedule | Part-time hours | Project based work | Remote workMid-level FreelanceIreland - Remote R6d ago
-
Senior-level Full TimeParkmore East Business Park, Galway Ireland7d ago
-
Senior-level Full TimeParkmore East Business Park, Galway Ireland7d ago
-
AI Coding Assistants | AI coding | Alerting | BigQuery | CI/CDContinuous improvement culture | Flexible working hours | High autonomy | Learning community access | Long-term ownershipSenior-level Full TimeIreland R8d ago
-
Apache Airflow | BigQuery | Cloud Composer | Cloud Migration | Cloud platformAgile collaborative environment | Flexible working arrangements | Hybrid work option | Professional development support | Remote work optionSenior-level Full TimeIreland8d ago
-
Senior-level Full TimeDublin, IRL, Ireland8d ago
-
AI/ML Agent Engineer — Front-End Focus EUR 60K-76KAngularJS | Authentication | Authorization | CI/CD | ClaudeMid-level Full TimeDublin, Ireland8d ago
-
Sr. Software Eng, Data Platforms EUR 70K-90KABAC | Amazon S3 | Apache Airflow | Apache Flink | Apache IcebergCareer development | Conference support | Global benefits | Hybrid remote friendly | Learning resources supportSenior-level Full TimeDublin, Ireland13d ago
-
Senior Data Engineer, Cybersecurity EUR 84K-126KAWS CDK | AWS Glue | AWS Step Functions | Alation | Amazon EMRFlexible work schedule | Hybrid work arrangementSenior-level Full TimeIreland, Dublin13d ago
-
AI & Data - AI Lab: AI Engineer - Agentic & Generative Intelligence - Senior/Assistant Manager EUR 60K-75KAWS | Azure | Azure OpenAI | CI/CD | Cloud platformAdditional annual leave purchase | Bike to work scheme | Career development | Cash incentives for referrals | Discounted health insuranceSenior-level Full TimeDublin 2, IE13d ago