Senior Data Engineer - Delta Lake & dbt (Freelance possible)
Tasks
- Automate alerts and monitor pipeline runs
- Collaborate with reporting teams for dashboard data
- Design data ingestion pipelines
- Develop medallion lakehouse transformation models
- Ensure data pipeline reliability idempotence traceability
- Expose gold layer endpoints for BI dashboards
- Implement ETL ELT CDC processes
- Implement SCD2 history upsert append only logic
- Implement incremental batch and streaming ingestion
- Maintain Delta Lake tables and ACID transactions
- Manage data metadata and data lineage
- Orchestrate data assets and handle job failures
- Write governance documents and DUA SLA support
Perks/Benefits
Skills/Tech-stack
ACID | Apache Airflow | Apache Spark | Apache Superset | CDC | DBT | DWH | Dagster | Data Architecture | Data Catalog | Data Governance | Data Lineage | Data metadata | Data metadata management | Debezium | Delta Lake | DuckDB | Kafka | Lakehouse | Linux | Metadata Management | Microsoft SQL | Microsoft SQL Server | OpenShift | Pandas | PostgreSQL | Power BI | Powershell | Python | SQL | SQL Server | Time Travel
Education
N/A
Roles
Related jobs
-
Database Administrator (High Availability, Automation and Migration) for NATO with security clearance A EUR 53K-89KAuditing | Availability Groups | Azure | Azure SQL | Azure SQL Managed InstanceOn-site work environment | Security clearance requiredMid-level Full TimeBraine-l'Alleud, Belgium1d ago
-
Database Reliability Engineer — On-Premises and Cloud Platforms for NATO with security clearance A EUR 53K-80KAccess Control | Always On | Always On Availability | Always On Availability Groups | AuditingOn-site work | Security clearance supportMid-level Full TimeBraine-l'Alleud, Belgium1d ago
-
SQL Server and Azure Database Engineer (Always On, PostgreSQL, MongoDB) for NATO with security clearance A EUR 53K-99KAccess Control | Always On | Always On Availability | Always On Availability Groups | AuditingMid-level Full TimeBraine-l'Alleud, Belgium1d ago
-
Senior Data Engineer Consultant EUR 68K-88KApache Airflow | Apache Spark | Apache Superset | BI Report Server | Change Data CaptureLong-term mission | Skill enhancement opportunitiesSenior-level Full TimeBruxelles, Belgium1d ago
-
ARM | Ansible | Assembly | Bare Metal | C#Mid-level Full TimeZaventem, Belgium1d ago
-
AI engineer EUR 60K-84KAI Governance | API Integration | Artificial Intelligence | Automation | AzureAutonomy | Company car | Expense reimbursement | Flexible work environment | Health insuranceSenior-level Full TimeIeper, BE2d ago
-
Lead Analytics Engineer EUR 62K-86KAnalytics engineering | Conversational Analytics | DBT | Data Modeling | Data PipelinesBonus scheme | Company car | Continuous training | Flexible home office | Flexible locationsSenior-level Full TimeMechelen, Vlaams Gewest, Belgium2d ago
-
AI Foundry | AWS | AWS GovCloud | Agentforce | Agentic AI401k matching | Career development resources | Dental insurance | Flexible work arrangements | Health insuranceSenior-level Full TimeBelgium4d ago
-
Senior AI Engineer - Consultant EUR 54K-75KAnomaly Detection | Azure | CI/CD | Classification | Cloud platformExpense allowances | Flexible mobility | Housing budget | Hybrid working | Knowledge-sharing workshopsSenior-level Full TimeEvere, Belgium4d ago
-
Data Engineer - GenAI EUR 49K-72KAWS | Airflow | Azure | DBT | DagsterCollaborative workplace | Company car | Mobility budget | Premium insurance | Professional growthMid-level Full TimeBrussels-Capital, Belgium4d ago
-
Tech Lead - GenAI EUR 66K-87KAPI Development | Agent systems | Agentic AI | Cloud Computing | Code reviewSenior-level Full TimeBrussels-Capital, Belgium4d ago
-
Mainframe Storage Engineer 10931453 EUR 60K-96KBackup | Capacity Management | Data Integrity | Data Security | Disaster RecoverySenior-level Full TimeBrussels, Belgium4d ago
-
Data Analytics Engineer Job ID: JP055109 EUR 42K-60KAzure | Azure DevOps | DAX | DBT | Data MappingGood communication in Dutch English and French | Hybrid workingMid-level Full TimeBrussels, Belgium R4d ago
-
Azure Data Engineer Job ID: JP055100 EUR 54K-77KAPIs | Agile | Azure Data | Azure Data Factory | Azure DatabricksHybrid workSenior-level Full TimeAartselaar, Belgium R4d ago
-
Automation | Azure | Azure Data | Azure Data Explorer | CSVCross-functional collaboration | Exposure to large scale security telemetry | Opportunity to work in regulated financial services | Professional growth | Remote workMid-level Full TimeBelgium R4d ago
-
Senior Embedded Wireless Software Engineer EUR 57K-77K2.4 GHz | 2.4 GHz wireless | ARM | ARM microcontrollers | Angle of DepartureFlexible extra legal benefits | Growth opportunities | Homeworking | Life-work balance | Onsite training programSenior-level Full TimeBE Mechelen, Belgium5d ago
-
CLOUD AMAZE - Sr. DW Architect (Practice) EUR 63K-77KAWS | Analytics | Azure | Big Data | Data GovernanceSenior-level Full TimeBelgium5d ago
-
Fluid dynamics and machine learning expert EUR 61K-85KCFD | Computational Fluid Dynamics | Data Modeling | Fluid Dynamics | Machine LearningCompany car | Eco-cheques | Hybrid work options | Insurance coverage | Meal vouchersSenior-level Full TimeAntwerp, Antwerpen, Belgium R5d ago
-
Consultant Data Engineer - Google Cloud (GCP) EUR 80K-82KAuthentication | CI/CD | Certificate management | Cloud Architecture | Cloud StorageDiversity initiatives | Entrepreneurial culture | Knowledge sharing | Well-being supportEntry-level Full TimeBruxelles, Bruxelles, Belgium6d ago
-
BI Data Engineer EUR 52K-72KAzure Data | Azure Data Factory | CDC | CI/CD | CachingContinuous learning opportunities | Hospitalization plan | Hybrid working model | Meal allowance | Mobility budgetNone Full TimeBrussels, Brussels, Belgium R6d ago
-
Mid-level Full TimeBruxelles, Belgium6d ago
-
Azure | Azure Data | Azure Data Factory | Azure DevOps | BashCollaborative cross-functional environment | Hands on work with Databricks and Azure | Professional growthMid-level Full TimeBelgium6d ago
-
Consultant Data Engineer - Google Cloud (GCP) EUR 80K-82KCI/CD | Cloud platform | Docker | ETL | GCPEntry-level Full TimeBruxelles, Bruxelles, Belgium6d ago
-
Senior Data Engineer Consultant EUR 56K-79KAWS | Apache Spark | Batch Processing | CI/CD | Cloud platformFlexible working arrangements | International project exposure | Knowledge sharing | Training and developmentSenior-level Full TimeBrussel, Belgium6d ago
-
Azure DevOps | DAX | DBT | Data Vault | Data Vault 2.0Agile work environment | Career development budget | Company car or alternative allowance | Flexible freelance option | Training and certification supportMid-level FreelanceBrussels, Belgium6d ago