Big Data Principal
Tasks
- Build enterprise data pipelines
- Develop PySpark and Spark SQL solutions
- Implement engineering standards code quality testing and documentation
- Industrialize notebooks into governed assets
- Integrate GenAI tools for data engineering productivity
- Manage data pipeline lifecycle using Azure tools
- Set up CI CD and version control workflows
- Tune Spark performance
Perks/Benefits
- N/A
Skills/Tech-stack
Azure DevOps | CI/CD | Data Engineering | Databricks | Databricks Genie | GenAI | Logging | Notebooks | Performance Tuning | PySpark | Spark SQL | Testing | Version control | Workflows
Education
N/A
Related jobs
-
Junior AI & Data Analyst EUR 31K-37KAI Services | API | Azure AI | Azure AI Services | Azure CopilotCoaching and Mentorship | International collaboration | Personalized growth path | Training and learning opportunitiesEntry-level Full TimeIxelles, Bruxelles, Belgium1d ago
-
Databricks Engineer EUR 64K-88KAmazon Web Services | Apache Spark | Azure | CI/CD | DatabricksCoaching | Great Place to Work certification | Growth opportunities | Learning and developmentSenior-level Full TimeHeverlee - Berchem - Gent - …1d ago
-
Access Control | Audit Logging | CI/CD | Data Governance | Deep learningCompetitive salary | Remote working model | Work on cutting-edge AI solutionsSenior-level Full TimeBelgium2d ago
-
Data Analyst EUR 42K-72KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCompany car or mobility budget | Comprehensive insurance | Continuous learning opportunities | Indefinite contract | Laptop providedMid-level Full TimeBrussels/Flanders, Belgium2d ago
-
Senior Database Engineer (PostgreSQL 12+, MySQL 8+, High Availability) for NATO with security clearance A EUR 80K-80KAccess Control | Archiving | Backup and Recovery | Capacity Planning | ClusteringOn-site workSenior-level Full TimeBrussels, Belgium2d ago
-
API Design | Access Control | CI/CD | CQRS | Data GovernanceSenior-level Full TimeBruxelles Avenue Marnix (ING), Belgium4d ago
-
AI Engineer EUR 49K-67KAI Agents | AI Foundry | API Integration | APIs | Azure AIElectric company car | Flexible environment | Growth opportunities | Hybrid work | Travel opportunitiesMid-level Full TimeAalst, Vlaams Gewest, Belgium R4d ago
-
SQL Server and Azure Database Engineer (Always On, PostgreSQL, MongoDB) for NATO with security clearance A EUR 53K-99KAccess Control | Always On | Always On Availability | Always On Availability Groups | AuditingMid-level Full TimeBraine-l'Alleud, Belgium5d ago
-
Senior Data Engineer Consultant EUR 68K-88KApache Airflow | Apache Spark | Apache Superset | BI Report Server | Change Data CaptureLong-term mission | Skill enhancement opportunitiesSenior-level Full TimeBruxelles, Belgium5d ago
-
ARM | Ansible | Assembly | Bare Metal | C#Mid-level Full TimeZaventem, Belgium5d ago
-
Lead Analytics Engineer EUR 62K-86KAnalytics engineering | Conversational Analytics | DBT | Data Modeling | Data PipelinesBonus scheme | Company car | Continuous training | Flexible home office | Flexible locationsSenior-level Full TimeMechelen, Vlaams Gewest, Belgium6d ago
-
Senior AI Engineer - Consultant EUR 54K-75KAnomaly Detection | Azure | CI/CD | Classification | Cloud platformExpense allowances | Flexible mobility | Housing budget | Hybrid working | Knowledge-sharing workshopsSenior-level Full TimeEvere, Belgium8d ago
-
Data Engineer - GenAI EUR 49K-72KAWS | Airflow | Azure | DBT | DagsterCollaborative workplace | Company car | Mobility budget | Premium insurance | Professional growthMid-level Full TimeBrussels-Capital, Belgium8d ago
-
Data Analytics Engineer Job ID: JP055109 EUR 42K-60KAzure | Azure DevOps | DAX | DBT | Data MappingGood communication in Dutch English and French | Hybrid workingMid-level Full TimeBrussels, Belgium R8d ago
-
Azure Data Engineer Job ID: JP055100 EUR 54K-77KAPIs | Agile | Azure Data | Azure Data Factory | Azure DatabricksHybrid workSenior-level Full TimeAartselaar, Belgium R8d ago
-
Consultant Data Engineer - Google Cloud (GCP) EUR 80K-82KAuthentication | CI/CD | Certificate management | Cloud Architecture | Cloud StorageDiversity initiatives | Entrepreneurial culture | Knowledge sharing | Well-being supportEntry-level Full TimeBruxelles, Bruxelles, Belgium10d ago
-
BI Data Engineer EUR 52K-72KAzure Data | Azure Data Factory | CDC | CI/CD | CachingContinuous learning opportunities | Hospitalization plan | Hybrid working model | Meal allowance | Mobility budgetNone Full TimeBrussels, Brussels, Belgium R10d ago
-
AI Engineer EUR 54K-74KAdvanced search | Agents | Automated testing | CI/CD | ChunkingGroup insurance | Hospitalisation | Learning and development budget | Meal vouchers | Mobility budgetEntry-level Full TimeBelgium10d ago
-
Consultant Data Engineer - Google Cloud (GCP) EUR 80K-82KCI/CD | Cloud platform | Docker | ETL | GCPEntry-level Full TimeBruxelles, Bruxelles, Belgium10d ago
-
Senior Data Engineer Consultant EUR 56K-79KAWS | Apache Spark | Batch Processing | CI/CD | Cloud platformFlexible working arrangements | International project exposure | Knowledge sharing | Training and developmentSenior-level Full TimeBrussel, Belgium10d ago
-
Embedded Hardware Engineer EUR 59K-80KElectronics | Embedded Systems | Hardware Development | Hardware specification | Issue analysisDiversity and inclusion | Inclusive workplace culture | Learning opportunities | Professional developmentSenior-level Full TimeGhent, East Flanders, BE11d ago
-
OT Data Engineer-FLU004016 EUR 48K-68KApache Cassandra | Automation | Data Engineering | Data Management | Data PipelinesMid-level Full TimeBrussels, Belgium11d ago
-
Senior Data Engineer Consultant EUR 56K-79KAWS | Apache Kafka | Apache Spark | Automation | AzureFlexible mobility options | Flexible working arrangements | International project exposure | Knowledge sharing | Tailored training and developmentSenior-level Full TimeAntwerp, Belgium11d ago
-
Machine Learning Engineer EUR 28K-28KAWS | Apache Spark | Azure | C++ | Computer VisionHospital insurance | Mobility budget | Performance-related bonus | Training opportunitiesEntry-level Full TimeAntwerp, Belgium11d ago
-
Machine Learning Engineer EUR 45K-60KAWS | Apache Spark | Azure | C++ | Computer VisionHealth insurance | Mobility budget | Performance bonus | Professional development plan | Training opportunitiesMid-level Full TimeBrussel, Belgium11d ago