Senior Python Data Engineer (AI & Data Migration) Job ID: JP054841
Tasks
- Automate workflow validation and human in the loop QA
- Build data pipelines with Pandas Polars PyArrow Parquet and PySpark
- Collaborate with architects data engineers and SAS experts for migrations
- Design Python ETL and data transformations
- Ensure testing documentation and operational reliability
- Improve ETL ELT data quality schema management and performance
- Optimize AI generated code performance and quality
Perks/Benefits
Skills/Tech-stack
Apache Spark | Data Quality | ELT | ETL | GitHub Copilot | Pandas | Parquet | Performance Tuning | Polars | PyArrow | PySpark | Python | Schema management | Testing Frameworks
Education
N/A
Related jobs
-
Senior Python Data Engineer - JP054841 EUR 54K-72KAI Assisted Development | Agent systems | Agentic Workflows | Data Engineering | Data QualityHybrid work modelSenior-level Full TimeBrussels, Belgium1d ago
-
Azure Databricks | DBT | Kubernetes | Microsoft Azure | PythonHybrid work | Public sector project experienceSenior-level Full TimeBrussels, Belgium1d ago
-
Agile | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Data WarehousingHybrid work | Remote work availableSenior-level Full TimeBrussels, Belgium1d ago
-
Senior-level Full TimeBrussels, Brussels, Belgium2d ago
-
Microsoft Power BI Service Operations EUR 80K-89KActive Directory | Active Directory Federation Services | Active Directory federation | BI Report Server | Dashboard DevelopmentOn site work supportMid-level Full TimeBelgium2d ago
-
Data Engineer EUR 36K-54KAWS | Big Data | CI/CD | Data Pipelines | DatabasesAnnual leave | Company car | Flexible working hours | Insurance package | Meal vouchersMid-level Full TimeAntwerpen, Antwerpen, België2d ago
-
Big Data Engineer (Expert) Job ID: JP054810 EUR 62K-77KAgile | Azure Databricks | Data Management | Data Quality | Dimensional ModelingHybrid work | Onsite in Brussels | Teleworking within Belgium | User trainingSenior-level Full TimeBrussels, Belgium2d ago
-
Agile | Azure Databricks | Data Warehousing | Dimensional Modeling | ETLHealthcare analytics domain | Hybrid work | Training and demonstrationsMid-level Full TimeBrussels, Belgium2d ago
-
Data Scientist Grid Data Analytics EUR 46K-53KAgile | Azure | Computer Vision | Data Contracts | Data GovernanceAccident Coverage | Ambulatory Care Coverage | Annual end bonus for results | Childbirth and marriage bonus | Company carSenior-level Full TimeBruxelles, BRU, BE, 10002d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Flexible management approach | Portfolio and LinkedIn sharing | Supportive teamMid-level Full TimeBrussels, Belgium2d ago
-
ADFS | BI Desktop | BI Report Server | Change Management | Claims Based AuthenticationMid-level Contract Full TimeBraine-l'Alleud, Wallonia, Belgium2d ago
-
Apache Hadoop | Big Data | Data Architecture | Data Pipelines | DatabricksHybrid workSenior-level Full TimeBrussels, Belgium3d ago
-
Agent systems | Apache Spark | Data Quality | Data Validation | ELTCareer plan | Company car | Enjoyable work environment | Extra education budgetSenior-level FreelanceBrussels, Belgium3d ago
-
Senior Data Engineer EUR 62K-87KAgile | Azure Databricks | Data Management | Data Quality | Data ValidationBike parking | Car parking | Company restaurant | Flexible working hours | Individual lockerSenior-level Full TimeBrussel, Belgium4d ago
-
Data Engineer EUR 62K-80KAzure | Databricks | Dimensional Modeling | Kimball Dimensional | Kimball dimensional modelingBike parking | Car parking | Company restaurant | Flexible working hours | Individual lockerSenior-level Full TimeBrussel, Belgium4d ago
-
Agile | Azure Databricks | CI/CD | CRUD | Data ManagementCareer development plan | Company car | Extra education budget | Fun colleagues | User training supportSenior-level FreelanceBrussels, Belgium4d ago
-
Analysis Services | Azure Databricks | Data Ingestion | Data Warehousing | DatabricksCareer development plan | Company car | Extra education budget | Flexible freelance optionSenior-level FreelanceBrussels, Belgium4d ago
-
Data Engineer EUR 49K-60KAzure | Data Pipeline Monitoring | Data Validation | Data pipeline | DebuggingFlexible working hours | Hybrid working | International team | Professional development opportunitiesMid-level Full TimeLeuven, Belgium6d ago
-
Junior Data Engineer EUR 35K-42KAzure | Data Pipeline Monitoring | Data Validation | Data pipeline | DebuggingCareer development opportunities | Flexible working hours | Hybrid working | International teamEntry-level Full TimeLeuven, Belgium6d ago
-
Executive-level Full TimeMechelen/Leuven/Gent, Vlaams Gewest, Belgium6d ago
-
Mid-level Full TimeSint-Niklaas, VOV, Belgium6d ago
-
Senior Embedded Software engineer EUR 62K-85KARM Cortex | ARM Cortex-M | ASPICE | Assembly Language | C#Senior-level Full TimeTessenderlo, Belgium; Tessenderlo-Ham6d ago
-
Analytics Engineer EUR 52K-78KAWS | Agentic AI | DBT | Dagster | Data ArchitectureEco vouchers | Employee discounts | Group insurance | Hospitalization insurance | LaptopMid-level Full TimeMechelen, Belgium R7d ago
-
Ingénieur(e) Robotique & Automatisme (H/F) EUR 38K-45KABB Rapid | Beckhoff TwinCat | Cognex | Doosan | EN ISO 13849Associateship opportunity | Collaborative projects | Equal opportunity employment | Parental support | Training and developmentMid-level Full TimeLiège, Belgium7d ago
-
Senior Data Engineer OND000043 EUR 58K-78KData Pipelines | Data Quality | Data Reliability | Data Warehouse | Data Warehouse ModelingGovernment sector experience optional | Hybrid workSenior-level Full TimeBrussels, Belgium7d ago