Senior Data Engineer Python & AI Migration (Freelance possible)
Tasks
- Contribute to AI assisted agent workflows and orchestration
- Design build and validate Python data transformation solutions
- Ensure code quality maintainability performance and operational robustness
- Implement data quality controls and schema management
- Implement human in the loop validation mechanisms
- Improve agent harness for multi agent migration pipeline
- Migrate SAS ETL workloads to Python data platform
- Optimize Parquet for data engineering use cases
- Review optimize AI generated Python code
- Strengthen workflow reliability traceability and throughput
- Support ETL and ELT processes for data acquisition and transformation
Perks/Benefits
Skills/Tech-stack
Agent systems | Apache Spark | Data Quality | Data Validation | ELT | ETL | GitHub Copilot | Human-in-the-loop | Multi-Agent | Multi-Agent Systems | Pandas | Parquet | Polars | PyArrow | PySpark | Python | Schema management | Testing | The Loop | Workflow Orchestration
Education
N/A
Related jobs
-
Data Scientist Grid Data Analytics EUR 46K-53KAgile | Azure | Computer Vision | Data Contracts | Data GovernanceAccident Coverage | Ambulatory Care Coverage | Annual end bonus for results | Childbirth and marriage bonus | Company carSenior-level Full TimeBruxelles, BRU, BE, 10009h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Flexible management approach | Portfolio and LinkedIn sharing | Supportive teamMid-level Full TimeBrussels, Belgium11h ago
-
Apache Hadoop | Big Data | Data Architecture | Data Pipelines | DatabricksHybrid workSenior-level Full TimeBrussels, Belgium1d ago
-
Computational Biology | Data Analysis | Data integration | Databases | DockerContinuous learning opportunities | Flexible schedule | Fully remote | Healthcare technology exposure | International collaborative environmentSenior-level Full TimeBelgium R1d ago
-
Senior Data Engineer EUR 62K-87KAgile | Azure Databricks | Data Management | Data Quality | Data ValidationBike parking | Car parking | Company restaurant | Flexible working hours | Individual lockerSenior-level Full TimeBrussel, Belgium2d ago
-
Data Engineer EUR 62K-80KAzure | Databricks | Dimensional Modeling | Kimball Dimensional | Kimball dimensional modelingBike parking | Car parking | Company restaurant | Flexible working hours | Individual lockerSenior-level Full TimeBrussel, Belgium2d ago
-
Agile | Azure Databricks | CI/CD | CRUD | Data ManagementCareer development plan | Company car | Extra education budget | Fun colleagues | User training supportSenior-level FreelanceBrussels, Belgium2d ago
-
Analysis Services | Azure Databricks | Data Ingestion | Data Warehousing | DatabricksCareer development plan | Company car | Extra education budget | Flexible freelance optionSenior-level FreelanceBrussels, Belgium2d ago
-
Data Engineer EUR 49K-60KAzure | Data Pipeline Monitoring | Data Validation | Data pipeline | DebuggingFlexible working hours | Hybrid working | International team | Professional development opportunitiesMid-level Full TimeLeuven, Belgium4d ago
-
Junior Data Engineer EUR 35K-42KAzure | Data Pipeline Monitoring | Data Validation | Data pipeline | DebuggingCareer development opportunities | Flexible working hours | Hybrid working | International teamEntry-level Full TimeLeuven, Belgium4d ago
-
Executive-level Full TimeMechelen/Leuven/Gent, Vlaams Gewest, Belgium4d ago
-
Mid-level Full TimeSint-Niklaas, VOV, Belgium4d ago
-
Senior Embedded Software engineer EUR 62K-85KARM Cortex | ARM Cortex-M | ASPICE | Assembly Language | C#Senior-level Full TimeTessenderlo, Belgium; Tessenderlo-Ham4d ago
-
Analytics Engineer EUR 52K-78KAWS | Agentic AI | DBT | Dagster | Data ArchitectureEco vouchers | Employee discounts | Group insurance | Hospitalization insurance | LaptopMid-level Full TimeMechelen, Belgium R5d ago
-
Ingénieur(e) Robotique & Automatisme (H/F) EUR 38K-45KABB Rapid | Beckhoff TwinCat | Cognex | Doosan | EN ISO 13849Associateship opportunity | Collaborative projects | Equal opportunity employment | Parental support | Training and developmentMid-level Full TimeLiège, Belgium5d ago
-
Senior Data Engineer OND000043 EUR 58K-78KData Pipelines | Data Quality | Data Reliability | Data Warehouse | Data Warehouse ModelingGovernment sector experience optional | Hybrid workSenior-level Full TimeBrussels, Belgium5d ago
-
.NET | API Integration | Azure | Azure DevOps | Backend ServicesAdditional training and certification support | Company car or alternative allowance | Freelance possible | Hybrid work | Professional development budgetSenior-level FreelanceBrussels, Belgium6d ago
-
Machine Learning Engineer Job ID: JP054754 EUR 49K-67KAPIs | Azure | Azure DevOps | Backend Services | Batch ProcessingHybrid work model | Onsite days in Brussels | Remote workMid-level Full TimeBrussels, Belgium6d ago
-
Senior Data Engineer Consultant EUR 56K-79KAWS | Apache Kafka | Apache Spark | Azure | Batch ProcessingClient site work | Flexible mobility plan | Flexible working hours | International projects | Knowledge sharingSenior-level Full TimeAntwerp, Belgium6d ago
-
Data Architect EUR 56K-79KAWS | Apache Kafka | Apache Spark | Azure | Batch ProcessingFlexible working arrangements | Health insurance | International project exposure | Knowledge sharing | Professional trainingSenior-level Full TimeBruxelles, Bruxelles, Belgium6d ago
-
Data Architect EUR 56K-79KAWS | Apache Kafka | Apache Spark | Automation | AzureCompany car or mobility budget | Flexible working arrangements | Hospital insurance | International project exposure | Tailored training and developmentSenior-level Full TimeAntwerpen, Vlaanderen, Belgium6d ago
-
Senior Data Engineer Consultant EUR 56K-79KAWS | Apache Kafka | Apache Spark | Azure | Batch ProcessingFlexible working arrangements | International project exposure | Knowledge sharing | Tailored training and developmentSenior-level Full TimeBrussel, Belgium6d ago
-
Consultant Data Engineer EUR 28K-28KAWS | Azure | Big Data | CI/CD | Certificate managementDiversity and inclusion | Great place to work | Knowledge sharing | Well-beingEntry-level Full TimeBrussels, Belgium6d ago
-
Consultant Data Engineer EUR 45K-60KAWS | Azure | Big Data | CI/CD | Certificate managementDiversity | Entrepreneurial culture | Knowledge sharing | Well-beingMid-level Full TimeAntwerp, Belgium6d ago
-
Machine Learning Engineer EUR 28K-28KAmazon Web Services | Apache Hadoop | Apache Spark | C++ | Cloud platformDiversity and inclusion | Hospital insurance | Mobility budget | Performance bonus | Professional development planEntry-level Full TimeAntwerp, Belgium6d ago