Data Engineer Kafka & Elasticsearch (Freelance kan)
Tasks
- Build and manage Apache Kafka pipelines
- Configure Elasticsearch indexing and ingestion
- Create CI CD pipelines for deployments
- Design event driven data architecture
- Develop data service layer with REST APIs
- Develop microservices for data access
- Document pipelines schemas configurations and technical decisions
- Ensure data consistency and observability
- Implement robust error handling for pipelines
- Implement schema management and topic management
- Optimize data pipeline performance and scalability
- Use Docker and Kubernetes to deploy components
Perks/Benefits
Skills/Tech-stack
Apache Kafka | Avro | CI/CD | Docker | Elasticsearch | GitLab CI | Index Lifecycle Management | Index lifecycle | Ingest pipelines | KSQLDB | Kafka Connect | Kibana | Kubernetes | Lifecycle Management | Microservices | OpenShift | PostgreSQL | Python | REST API | Schema Registry
Education
N/A
Roles
Related jobs
-
Senior Software Engineer EUR 46K-66KAI Agents | AWS | Agentic AI | Autonomous AI | Autonomous AI AgentsClient project ownership | High ownership and autonomy | Relocation not required | Stock optionsSenior-level Full TimeGand, Belgium1d ago
-
Apache Kafka | Avro | CI/CD | Data pipeline | DockerCompany car | Extra-legal benefits | Flexible telework | Professional development support | Training budgetMid-level FreelanceBrussels, Belgium1d ago
-
Elastic Data Engineer EUR 54K-78KApache Kafka | Avro | Docker | Elasticsearch | Elasticsearch IngestConsultancy experience | On-site work | Professional developmentMid-level Full TimeBrussel, Belgium1d ago
-
ARINC | Bare Metal | C++ | DO-178C | DO-254Competitive equity grants | Health benefits | Recovery Benefits | Travel opportunitiesSenior-level Full TimeBrussels, Brussels-Capital, Belgium1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Competitive compensation | Friendly atmosphere | Supportive teamMid-level Full TimeAntwerp, Belgium2d ago
-
Data engineer (consultant / freelancer) EUR 39K-52KAzure | Data Modeling | Data Warehouse | Data Warehouse Concepts | DatabricksEntry-level Freelance Full TimeBrugge - Sint-Clarastraat, Belgium2d ago
-
A/B | A/B Testing | B testing | Continuous Delivery | Continuous integrationOnsite workSenior-level Full TimeBrussels, Belgium2d ago
-
Data Engineer EUR 48K-68KApache Kafka | Apache Spark | Apache Superset | CI/CD | DagsterCompany car | Eco-cheques | Hybrid work option | Insurance | Meal vouchersMid-level Full TimeLiège, Walloon Region, Belgium4d ago
-
AI & ML Engineer EUR 52K-72KCloud services | DevOps Pipelines | FastAPI | Flask | LLMCompany car or mobility budget | Cycling reimbursement | Employee discounts | Group insurance | Healthcare cost reimbursementMid-level Full TimeBrussels, Brussels Hoofdstedelijk Gewest, België4d ago
-
Machine Learning Engineer EUR 57K-90KCUDA | Computer Vision | Neural Networks | ONNX | PyTorchFlexible working hours | International environment | Quarterly offsite | Team events | Vacation daysSenior-level Full TimeGhent, Flanders, Belgium4d ago
-
Data Engineer EUR 42K-60KAutomated testing | Azure | Azure SQL | DBT | Data ModelingCompany car | Flexible working hours | Fuel card | Group insurance | Health insuranceMid-level Full TimeAntwerpen-zuid, Antwerpen, België4d ago
-
Data/AI Engineer - Data Platform & Analytics EUR 40K-55KAccess Management | Audit Logging | Azure | CI/CD | Data LakesProfessional developmentMid-level Full TimeBrussels, Brussels, Belgium5d ago
-
Data Engineer EUR 47K-72KAWS | Azure | Cloud Computing | Cloud platform | Google CloudCafeteria plan | Dedicated mentor | Flexible hours | Full insurance coverage | Group insurance coverageEntry-level Full TimeEurope, Belgium, Brussels Office - Zaventem … R5d ago
-
Manager Data Engineer EUR 61K-74KAWS | Apache Spark | Azure | Azure Data | Azure Data FactoryBuddy and performance manager | Cafeteria plan benefits | Career development trainings | Charging card | Company carMid-level Full TimeEurope, Belgium, Brussels Office - Zaventem … R5d ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure EventBudget for training | Career development plan | Company car or alternative reimbursement | Flexible freelance option | Support for certificationsSenior-level FreelanceMelle, Belgium5d ago
-
ArcGIS Portal | ArcGIS Pro | ArcGIS Server | Dashboards | Data ManagementSenior-level Full TimeMons, Belgium5d ago
-
Agile | CI/CD | Cloud Architecture | Data Governance | DockerSenior-level Full TimeBRUXELLES, Brussels, Belgique6d ago
-
Generative AI Pipeline Engineer (Tech Lead) EUR 75K-85KAPI Integration | Agentic Workflows | Blender | CAD | ComfyUIFitness allowance | Home office support | Medical insurance coverage | Ongoing learning | Paid vacationSenior-level Full TimeBrussels, Remote, BE R6d ago
-
Senior Data Engineer Consultant EUR 53K-79KAWS | Apache Kafka | Apache Spark | Automation | AzureFlexible working arrangements | International project exposure | Knowledge sharing | Mobility options | Training and developmentSenior-level Full TimeAntwerp, Belgium6d ago
-
Senior Data Engineer Consultant EUR 53K-79KAWS | Apache Kafka | Apache Spark | Azure | CI/CDFlexible mobility options | Flexible working arrangements | International project exposure | Knowledge sharing | Training and developmentSenior-level Full TimeBrussel, Belgium6d ago
-
API Integration | Azure AI | Context Management | Database Integration | GPU ComputingComprehensive benefits package | Inclusive workplace culture | Innovative projects | International team collaboration | Professional growth opportunitiesSenior-level Full TimeBelgium6d ago
-
Data Engineer EUR 47K-68KAWS | Agile | Azure | CDP | Data GovernanceCareer growth opportunities | Challenging projects | Professional mentorship | Supportive work culture | Training sessionsMid-level Full TimeGenk, Belgium6d ago
-
AWS | Azure | Cloud Platforms | Data Analysis | Data cleaningContinuous learning | Flexible schedule | Fully remote | Professional growth | Remote work flexibilityMid-level Full TimeBelgium R6d ago
-
Senior AI Engineer, Unstructured AI EUR 64K-93KAPI Design | Big Data | Context engineering | Data Cataloging | Data PipelinesFlexible benefits | Health coverage | Hybrid work schedule | Inclusion and belonging | Time offSenior-level Full TimeBrussels, Belgium R7d ago
-
AI/ML Engineer EUR 60K-89KAI Agents | AI Safety | AI Studio | AWS Bedrock | AWS SageMakerAd hoc training | Commuting allowance | Continuous learning opportunities | Hospitalization plan | Meal allowanceSenior-level Full TimeBrussels, Brussels, Belgium7d ago