Data Flow Engineer
Warsaw, Masovian Voivodeship, Poland
PLN 258K-384K (estimate) Senior-level Full Time
Tasks
- Build tune Change Data Capture pipelines
- Connect external systems via REST APIs JDBC and Kafka
- Design build test maintain data pipelines
- Gather requirements with stakeholders
- Manage Avro schemas and metadata lineage
- Monitor pipelines and configure alerts
- Participate in CDP NiFi and Kafka upgrades and migrations
- Set up security and governance with Apache Ranger
- Write and maintain SOPs runbooks documentation
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Atlas | Apache Iceberg | Apache Kafka | Apache NiFi | Apache Ranger | Avro | Change Data Capture | Cloudera DataFlow | Data Capture | Debezium | Flink | JDBC | JWT | OAuth | Python | REST API | SQL | Schema Registry | Spark
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Staff Software Engineer, BigLake Federation PLN 232K-348KApache Iceberg | Apache Spark | Big Data | Cloud Computing | Data analyticsSenior-level Full TimeWarsaw, Poland15h ago
-
AI Solutions Engineer - Mergers & Acquisitions PLN 170K-315KAPI Development | API Gateway | AWS | Authentication | AuthorizationDedicated training budget | Flex location | Group life insurance | Multisport | Private healthcareMid-level Full TimeWarsaw Grafit, Poland1d ago
-
GenAI Solutions Specialist PLN 146K-285KAWS | Cloud Computing | Generative AI | Machine Learning | PythonAdditional days off | Annual bonus | Annual equity grant | E-learning access | Employee stock purchase planMid-level Full TimePoland1d ago
-
Senior Data Engineer PLN 204K-204KAccess Control | Airflow | Apache Kafka | Audit trails | BigQueryClear career progression | Community work time | Extra time off for volunteering | Mentoring | Tailored development programsSenior-level Full TimeKraków - Poland1d ago
-
Agent Orchestration | Amazon Neptune | D3.js | Entity Resolution | Entity recognitionAsynchronous collaboration | Flexible schedule | Remote workSenior-level Full TimePoland - Kraków1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Backfill | Data Capture | Data FilteringFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote optionsSenior-level Full TimeWrocław, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Capture | Data Migration | GCP DataflowFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeSzczecin, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud DataStream | Cloud Dataflow | Cloud platform | Data BackfillFlextime | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeWarsaw, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Capture | Dataflow | DatastreamEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeLublin, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Capture | Data Migration | DataflowFlextime | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimePoznań, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Backfill | Data Capture | Data FilteringEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeKraków, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Capture | Data Migration | DataflowCompetitive compensation | Education budget | Exciting projects | Fitness budget | FlextimeSenior-level Full TimeGdańsk, Poland1d ago
-
Senior Data Engineer (ADB, Python) CAD 120K-160KASP.Net Core | Angular | Apache Spark | Azure Cloud | Azure DataHybrid/Remote flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBulgaria, Georgia, Poland, Romania, Uzbekistan1d ago
-
Senior/Lead Data Engineer (Databricks, Power BI) RON 312K-396KApache Spark | Azure Synapse | Cloud Data | Cloud data platform | DAXHybrid/Remote flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Recognition programSenior-level Full TimeBulgaria, Poland, Romania1d ago
-
Middle DataOps Engineer USD 120K-155KAgile | Azure | Azure DevOps | Azure Monitor | BashHybrid options | International projects | Local benefits | Medical healthcare | Ongoing learning reimbursementMid-level Full TimeBulgaria, Georgia, Hungary, Lithuania, Poland, Romania, …1d ago
-
Middle DataOps Engineer USD 120K-155KARM Templates | Azure | Azure DevOps | Azure Monitor | BashHybrid work flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesMid-level Full TimeBulgaria, Georgia, Hungary, Lithuania, Poland, Romania, …1d ago
-
Mid-level Full TimeWrocław1d ago
-
AI Engineer PLN 246K-384KAI Foundry | AI Search | API Design | Audit Logging | Automated EvaluationFlexible leave | Global Wellbeing Days | Professional growth opportunities | Remote working opportunitiesSenior-level Full TimePoland, Poland1d ago
-
Senior/Lead Data Engineer (Databricks, Power BI) RON 312K-396KApache Spark | Azure Synapse | DAX | Data Warehousing | DatabricksHybrid work flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBulgaria, Poland, Romania1d ago
-
Senior/Lead Data Engineer (Databricks, Power BI) RON 312K-396KApache Spark | Azure Synapse | DAX | Data Modeling | Data WarehousingHybrid/Remote flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBulgaria, Poland , Romania1d ago
-
Senior Data Solutions Engineer PLN 220K-384KAWS | Azure | Cloud | Data Modeling | Data WarehouseEmployee-oriented culture | Free breakfasts | Friendly team | Growth opportunities | Hybrid work modelSenior-level Full TimeKraków, Województwo małopolskie, Poland1d ago
-
Machine Learning Credit Model Developer PLN 115K-264KAgile | Classification | Collection systems | Credit Decision Scorecards | Credit RiskSenior-level Full TimeWarszawa (Pańska 97), Poland2d ago
-
Machine Learning Credit Model Developer PLN 115K-264KAgile | Classification | Credit Decision Scorecards | Credit Risk | Credit Risk ManagementSenior-level Full TimeWarszawa (Pańska 97), Poland2d ago
-
Reliability & Data Analysis Engineer PLN 186K-228KAgile | Apache Spark | CI/CD | Data Aggregation | Data CleansingEmployee pension scheme | Employee recognition program | Flexible working hours | Learning and development program | Life insuranceMid-level Full TimePOL - Rzeszow, Poland2d ago
-
Reliability & Data Analysis Engineer PLN 186K-228KAWS | Agile | Azure | CI/CD | Cloud platformAdditional paid time off | Employee pension scheme | Employee recognition program | Flexible working hours | Learning programsMid-level Full TimePOL - Rzeszow, Poland2d ago