Lead Distributed Data Platform Engineer
Tasks
- Build lakehouse platforms with Spark and Delta Lake and Iceberg
- Collaborate with stakeholders on analytics requirements
- Conduct architecture reviews and improve fault tolerance
- Design and implement scalable data pipelines
- Drive distributed system architecture decisions
- Ensure clean code modular design CI CD and automated testing
- Implement data governance observability and compliance
- Lead and mentor data platform engineers
- Participate in on-call rotations
- Perform code reviews and uphold software engineering best practices
- Tune performance and scalability and optimize cloud cost
Perks/Benefits
Skills/Tech-stack
Apache Iceberg | Apache Spark | Automated testing | CI/CD | Cloud Cost Optimization | Compliance | Cost Optimization | DBT | Data Governance | Databricks | Delta Lake | Docker | Infrastructure as Code | Kubernetes | Observability | Performance Tuning | Python | SQL | Scalability | Snowflake | “as-code”
Education
N/A
Related jobs
-
AWS | Azure | Data Architecture | Data Governance | Data LineageSenior-level Full TimeGdańsk; Katowice; Poznań; Wrocław15h ago
-
Senior Power BI Engineer PLN 136K-181KCI/CD | DAX | Data Modeling | DevOps | Microsoft FabricHybrid work | Private health care | Savings plans | Sport cards | Stock plansSenior-level Full TimeWARSAW DOWNTOWN OFFICE, Poland1d ago
-
Senior-level Full TimeWarsaw, Masovian Voivodeship, Poland1d ago
-
Senior Data Engineer (Snowflake) CAD 120K-150KAirbyte | Azure Data | Azure Data Factory | Coalesce.io | Data FactoryHybrid/Remote flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Recognition programSenior-level Full TimeBulgaria, Georgia, Lithuania, Poland,Romania, Uzbekistan1d ago
-
Senior Data Engineer PLN 180K-204KAWS CloudFormation | AWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDBHybrid or remote flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Recognition programSenior-level Full TimeBulgaria, Hungary, Poland1d ago
-
Analytics Engineer II PLN 226K-346KAlerting | Cost Optimization | DBT | Data Lineage | Data TestingDental insurance | Employee resource groups | Flexible spending wallets | Health insurance | Learning and development programsMid-level Full TimeRemote Poland R1d ago
-
Senior Data Engineer PLN 220K-336KAWS | Apache Airflow | Apache Atlas | Apache Kafka | Apache SparkSenior-level Full TimeWarsaw, Masovian Voivodeship, Poland1d ago
-
Mid-level Full TimePoland1d ago
-
[CMI] Machine Learning Engineer PLN 228K-346KAmazon SageMaker | Auditability | Automated retraining | CI/CD | Cloud infrastructureFlexible employment | Internal and external training | International business trips | International projects | Language classesSenior-level Full TimeKraków, Lesser Poland Voivodeship, Poland1d ago
-
Data Engineer PLN 276K-276KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaCareer growth | Coworking space | English classes | English clubs | MacBook providedMid-level Full TimePoland1d ago
-
Staff AI Engineer (AI Enablement Platform) PLN 246K-400KAPI Design | APIs | AWS | Agent Orchestration | AzureMentoring | Mentorship | Professional developmentSenior-level Full TimePoland2d ago
-
Senior Data Engineer (Python, GCP, Airflow) PLN 174K-268KApache Airflow | Apache Beam | BigQuery | Cloud SQL | Cloud StorageAccess to e-learning platforms | Hybrid work | Life insurance | Lunch subsidy | Online trainingSenior-level Full TimeKraków, PL, 30-3022d ago
-
Senior Data Consultant (Python, GCP, Airflow) PLN 250K-326KApache Airflow | Apache Beam | Apache Spark | BigQuery | Cloud SQLContract (B2B) | Remote work flexibilitySenior-level Full TimeKraków, PL, 30-3022d ago
-
Senior-level Full TimePoznań, Poland; Łódź, Poland; Kraków, Poland; …2d ago
-
Android AOSP | Android HAL | C# | Debugging | Device treeAdditional days off | English language lessons | Hybrid work | Multisport funding | Paid volunteering daysMid-level Full TimeWarsaw, Poland2d ago
-
Lead Data Architect ID69151 PLN 217K-328KAI/ML | Agile Scrum | Data Architecture | Data Governance | Data ModelingEducation budget | Fitness budget | Flextime | Professional growth | Remote and office optionsSenior-level Full TimeWrocław, Poland2d ago
-
Lead Data Architect ID69151 PLN 217K-328KAI/ML | AI/ML Tools | Agile | Data Governance | Data ModelingEducation budget | Fitness budget | Flextime | Professional growth | Remote work optionsSenior-level Full TimeLublin, Poland2d ago
-
Lead Data Architect ID69151 PLN 217K-328KAI/ML | AI/ML Tools | Agile Scrum | Data Governance | Data ModelingEducation budget | Fitness budget | Flexible schedule | Personalized growth roadmaps | Professional growthSenior-level Full TimePoznań, Poland2d ago
-
Lead Data Architect ID69151 PLN 217K-328KAI/ML | AI/ML Tools | Agile | Data Governance | Data ModelingEducation budget | Fitness budget | Flextime | Office options | Professional growthSenior-level Full TimeWarsaw, Poland2d ago
-
Analytics Engineer (m/f/d) PLN 211K-320KDAX | Data Query | Data Query Optimization | Data Visualization | DatabricksCross functional international environment | Remote work option | Technology monitoring and choices | Training opportunitiesSenior-level Full TimeWarszawa, Województwo mazowieckie, Poland R2d ago
-
Data Engineer - HR support (m/f/n) PLN 96K-110KData Governance | Data Migration | Data Privacy | Data Quality | DatabricksFlexible working model | Remote work optionsEntry-level Full TimeWarszawa, Województwo mazowieckie, Poland2d ago
-
Senior Forward Deployed Engineer, GenAI, Google Cloud PLN 364K-374KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesBenefits | Bonus | EquitySenior-level Full TimeWarsaw, Poland2d ago
-
Embedded Software Engineer (Poland) PLN 190K-268KARM Cortex | ARM Cortex-M | Analog electronics | Automated testing | BLEMedical insurance | Remote workSenior-level Full TimeKraków, Poland R2d ago
-
Agile | Apache Airflow | Apache Spark | BigQuery | Cloud ComposerCareer growth | Remote/hybrid work | Training and mentoringSenior-level Full TimePoland2d ago
-
Senior SW Engineer – AI Infrastructure & Optimization PLN 280K-383KCUDA | Cloud Platforms | Distributed Systems | GPU Performance | GPU Performance OptimizationSenior-level Full TimeKraków, Małopolskie, PL2d ago