Lead Distributed Data Platform Engineer
Tasks
- Build lakehouse platforms with Spark and Delta Lake and Iceberg
- Collaborate with stakeholders on analytics requirements
- Conduct architecture reviews and improve fault tolerance
- Design and implement scalable data pipelines
- Drive distributed system architecture decisions
- Ensure clean code modular design CI CD and automated testing
- Implement data governance observability and compliance
- Lead and mentor data platform engineers
- Participate in on-call rotations
- Perform code reviews and uphold software engineering best practices
- Tune performance and scalability and optimize cloud cost
Perks/Benefits
Skills/Tech-stack
Apache Iceberg | Apache Spark | Automated testing | CI/CD | Cloud Cost Optimization | Compliance | Cost Optimization | DBT | Data Governance | Databricks | Delta Lake | Docker | Infrastructure as Code | Kubernetes | Observability | Performance Tuning | Python | SQL | Scalability | Snowflake | “as-code”
Education
N/A
Related jobs
-
Lead Data Engineer PLN 258K-370KApache Kafka | CDC | Change Data Capture | Data Capture | Data CatalogAutonomy | Hybrid work model | Professional growth | Psychological safety | Remote work flexibilitySenior-level Full TimeKraków10h ago
-
Lead Data Engineer PLN 258K-370KBigQuery | Change Data Capture | Data Capture | Data Catalog | Data ModelingAutonomy | Hybrid work flexibility | Professional growth | Psychological safety culture | Remote work daysSenior-level Full TimeKraków10h ago
-
Lead Data Engineer SEK 775K-930KApache Kafka | BigQuery | CDC | Change Data Capture | Cloud platformAutonomy | Mentorship | Psychological safety | Remote work 3 days per week flexibilitySenior-level Full TimeOslo; Stockholm; Copenhagen; Aarhus; Helsinki; Kraków12h ago
-
Senior Fabric/Data Engineer | SB PLN 206K-267KAPIs | Automated testing | Azure Data Factory | Azure DevOps | CDCCafeteria benefits system | Certification funding | Charitable initiatives support | Conference participation | Flexible benefitsSenior-level Full TimeWarsaw, Masovian Voivodeship, Poland14h ago
-
Regular Data Engineer/ SB PLN 175K-255KAzure | Azure Data | Azure Data Factory | Azure DevOps | DBTCertification funding | Charity initiatives participation | Conference participation | Flexible working hours | Hybrid workMid-level Full TimeWarsaw, Masovian Voivodeship, Poland14h ago
-
Senior Software Engineer - Testing AI Coding Agents USD 100K-100KDocker | FastAPI | Functional testing | Integration Testing | JavaScriptFlexible schedule | Project based workSenior-level Full TimePoland - Remote R1d ago
-
Senior Software Engineer - AI Model Evaluation USD 80K-80KCase Development | Docker | FastAPI | Feedback iteration | Functional testingSenior-level Full TimePoland - Remote R1d ago
-
Senior Software Engineer - AI Coding Benchmarks USD 80K-80KDocker | FastAPI | Functional testing | Integration Testing | JavaScriptSenior-level Full TimePoland - Remote R1d ago
-
Manufacturing Systems Integration Data Engineer PLN 191K-318KALCOA+ | API | CSA | CSV | Cloud PlatformsCareer development | Employee recognition | Flexible working | Health and wellbeing programs | Life insuranceMid-level Full TimePoznan Pastelowa, Poland1d ago
-
R&D Scientist in Machine Learning for Simulations PLN 241K-411KArtificial Intelligence | CFD | Computer Vision | Data Visualization | Hyperparameter TuningCompany events and team building activities | Discounts and perks platform | Employee capital plans | Equipment for home office | Fitness and wellness programsSenior-level Full Time(HE)Office KRK Pawia, Poland1d ago
-
Product Intelligence Engineer PLN 258K-329KAutogen | CrewAI | Data Governance | Data Modeling | Function CallingCareer development | Distributed team collaboration | Learning opportunities | Work from anywhereSenior-level Full TimeBielsko-Biała, Poland R1d ago
-
AWS | Agentic Workflows | Azure | Docker | GCPHybrid work | Internal mobility | Professional developmentSenior-level Full TimePoznan, Wielkopolskie, Poland1d ago
-
AWS | Azure | CI/CD | Cloud platform | DockerAccess to cutting edge tools and platforms | Career development | Hybrid work | Inclusive innovation driven culture | MentorshipMid-level Full TimePoznan, Wielkopolskie, Poland1d ago
-
AI Safety | AI ethics | API Integration | AWS | Agent systemsHybrid work | Mentorship | Remote workSenior-level Full TimeGdańsk, Poland1d ago
-
Automation | Big Data | CI/CD | Cloud infrastructure | Cloud platformRemote-first work environment | Work-life balanceExecutive-level Full TimePoland R1d ago
-
AI Engineer PLN 179K-254KAI Foundry | AI Search | API Design | Automated Evaluation | Azure AIEmployee resource groups | Flexible leave | Global Wellbeing Days | Growth opportunities | Paid time offSenior-level Full TimePoland, Poland1d ago
-
Embedded Software Engineer (Poland) PLN 180K-338KAnalog circuits | Automated testing | BLE | Bash | Bluetooth Low EnergyEducation Training Programs | English teachers | Medical insurance | Paid time off | Remote workSenior-level Full TimeKraków, Poland R1d ago
-
Senior Data Solutions Engineer PLN 208K-320KAWS | Azure | Data Modeling | Data Pipelines | Data WarehousingAccommodation covered | Free breakfasts | Hybrid working model | International projects | No dress codeSenior-level Full TimeKraków, Województwo małopolskie, Poland1d ago
-
[CMI] Machine Learning Engineer PLN 226K-336KAmazon SageMaker | Audit Logging | Automated retraining | CI/CD | Cloud infrastructureExternal training | Flexible work hours | Insurance | Internal training | International business tripsSenior-level Full TimeKraków, Lesser Poland Voivodeship, Poland1d ago
-
Analytics Engineer PLN 153K-211KAirflow | DBT | Data Modeling | Data Quality | Data WarehousingB2B contract | Onsite work daily schedule | RSUsMid-level Full TimeWarsaw1d ago
-
Data & AI Internship Program (She/He/They) PLN 60K-60KAggregation | Data Engineering | Data Pipelines | Data Visualization | Data WarehousingBuddy support | Career development | Flexible working hours | Long-term employment opportunity | MentorshipEntry-level Full Time InternshipWarsaw, Sienna 39, Poland2d ago
-
Asset Management | Data Analysis | Failure Mechanisms | Predictive Modeling | Probabilistic ModelingAnnual performance bonus | Disability programs | Flexible work hours | Hybrid work | Life insuranceSenior-level Full TimePL-PDK-WARSAW-ALEJA KRAKOWSKA 110/114 BLD 3014613, Poland R2d ago
-
AI Automation & Analytics Engineer PLN 204K-291KAPIs | Anomaly Detection | Anthropic Claude | Azure | Azure OpenAICollaborative workplace culture | Continuous learning opportunities | Multisport card subsidy | Private medical care | Professional onboardingMid-level Full TimeStare Miasto, Poland2d ago
-
Senior AI Engineer PLN 241K-309KAnsible | Authentication | Autoscaling | Azure | CI/CDFlexible work arrangements | In-office fitness center | Lunch subsidy | Mentoring programs | P&G stock optionsSenior-level Full TimeWARSAW DOWNTOWN OFFICE, Poland2d ago
-
Senior Data Engineer - Databricks PLN 270K-384KACID transactions | AWS | Access Control | Apache Spark | Automated testingAfter hours incident response | On-call rotationSenior-level Full TimePoland - Remote R2d ago