Senior Data Engineer (Databricks Migration)
Kraków, Lesser Poland Voivodeship, Poland
PLN 258K-396K (estimate) Senior-level Full Time
Tasks
- Analyze ETL ELT workloads and define migration approaches
- Build Spark based data processing with PySpark
- Conduct code reviews and improve reliability
- Design and implement Lakehouse architecture with Delta Lake
- Design and maintain medallion layers Bronze Silver Gold
- Develop and optimize data pipelines for large scale processing
- Implement data governance and security with Unity Catalog
- Implement incremental processing strategies
- Migrate analytical platform from BigQuery to Databricks
- Support production deployments and platform modernization
- Troubleshoot and optimize SQL and Spark workloads
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | CI/CD | Cluster monitoring | Data Processing | Databricks | Declarative Pipelines | Delta Lake | Dimensional Modeling | Distributed data | Distributed data processing | ELT | ETL | GCP | Performance optimization | PySpark | Python | SQL | Spark Declarative Pipelines | Unity Catalog
Education
N/A
Roles
Related jobs
-
Data Engineer Consultant for EU projects | Poland PLN 91K-144KData Mapping | Data Modelling | Data Quality | Data Transformation | Data ValidationCareer growth | Certification support | Cross-training opportunities | Hybrid work | Travel opportunitiesMid-level Full TimePoland, Warsaw5h ago
-
Senior DevOps Engineer | GenAI 1 PLN 179K-254KAPI | API Gateway | Alerting | Auditability | AzureCafeteria benefits | Certification funding | Charitable initiatives | Conference participation | Flexible working hoursSenior-level Full TimeWarsaw, Masovian Voivodeship, Poland R7h ago
-
Senior-level Full TimeWarsaw, Masovian Voivodeship, Poland8h ago
-
CI/CD | DNS | Deployment | HTTPHTTPS | LinuxCollaborative team culture | Remote work | Social benefits | Transparent team cultureEntry-level Full TimeWarsaw, Poland R13h ago
-
APIs | Authentication | Cloud Fundamentals | GDPR | Generative AIAutonomy | Direct exposure to LLMs and AI agents | No regular meetings | Relocation for onboarding | Unlimited budget when ROI is rightMid-level Full TimeWarsaw, Masovian Voivodeship, Poland22h ago
-
DATA ENGINEER (AWS ecosystem/ Poland) PLN 276K-276KAWS CloudFormation | AWS CloudTrail | AWS DMS | AWS Data | AWS Data LakeEmployee rewards program | English communication | Full-time English teachers | Medical insurance | Open door communicationMid-level Full TimeKraków, Poland R1d ago
-
Agent Development | Agent Development Kit | Benchmarking | C++ | EvaluationEquity | Health insurance | Paid time off | Performance bonus | Retirement plansSenior-level Full TimeWarsaw, Poland2d ago
-
Senior Data Engineer PLN 240K-328KAPI Development | Access Control | Anomaly Detection | Apache Spark | Azure DataHybrid workSenior-level Full TimeKraków, PL2d ago
-
Senior AI Engineer – AI Transformation & Delivery PLN 241K-280KAI model | AI model governance | APIs | Access Control | Agentic AIHybrid workSenior-level Full TimePoland - Warsaw3d ago
-
Mid-level Full TimeWarsaw, Poland3d ago
-
Senior Data Engineer (Cloud) PLN 239K-301KBigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platformConference reimbursement | English lessons discount | Health benefits | Professional recommendation bonuses | Remote workSenior-level Full TimePoland, worldwide R3d ago
-
Azure Cloud Engineer, Data Mesh and AI Platforms team PLN 237K-360KAI Foundry | AKS | Application Insights | Azure | Azure AIHybrid work up to 40 percent remote possibleSenior-level Full TimeGdańsk, PL, 80-309 R3d ago
-
GCP Cloud Engineer, Data Mesh and AI Platforms team PLN 237K-322KAlerting | Automated testing | BigQuery | CI/CD | Cloud ComposerFull-time permanent position | Hybrid work | Up to 40 percent remote work allowedMid-level Full TimeGdańsk, PL, 80-309 R3d ago
-
AI Gateway Engineer, Data Mesh and AI Platforms team PLN 237K-400KAccess Control | Alerting | Authentication | Authorization | CI/CDHybrid work up to 40 percent remote | Permanent positionMid-level Full TimeGdańsk, PL, 80-309 R3d ago
-
Applied AI Engineer GBP 60K-80KArtificial Intelligence | Backend Development | Distributed Systems | Haystack | JavaEquity | Learning and development budget | Work from abroadMid-level Full TimeBerlin R4d ago
-
Senior Software Engineer, AI Intelligence Platform PLN 237K-330KAWS | Caching | Containerization | Data Processing | Data Processing PipelinesSenior-level Full TimeRemote Poland R4d ago
-
Technical Lead, Senior AI Engineer - VonHalsky (m/f/n) PLN 254K-360KAgent/tool use | At-Scale | Braintrust | CI/CD | Cloud ComputingB2B contract | Direct access to frontier models | Flexible hours | Hybrid work | Training opportunitiesSenior-level Contract Full TimeKraków, Poland R4d ago
-
AI Security | API Design | Agent systems | Agentic AI | Claude APIContract engagement | Fully remote work model | International technology focused environment | Opportunity to work on enterprise AI platform | Technical leadership and ownershipSenior-level Full TimePoland R4d ago
-
Junior Data Engineer (Azure Databricks) PLN 98K-118KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Data FactoryCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesEntry-level Full TimeKraków, Lesser Poland Voivodeship, Poland R4d ago
-
Mid-level Full TimePoland4d ago
-
Asset Analytics Engineer PLN 151K-258KAPIs | CMMS | Data Lineage | Data Modeling | Data QualityHybrid work | Medical care | Performance feedback | Private & life insurance | Sports cardMid-level Full TimeKatowice, PL R4d ago
-
Petroleum Data Engineer - Subsurface and Drilling Domain - Tieto Tech Consulting (m/f/d) PLN 92K-136KAI workflows | ArcGIS | Azure | Azure AI | Data ModelingEntry-level Full TimeŁódź, Łódź Voivodeship, Poland5d ago
-
Petroleum Data Engineer - Subsurface and Drilling Domain - Tieto Tech Consulting (m/f/d) PLN 92K-136KArcGIS | Azure | Classification | DISKOS | Data QualityEntry-level Full TimeKraków, Lesser Poland Voivodeship, Poland5d ago
-
Petroleum Data Engineer - Subsurface and Drilling Domain - Tieto Tech Consulting (m/f/d) PLN 92K-136KAI workflows | ArcGIS | Data Pipelines | Data Quality | GeoAIAgile team collaboration | Diversity and inclusion | Iterative development with SMEs | Stakeholder managementEntry-level Full TimeSzczecin, West Pomeranian Voivodeship, Poland5d ago
-
Petroleum Data Engineer - Subsurface and Drilling Domain - Tieto Tech Consulting (m/f/d) PLN 92K-136KAI Services | Agile | ArcGIS | Azure | Data PipelinesEntry-level Full TimeWrocław, Lower Silesian Voivodeship, Poland5d ago