Data Engineer - Databricks, BI
Tasks
- Automate data quality checks and anomaly detection
- Build Databricks data pipelines
- Collaborate with BI developers to improve dashboard performance
- Design Unity Catalog assets with access controls and row level security
- Ensure end to end pipeline reliability and monitoring
- Implement CDC and incremental loads
- Implement versioning documentation and monitoring across environments
- Integrate and operationalize data from multiple systems
- Model BI datasets for Power BI
- Model data for machine learning workflows
- Optimize Delta Lake tables with Liquid Clustering
- Optimize datasets for query performance and semantic clarity
- Perform data validation source to target mapping
Perks/Benefits
Skills/Tech-stack
Anomaly Detection | Apache Spark | Change Data Capture | Data Capture | Data Quality | Data Validation | Databricks | Declarative Pipelines | Delta Lake | Delta MERGE | Delta Tables | ETL | Incremental loads | Liquid clustering | MLOps | Materialized views | Orchestration | Power BI | PySpark | Row Level Security | SAP | SQL | Spark Declarative Pipelines | Unity Catalog | Version control
Education
N/A
Roles
Related jobs
-
(Senior) Software Engineer - SAP BW PLN 216K-336KABAP | ADSO | AMDP | Analysis for Office | Analytics CloudHybrid workSenior-level Full TimeKraków, PL10h ago
-
Technology Specialist - Databricks, Azure PLN 276K-276KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2English communication | Hybrid workEntry-level Full TimeKraków, PL10h ago
-
Senior Data Analytics/Solutions Engineer PLN 240K-328KAzure | Azure DevOps | CI/CD | Data Contracts | Data GovernanceHybrid workSenior-level Full TimeKraków, PL10h ago
-
Data Quality Engineer PLN 276K-276KADLS Gen2 | Agile | Asset bundles | Ataccama | AzureHybrid workMid-level Full TimeKraków, PL10h ago
-
Data Engineering Lead PLN 250K-360KApache Kafka | Azure | Azure Data | Azure Data Factory | Azure DatabricksHybrid workSenior-level Full TimeKraków, PL10h ago
-
Mid-level Full TimeWarsaw, Poland, PL1d ago
-
Mid-level Full TimeWrocław, Województwo dolnośląskie, PL1d ago
-
Mid-level Full TimeKraków, Województwo małopolskie, PL1d ago
-
Senior-level Full TimeWarsaw, Poland, PL1d ago
-
Software Engineer III, AI/ML Cloud PLN 280K-287KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalSenior-level Full TimeWarsaw, Poland1d ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R1d ago
-
Analytics Engineer (DBT, BigQuery) PLN 153K-228KAirflow | BigQuery | CI/CD | Code review | DBTCommunity focus | Hybrid work 3 days per week | In-person collaborationMid-level Full TimeWarsaw, Poland2d ago
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R2d ago
-
Associate Data Scientist (AI) PLN 163K-229KAWS | Agentic Applications | Azure | Calculus | DockerHybrid or remote flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Team eventsMid-level Full TimeBulgaria, Poland2d ago
-
Forward Deployed Engineer, Applied AI PLN 221K-328KAWS | Azure | Data Engineering | Data Modeling | Data ValidationSenior-level Full TimePL-Warsaw2d ago
-
BigQuery | Concept drift | Concept drift detection | Data Annotation | DatabricksSenior-level Full TimeWarszawa, Poland2d ago
-
Data Engineer PLN 276K-276KAWS Athena | AWS CloudFormation | AWS Glue | AWS Lambda | AWS RedshiftCareer growth | Coworking space option | English classes | English clubs | MacBook providedMid-level Full TimePoland2d ago
-
Machine Learning Engineer PLN 213K-328KAirflow | Azure | Data Processing | Distributed data | Distributed data processingFriendly atmosphere | Good working conditions | Self-development opportunities | Trust and autonomySenior-level Full TimeKraków, Małopolskie, Poland3d ago
-
Mid-level Full TimeWrocław, Województwo dolnośląskie, PL3d ago
-
Mid-level Full TimeWarsaw, Poland, PL3d ago
-
Mid-level Full TimeKraków, Województwo małopolskie, PL3d ago
-
Senior Data Analytics, Senior Vice President PLN 330K-562KConfluence | Counterparty Credit | Counterparty Credit Risk | Credit Risk | Data GovernanceDiscretionary annual performance bonus | Employee assistance program | Holidays allowance | Hybrid working model | Learning and development resourcesSenior-level Full TimeLocation(s): Warsaw, Mazovia, Poland R3d ago
-
Senior AI Engineer PLN 237K-309KAWS | Azure | Claude Code | Cloud platform | Code reviewHome-office equipment | Hybrid working model | Life insurance | Private medical care | Training and certification opportunitiesSenior-level Full TimeKatowice, PL3d ago
-
(Junior or Mid) Data Engineer with Snowflake PLN 81K-119KAWS Glue | Access Control | Access policies | Apache Airflow | Azure DevOpsAdditional leave | Baby leave | Birthday day off | Cafeteria benefits | Diversity initiativesEntry-level Full TimePoland - Warsaw - ASEC3d ago
-
Senior Data Modeller PLN 310K-410KAgile | BigQuery | CI/CD | Cloud Data | Cloud Data IntegrationTravel to KrakowSenior-level Full TimeKraków, PL, 30-3023d ago