Data Engineer - Databricks, BI
Tasks
- Automate data quality checks and anomaly detection
- Build Databricks data pipelines
- Collaborate with BI developers to improve dashboard performance
- Design Unity Catalog assets with access controls and row level security
- Ensure end to end pipeline reliability and monitoring
- Implement CDC and incremental loads
- Implement versioning documentation and monitoring across environments
- Integrate and operationalize data from multiple systems
- Model BI datasets for Power BI
- Model data for machine learning workflows
- Optimize Delta Lake tables with Liquid Clustering
- Optimize datasets for query performance and semantic clarity
- Perform data validation source to target mapping
Perks/Benefits
Skills/Tech-stack
Anomaly Detection | Apache Spark | Change Data Capture | Data Capture | Data Quality | Data Validation | Databricks | Declarative Pipelines | Delta Lake | Delta MERGE | Delta Tables | ETL | Incremental loads | Liquid clustering | MLOps | Materialized views | Orchestration | Power BI | PySpark | Row Level Security | SAP | SQL | Spark Declarative Pipelines | Unity Catalog | Version control
Education
N/A
Roles
Related jobs
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeKatowice, Silesian Voivodeship, Poland R2d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship | Professional development opportunities | Relocation programMid-level Full TimePoznań, Greater Poland Voivodeship, Poland R2d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Big DataCertification programs | Health insurance | Mentorship | Professional development | Relocation programMid-level Full TimeGdańsk, Pomeranian Voivodeship, Poland R2d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeWrocław, Lower Silesian Voivodeship, Poland R2d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Data FactoryCertification programs | Health insurance | Internal mobility | Mentorship programs | Professional development opportunitiesMid-level Full TimeŁódź, Łódź Voivodeship, Poland R2d ago
-
Agile | Containerization | Data Glossary | Data Modeling | Enterprise DataConference access | Family benefits | Flexible working hours | Hybrid work | Language coursesMid-level Full TimeWarszawa, Województwo mazowieckie, Poland2d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CDHealth insurance | Internal mobility | Internship opportunities | Mentorship | Mentorship and talent investmentMid-level Full TimeKraków, Lesser Poland Voivodeship, Poland R2d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship programs | Relocation program | Remote work flexibilityMid-level Full TimeWarsaw, Masovian Voivodeship, Poland R2d ago
-
Data Engineer - HR support project (m/f/n) PLN 276K-280KAI tools | Apache Spark | Data Governance | Data Monitoring | Data PrivacyB2B contract | Flexible working model | Remote optionsMid-level Full TimeWarszawa, Województwo mazowieckie, Poland2d ago
-
A/B | A/B Testing | ARIMA | AWS Lambda | Amazon ECSConference co financing | Course co financing | English classes co financing | Flexible working hours | Individual development plansSenior-level Full TimeWrocław, Poland2d ago
-
Security Management - Data Engineer PLN 182K-258KAI Foundry | API Integration | Access Management | Ansible | App ServicesSenior-level Full TimeWrocław, DS, PL, 50-0862d ago
-
Senior Big Data Engineer PLN 188K-350KApache Spark | Azure | Big Data | CI/CD | Data QualityAgile culture | Collaborative team environment | Conference participation | Quarterly planning | Technical trainingSenior-level Full TimeWarsaw, Poland2d ago
-
Senior-level Full TimeWarsaw, Poland2d ago
-
Senior Data Engineer PLN 236K-242KAgile | Artificial Intelligence | BigQuery | CDC | Cloud ComputingSenior-level Full TimeWarszawa, Masovian, PL, 02-1462d ago
-
C# | CI/CD | Debugging | MATLAB | SimulinkHybrid work model | Life insurance | Private healthcare | Professional developmentEntry-level Full TimeŁódź, Łódzkie, PL, 92-2022d ago
-
Data Engineer - Superior Retail Execution PLN 276K-276KApache Spark | Azure | CI/CD | Cloud platform | Data ArchitectureHybrid work model | Private health care | Remote work options | Savings plans | Sport cardsMid-level Full TimeWARSAW PLANT & GO, Poland2d ago
-
Data Engineer (UA/RU Language speaking) EUR 49K-67KAPI Integration | AWS | Airflow | Airflow Orchestration | CRMAccess scoped retrieval and audit focus | Distributed team | Part time 20 hours per weekMid-level Full TimePoland3d ago
-
Analytical Engineer PLN 249K-284KApache Airflow | DBT | Data Contracts | Data Modeling | Data ObservabilityBreakfast and lunch catering | Career growth budget | Dental coverage | Family forming support | Fertility healthcare supportSenior-level Full TimeWarsaw R3d ago
-
Software Engineer - FDE PLN 225K-312KAWS | Azure | Data Modeling | Data Validation | Data WarehousingSenior-level Full TimePL-Warsaw-Lixa C3d ago
-
Senior-level Full TimeKraków, Województwo małopolskie, PL3d ago
-
MLOps Team Lead PLN 288K-384KAmazon Web Services | Apache Airflow | Apache Spark | CI/CD | Cloud platformSenior-level Full TimeWarsaw, Poland, PL3d ago
-
Senior-level Full TimeWrocław, Województwo dolnośląskie, PL3d ago
-
Power BI Engineer PLN 153K-218KAgile | Analytics engineering | DAX | DBT | Data ModelingAgile/Scrum environment | Flexible schedule | Flexible working hours | Hybrid or remote workplace | Technical equipmentMid-level Full TimeKraków, Lesser Poland Voivodeship, Poland - … R3d ago
-
1104 | Senior Data Engineer (Databricks) PLN 270K-384KACID | AWS | Access Control | Apache Spark | AzureSenior-level Full TimePoland - Remote R3d ago
-
Senior Machine Learning Engineer (E3) PLN 283K-358KAB Testing | AWS | BigQuery | Cloud Dataflow | Data DriftSenior-level Full TimeKrakow, Poland R4d ago