Data Engineer (Azure Databricks)
Tasks
- Build and optimize data transformations using PySpark and SQL
- Collaborate with BI teams to support Power BI reporting
- Design and develop data pipelines using Azure Databricks
- Design and evolve cloud based data architectures
- Design and maintain data models and data warehouse structures for analytics
- Ensure data quality scalability and performance of data processing pipelines
- Implement and maintain Lakehouse architectures using Delta Lake
- Integrate data from multiple sources into data platform
- Orchestrate ETL and ELT pipelines using Azure Data Factory
- Support and evolve SQL Server data platforms and ETL solutions using SSIS
Perks/Benefits
- Certification programs
- Health insurance
- Mentorship
- Professional development opportunities
- Relocation program
- Work from anywhere
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Data Factory | Delta Lake | ELT | ETL | Lakehouse | Power BI | PySpark | SQL | SQL Server | SSIS | Spark SQL | Structured Streaming
Education
N/A
Roles
Related jobs
-
ML Engineer (AdTech) PLN 216K-276KApache Spark | BigQuery | CI/CD | Cloud Storage | Cloud platformHealth and wellness benefits | On call readiness training | Speed coaching | Sports trainingMid-level Full TimeWarszawa, Poland11h ago
-
Senior Data Engineer PLN 258K-385KAWS | Apache Airflow | Apache Spark | Azure | BigQueryDotdigital day | Loyalty reward | Medical benefits | Paid sick leave | Parental leaveSenior-level Full TimePoland, Poland12h ago
-
Senior Data Engineer PLN 258K-396KAPI Development | Apache Spark | Azure | Azure Data | Azure Data FactoryCafeteria system | Friendly atmosphere | Insurance | Medical packagesSenior-level Full TimePoland, Poland1d ago
-
Amazon Redshift | DBT | Data Documentation | Data Modeling | Data QualityFully remote work | Healthcare coverage | Home office equipment allowance | Learning and development budget | Paid parental leaveSenior-level Full TimePoland R1d ago
-
Software Engineer, Data Platform Insights PLN 288K-400KCI/CD | DBT | Data pipeline | Databricks | DatahubHybrid work environment | Inclusive workplaceSenior-level Full TimeWarsaw, Poland1d ago
-
Mid-level Full TimeWarsaw1d ago
-
Senior AI Engineer PLN 182K-321KAgile | Ansible | Authentication | Autoscaling | AzureFlexible work arrangements | In-office fitness center | Lunch subsidy | Mentoring programs | Private health careSenior-level Full TimeWARSAW DOWNTOWN OFFICE, Poland1d ago
-
Lead Data Engineer - Mergers & Acquisitions PLN 19K-35KAPI Development | AWS Glue | AWS Lambda | Amazon Athena | Amazon EKSAdditional paid leave | Flex location | Group life insurance | Multisport | Private healthcareSenior-level Full TimeWarsaw Grafit, Poland1d ago
-
Technical Solutions Engineer, Databases (English) PLN 156K-246KC plus plus | C# | DNS | Data Processing | Data Processing Frameworks24x7 support coverage | Global team support | Non standard work hours or shiftsMid-level Full TimeWarsaw, Poland2d ago
-
AWS Bedrock | Azure OpenAI | CI/CD | Docker | Function CallingCommuter benefit | Pension program | Professional development budget | WFH stipend | Wellness benefitSenior-level Full TimeWarsaw, Poland2d ago
-
Software Engineer II PLN 180K-274KAlgorithms | Apache Spark | Azure | Complexity analysis | Data StructuresMid-level Full TimeLodz, Poland2d ago
-
Data Lead Engineer PLN 258K-384KAWS | AWS Glue | Amazon EMR | Amazon S3 | Apache IcebergHybrid work | International projects | Multicultural team | Permanent full-time contract | Training and career developmentSenior-level Full TimeWarsaw, Masovian Voivodeship, Poland2d ago
-
Data Science Engineer PLN 282K-402KAWS | Airflow | CI/CD | Deep learning | DockerCareer development | Equal opportunity workplaceSenior-level Full TimeWrocław, Poland2d ago
-
Senior GenAI Engineer PLN 282K-408KAWS | Autogen | Azure | Azure DevOps | CI/CDContinuous learning | Diverse and inclusive cultureSenior-level Full TimeKatowice, Śląskie, PL, 40-2022d ago
-
Senior-level Full TimeWarszawa, Masovian, PL, 02-1463d ago
-
Junior Data Engineer (maternity cover) PLN 96K-132KApache Airflow | CI/CD | Cloud Data | Cloud Data Warehouse | ConsulCafeteria benefits | English classes | Hackathons | Health insurance | Hybrid workEntry-level Full TimeWarszawa, PL, 00-841 R3d ago
-
Junior Data Engineer (maternity cover) PLN 96K-132KApache Airflow | Apache PySpark | BigQuery | CI/CD | ContainerizationCafeteria plan fringe benefits | English classes | Hackathons | Hybrid work model | InsuranceEntry-level Full TimeWarszawa, PL, 00-841 R3d ago
-
Senior Backend Engineer with AI PLN 262K-400KAgentic Systems | Asynchronous programming | Cloud platform | Concurrency | Data PipelinesSenior-level Full TimeWrocław4d ago
-
Senior-level Full TimeGdańsk, Poland5d ago
-
Senior Machine Learning Research Engineer (20266) PLN 300K-384KComputer Vision | Deep learning | Machine Learning | Python | SQLEnglish-speaking environment | Equity | Flexible working hours | Hybrid work | Relocation packageSenior-level Full TimeWarsaw, Poland5d ago
-
Senior Data Engineer (with Backend Experience) PLN 258K-384KAPI Gateway | AWS EKS | AWS EMR | AWS Lambda | Amazon S3Flexible working hours | Hybrid or in office work option | Internal training sessions | Remote work option | Training budgetSenior-level Full TimeWarszawa, Poland R7d ago
-
AI Engineer PLN 185K-237KAzure | Big Data | CI/CD | Continuous Delivery | Continuous integrationFlexible work arrangements | In-office fitness center | Internal coaching | Life insurance | Lunch subsidyMid-level Full TimeWARSAW DOWNTOWN OFFICE, Poland7d ago
-
Senior Data Engineer PLN 258K-396KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksCafeteria system | Private healthcare | Private insurance | Sports cardSenior-level Full TimeWrocław, Poland8d ago
-
Machine Learning Engineer PLN 163K-229KAWS | Apache Airflow | Apache Spark | CI/CD | Cloud platformAdditional paid time off | Language classes | Learning and development opportunities | Paid sick days | Private medical coverageMid-level Full TimeWarsaw, Poland8d ago
-
[WBG] Senior Data Engineer PLN 240K-396KAzure Data | Azure Data Factory | CI/CD | DBT | Data FactoryExternal training | Flexible remote work | Internal training | International business trips | International projectsSenior-level Full TimeKraków, Lesser Poland Voivodeship, Poland8d ago