Data Engineer Databricks
Tasks
- Collaborate with architects to translate designs into implementations
- Conduct peer code reviews and mentor junior engineers
- Create high-performance batch and streaming pipelines
- Design and implement ETL/ELT processes with PySpark SQL notebooks
- Ensure best engineering practices including testing CI/CD version control documentation
- Integrate Azure services like Data Factory Data Lake Event Hub Synapse
- Maintain data quality governance standards
- Optimize Spark jobs for reliability and scalability
Perks/Benefits
- Comprehensive training and certifications
- Flexible remote work options
- Health and wellbeing programs
- Life and accident insurance
- Paid holidays and extra leave options
- Social responsibility initiatives
Skills/Tech-stack
N/A
Education
Related jobs
-
Senior Data Engineer (all genders) EUR 62K-72KAPIs | DBT | Data Architecture | Data Cataloging | Data LineageFree Membership | Friends and family discount | Hybrid work model | Internal training | Language classesSenior-level Full TimeBarcelona; Madrid; València, Valencia, Spain1d ago
-
Data Engineer EUR 38K-42KAWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Apache SparkCompany events | Hybrid remote work | Language lessons | Life insurance | Meal allowanceSenior-level Full TimeValencia, Spain2d ago
-
Senior Data Engineer (Analytics) EUR 68K-90KAWS | AWS Glue | Amazon EKS | Amazon EMR | Amazon KinesisCommute support | Health coverage | Lunch | SportsSenior-level Full TimeMadrid Office2d ago
-
Senior Data Engineer I EUR 60K-72KAirflow | Apache Beam | DBT | Data Governance | DockerDisConnect days | Flexible work arrangements | Global induction program | Stock purchase plan | Talent development programsSenior-level Full TimeValència, VC, Spain8d ago
-
Senior Data Engineer - Databricks (m/f/*) EUR 54K-70KAWS | Apache Spark | Azure | CI/CD | Data ModelingCareer growth | Educational resources | Flexible work options | Team eventsSenior-level Full TimeMadrid, Madrid, Spain R29d ago
-
Senior Data Engineer (m/f/*) EUR 46K-56KApache Spark | Cloud Platforms | Data Engineering | Data Processing | Data QualityCareer development | Certifications | Remote or hybrid work | Team events | Udemy accessSenior-level Full TimeMadrid, Madrid, Spain R29d ago
-
Senior Data Engineer EUR 67K-102KAWS | Airflow | Automation | BI tools | Data Governance21 days leave | Equipment provided | Flexible hours | Flexible work | Inclusive cultureSenior-level Full TimeSpain, Spain29d ago
-
Senior Data Engineer EUR 68K-87KAWS | Airflow | Apache Iceberg | BigQuery | DagsterCompany events | Critical illness cover | EAP | Family support | Hybrid workingSenior-level Full TimeBarcelona, ES29d ago