Data Engineer (Azure Databricks)
Tasks
- Collaborate with BI teams to support Power BI reporting
- Design data models and data warehouse structures for analytics
- Design data pipelines using Azure Databricks
- Develop data transformations using PySpark and SQL in Databricks
- Ensure data quality, scalability, and performance
- Evolve cloud based data architectures
- Implement Lakehouse architectures using Delta Lake
- Integrate data from multiple sources
- Orchestrate ETL ELT pipelines with Azure Data Factory
- Support SQL Server data platforms and SSIS when required
Perks/Benefits
- Certification programs
- Health insurance
- Mentorship programs
- Professional development
- Relocation program
- Remote work
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CD | Data Factory | Data Modeling | Data Processing | Data Warehousing | Delta Lake | Distributed data | Distributed data processing | ELT | ETL | Lakehouse | Power BI | PySpark | SQL | SQL Server | SSIS | Spark SQL | Structured Streaming
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeMadrid, Europe, Spain14h ago
-
AI machine learning | Azure | DAX | Data Modeling | Data QualityDiscounts on training and programs | Flexible benefits | Flexible work hours | Health insurance | Intensive work scheduleMid-level Full TimeBarcelona, Spain R15h ago
-
LLM Engineer EUR 51K-68KCI/CD | Docker | Embeddings | Fine Tuning | Generative AIAnnual leave | Commuting allowance | Employee referral scheme | Flexible schedule | Home working allowanceMid-level Full TimeBarcelona, Spain15h ago
-
Knowledge Graph Engineer, R&D Data Science & Digital Health - Data Strategy and Products EUR 52K-80KAmazon Neptune | Azure DevOps | CI/CD | Containerization | Continuous DeliveryMid-level Full TimeES022 Janssen Madrid, Spain23h ago
-
Mid-level Full TimeGetafe, Spain23h ago
-
Embedded Software Engineer - HW/SW Co-Design EUR 60K-85KARM Fast Models | C# | C++ | CI/CD | ContainerizationSenior-level Full TimeSpain, Valencia, Cortes Valencianas23h ago
-
Senior-level Full TimeBarcelona, Spain23h ago
-
Senior Software Engineer (MLAI services) EUR 58K-79KAPI Design | Anthropic | ArgoCD | CI/CD | Distributed SystemsFlexible culture | Flexible work environment | Remote work flexibility | Self-care supportSenior-level Full TimeBarcelona, Spain; Madrid, Spain1d ago
-
Beca Data Engineer EUR 28K-35KData Engineering | Data Ingestion | Data Modeling | Data Pipelines | Data QualityCareer growth | Continuous training | Hybrid work | MentoringEntry-level Full TimeMadrid, Spain1d ago
-
Senior AI Engineer (All genders) EUR 60K-88KAgentic AI | Amazon Bedrock | Artificial Intelligence | Azure OpenAI | CI/CDAnnual vacation days | Bike leasing | Hybrid working | Private medical health insurance | Product discountSenior-level Full TimeMadrid, Spain1d ago
-
Backend Engineer AI Integration EUR 55K-60KAPI Integration | AWS | Agent systems | Asterisk | Asynchronous programmingBirthday day off | Flexible compensation platform | Gym membership | Language courses | Meal vouchersMid-level Full TimeMadrid, MD, Spain R1d ago
-
Backend Engineer AI Integration EUR 55K-60KAWS | Agent systems | Async Programming | Azure | CI/CDExtra day off for birthday | Flexible compensation platform | Gym wellness membership | Language courses | Meal vouchersMid-level Full TimeBarcelona, CT, Spain R1d ago
-
Senior Software Engineer, AI and Security EUR 60K-79KAI | Cloud Security | Data Modeling | Distributed Computing | Information RetrievalSenior-level Full TimeMálaga, Spain1d ago
-
Senior AI Engineer EUR 51K-78KAdversarial Red Teaming | Automated testing | Bias Mitigation | Data Visualization | Dependency InjectionDental plan | Flexible remuneration | Health insurance | Home office setup allowance | Office breakfast buffetSenior-level Full TimeBarcelona - Cataluña1d ago
-
Amazon Redshift | Analytics engineering | DBT | Data Modeling | Data QualityFully remote work | Healthcare coverage | Home office equipment allowance | Learning and development budget | Paid parental leaveSenior-level Full TimeSpain R1d ago
-
Front And Ai Engineer - Ingles - Remoto EUR 30K-40KA2A | AG-UI | ASP.Net Core | Active Directory | App ServiceEmployee benefits discounts | Employee training | Flexible compensation | Indefinite contract | Remote workSenior-level Full TimeSpain - Remote R1d ago
-
MLOPS ENGINEER – HIBRIDO o REMOTO – INGLES EUR 35K-40KAirflow | Apache Spark | CI/CD | Control-M | ETLDiscounts | Employee benefits club | Flexible compensation | Hybrid work option | Indefinite contractEntry-level Full TimeESPAÑA, ESPAÑA R1d ago
-
AWS | Amazon Redshift | Cloud Architecture | Code Versioning | Data LineageSenior-level Full TimeES022 Janssen Madrid, Spain1d ago
-
Data Engineers EUR 30K-36KAmazon S3 | Apache Airflow | Apache Spark | CI/CD | Data QualityCompany training | Conference attendance | Flexible compensation benefits | Flexible working hours | Indefinite contractMid-level Full TimeMadrid, MD, Spain R2d ago
-
Algorithms | Apache Airflow | Apache Beam | Architectural patterns | BigQueryFlexible hours | Health benefits | Mentorship | Remote work | TrainingSenior-level Full TimeSpain R2d ago
-
API | AWS | Automated testing | Azure | BigQueryConferences | Flexible time off | Health insurance | Mentorship | Referral bonusesSenior-level Full TimeSpain R2d ago
-
Apptainer | Bioinformatics | Conda | FAIR-Data | GenomicsEntry-level Full TimeFontenay-aux-Roses2d ago
-
Senior Data Lead Engineer EUR 46K-73KAWS | BI Semantic Modeling | CDC | CI/CD | ConfluenceHybrid work | International projects | Multicultural team | Permanent employment | Training and continuous career developmentSenior-level Full TimeMálaga, AN, Spain2d ago
-
Senior Machine Learning Engineer EUR 56K-79KAI Pipelines | AWS | CI/CD | Containerization | Data EngineeringCharitable giving program | Fitness reimbursement | Life insurance | Pension fund | Work anywhereSenior-level Full TimeSpain - Barcelona2d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time schedule | Project based workSenior-level FreelanceSpain - Remote R2d ago