Senior Data Engineer (Databricks Migration)
Lisbon, Lisbon, Portugal
EUR 48K-70K (estimate) Senior-level Full Time
Tasks
- Analyze ETL ELT workloads and define migration approach
- Apply data governance and security using Unity Catalog
- Build Spark based data processing solutions with PySpark
- Conduct code reviews and improve reliability
- Design lakehouse architecture with Databricks and Delta Lake
- Develop scalable data pipelines for large volume datasets
- Implement Airflow orchestration
- Implement medallion data layers bronze silver gold
- Migrate analytical platform from BigQuery to Databricks
- Optimize incremental processing and transformation frameworks
- Support production deployments and platform modernization
- Troubleshoot and optimize SQL and Spark workloads
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | CI/CD | Data Processing | Databricks | Declarative Pipelines | Delta Lake | Dimensional Modeling | Distributed data | Distributed data processing | ELT | ETL | GCP | Lakehouse | Medallion Architecture | PySpark | Python | SQL | Spark Declarative Pipelines | Unity Catalog
Education
N/A
Roles
Related jobs
-
Alerting | Data Pipelines | Distributed Systems | GPU Performance | InferenceMid-level Full TimePortugal R7h ago
-
LLM Application Engineer EUR 49K-67KAgentic Workflows | Context engineering | Distributed Systems | Evaluation | ExperimentationMid-level Full TimePortugal R7h ago
-
API Development | Access Management | Auto Scaling | Cloud Computing | Cost OptimizationSenior-level Full TimePortugal20h ago
-
Senior AI Developer Experience Engineer EUR 54K-75KAI Agents | API Design | Agentic Workflows | Azure DevOps | CI/CDFixed-term contractSenior-level Full TimePorto - Portugal R1d ago
-
Data Engineer - Azure EUR 30K-57KApache Spark | Azure | Azure Databricks | Data Architecture | Data GovernanceDiscounts on cars | Flexible hours | Flexible working hours | Health insurance | Home-office allowanceMid-level Full TimeLisbon R2d ago
-
Platform Engineer (Analytics, Data & AI) EUR 41K-62KAI Foundry | API Management | Azure AI | Azure AI Foundry | Azure APICompany gym access | Continuous learning | Flexible working hours | Free parking | Hybrid work modelMid-level Full TimePorto, PT, 4000-457 R2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career growth opportunities | Flexible work environment | Remote-friendlyMid-level Full TimeBraga, Portugal3d ago
-
Agile | Build Automation | CI/CD | Continuous Delivery | Continuous integrationCanteen | Career progression | Discounts on partnerships and Bosch products | Flexible work conditions | Free parking lotSenior-level Full TimeBraga, Braga, Portugal R3d ago
-
Platform Engineer (DevOps / DataOps) EUR 36K-45KAmazon Web Services | CI/CD | Cloud Security | Git | Identity ManagementFlexible working model | International work environment | Training opportunitiesEntry-level Full TimeLousado, Braga, Portugal3d ago
-
Senior AI Engineer 🇪🇺 EUR 50K-79KA/B | A/B Testing | AWS | Agentic Systems | Anti Prompt InjectionCompany equipment provided | Company shares | Coworking allowance | Fitness membership access | Home office setup budgetSenior-level Full TimeAll France (remote) R3d ago
-
DB2 | Data Architecture | Data Engineering | Data Integrity | Data MigrationSenior-level Full TimeLisbon, Portugal3d ago
-
Software Engineer – Embedded AI (C++) (f/m/div.) EUR 55K-57KAPI Design | C plus plus | CI/CD | Clean Code | Computer VisionCanteen | Career progression | Flexible work conditions | Free parking lot | Health insuranceSenior-level Full TimeUnião das freguesias de Cardielos e … R4d ago
-
Data Engineer – IKEA Supply EUR 42K-46KDatabricks | Databricks Lakeflow | ELT | ETL | MatillionFlexible medical insurance | Remote work | Technology training accessSenior-level Full TimeLisboa, Lisboa R4d ago
-
Data Engineer | Lisboa EUR 28K-30KAirflow | Apache Airflow | Astronomer | BigQuery | Cloud platformContinuous learning | Employee discounts | Partnership discounts | Wellbeing initiatives | Work-life balance initiativesMid-level Full TimeEXPO, PT4d ago
-
Senior AI Engineer – Notebooks EUR 70K-90KBackend Development | Evaluation | Go | LLM | Language ModelsEmployee stock purchase plan | Global health benefits | Hybrid workplace | Inclusive community culture | Mentor/Buddy programSenior-level Full TimeBordeaux, France; Dublin, Ireland; France, Remote; … R4d ago
-
Mid-level Full TimeLisbon Office R4d ago
-
AI Engineer (.NET / Azure AI) EUR 25K-65K.NET | API Development | Angular | Ansible | Azure OpenAIComfort budget | Dental insurance | Flexible working hours | Health insurance | MentoringMid-level Full TimeCoimbra, Portugal R4d ago
-
AWS | AWS CloudFormation | AWS DMS | AWS Glue | AWS Glue CatalogContract-based compensation | Flexible work location | Fully remote | Technical autonomySenior-level Contract Full TimePortugal R5d ago
-
AI Engineer EUR 45K-60KAI Agents | AI Foundry | AI Search | API Design | API VersioningEmployee resource groups | Flexible leave | Global Wellbeing Days | Growth opportunities | Paid time offSenior-level Full TimeLisbon, Portugal R5d ago
-
Actor-critic | CI/CD | Computer Vision | Deep learning | Distributed CheckpointingAutonomy and ownership | Career growth opportunities | Continuous learning support | Flexible work environment | Impactful AI research projectsSenior-level Full TimePortugal5d ago
-
AKS | Azure AI | Azure DevOps | Azure Machine Learning | CI/CDCareer growth | Collaborative culture | Continuous learning | High ownership culture | International work environmentSenior-level Full TimePortugal R5d ago
-
Data Engineer EUR 24K-35KAlteryx | BO Universe | Data Governance | Data pipeline | Database performanceCoffee | Fruits Snacks | Health and wellness benefits | Health insurance | Life insuranceEntry-level Full TimeLisbon, Lisbon, Portugal5d ago
-
Data Engineer EUR 40K-55KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksHybrid workMid-level Full TimeHíbrido (Oporto, Distrito de Oporto, Portugal) R5d ago
-
Data Engineer (Cloud Solutions) EUR 40K-55KChain management | Data Lake | Data Modeling | Data Warehousing | Data integrationHybrid workMid-level Full TimeHíbrido (Oporto, Distrito de Oporto, Portugal) R5d ago
-
Senior Data Engineer - Platform EUR 62K-75KBigQuery | Cloud Functions | Cloud Run | Data Lake | Data WarehousingHybrid work | Open Source friendly | Training and certificationSenior-level Full TimePorto5d ago