Senior Data Engineer
Lisbon, Lisbon, PT, 1050-094
EUR 50K-70K (estimate) Senior-level Full Time
Tasks
- Build optimize ETL/ELT pipelines
- Collaborate on cost governance and FinOps optimization
- Define data quality rules and monitoring
- Design Lakehouse architectures
- Enforce data contracts naming conventions and lifecycle management
- Implement CI CD for data pipelines and notebooks
- Implement Unity Catalog for governance lineage and access control
- Implement incremental processing CDC and schema evolution
- Implement ingestion from APIs event streams files databases and message brokers
- Integrate BI dataset modeling for BI analytics and ML
- Integrate Databricks with Azure AWS and GCP
- Manage dev test prod environments and infrastructure as code
- Mentor junior engineers and define best practices
- Optimize performance partitioning Z ordering caching and file sizing
- Provide technical leadership for data engineering teams
Perks/Benefits
- Buddy program
- Comprehensive onboarding program
- English courses
- Flexible work schedule
- Food allowance
- Good public transport access
- Hybrid work
- Private medical care
Skills/Tech-stack
ADLS | AWS | AWS Glue | Access Control | Amazon Redshift | Amazon S3 | Analysis Services | Apache Spark | Azure | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory | Azure DevOps | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | CD pipelines | CI/CD | CI/CD pipelines | Change Data Capture | DAX | Data Capture | Data Contracts | Data Factory | Data Modeling | Data Privacy | Data Quality | Databricks | Delta Lake | Dimensional Modeling | ELT | ETL | GCP | GitHub Actions | GitLab | Incremental processing | Infrastructure as Code | Lakehouse Architecture | Medallion Architecture | Power BI | Powershell | PySpark | Role-Based Access | Role-Based Access Control | SQL Database | Schema evolution | Spark SQL | Synapse | Synapse Analytics | Tabular models | Terraform | Unity Catalog | “as-code”
Education
Roles
Related jobs
-
Software Engineer – Embedded AI (C++) (f/m/div.) EUR 55K-57KAPI Design | C plus plus | CI/CD | Clean Code | Computer VisionCanteen | Career progression | Flexible work conditions | Free parking lot | Health insuranceSenior-level Full TimeUnião das freguesias de Cardielos e … R10h ago
-
Mid-level Full TimeLisbon Office R1d ago
-
AWS | AWS CloudFormation | AWS DMS | AWS Glue | AWS Glue CatalogContract-based compensation | Flexible work location | Fully remote | Technical autonomySenior-level Contract Full TimePortugal R1d ago
-
AWS | Automation | Azure | Backup and Recovery | Cloud ComputingHybrid workMid-level Full TimeLisbon, Lisbon, Portugal1d ago
-
Actor-critic | CI/CD | Computer Vision | Deep learning | Distributed CheckpointingAutonomy and ownership | Career growth opportunities | Continuous learning support | Flexible work environment | Impactful AI research projectsSenior-level Full TimePortugal1d ago
-
AKS | Azure AI | Azure DevOps | Azure Machine Learning | CI/CDCareer growth | Collaborative culture | Continuous learning | High ownership culture | International work environmentSenior-level Full TimePortugal R1d ago
-
Data Engineer EUR 24K-35KAlteryx | BO Universe | Data Governance | Data pipeline | Database performanceCoffee | Fruits Snacks | Health and wellness benefits | Health insurance | Life insuranceEntry-level Full TimeLisbon, Lisbon, Portugal1d ago
-
Data Engineer EUR 40K-55KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksHybrid workMid-level Full TimeHíbrido (Oporto, Distrito de Oporto, Portugal) R2d ago
-
Data Engineer (Cloud Solutions) EUR 40K-55KChain management | Data Lake | Data Modeling | Data Warehousing | Data integrationHybrid workMid-level Full TimeHíbrido (Oporto, Distrito de Oporto, Portugal) R2d ago
-
Senior Data Engineer - Platform EUR 62K-75KBigQuery | Cloud Functions | Cloud Run | Data Lake | Data WarehousingHybrid work | Open Source friendly | Training and certificationSenior-level Full TimePorto2d ago
-
FullStack Data Engineer EUR 46K-65KAWS | AWS Batch | AWS CDK | AWS CloudFormation | AWS FargateHybrid work modelMid-level Full TimeLisbon, Lisbon, Portugal2d ago
-
Senior Full-Stack Engineer EUR 50K-61KAWS | Autoscaling | Distributed tracing | Event Driven | Event-driven architectureSenior-level Full TimePortugal2d ago
-
Data Engineer (Cloud Solutions) EUR 39K-60KData Lake | Data Modeling | Data Visualization | Data Warehousing | ETLHealth insurance | Meal allowance | Paid vacation | Referral bonus | Special discountsSenior-level Full TimePorto, Portugal R2d ago
-
Data Engineer SAS Migration EUR 39K-60KAzure Synapse | Python | SQLFlexible benefits | Health insurance | Meal allowance | No-term full-time contract | Paid vacationSenior-level Full TimeLisbon, Portugal R2d ago
-
Data Engineer - BigData EUR 50K-60KAgile | Data Modeling | Git | HDFS | HadoopHealth insurance | Meal allowance | Paid vacation | Referral bonus | Special discountsSenior-level Full TimePorto, Portugal R2d ago
-
Databricks Data Engineer EUR 57K-72KApache Spark | Data Catalog | Data Engineering | Data Governance | Data LakeFlex Options | Great team culture | Health insurance | Meal allowance | No-term contractSenior-level Full TimeLisbon, Portugal R2d ago
-
Distributed Cloud | Data Engineer EUR 65K-65KAgile | Amazon Redshift | Apache Spark | CI/CD | DatabricksMid-level Full TimeLisboa, Lisboa, Portugal2d ago
-
Data & AI Senior Engineer EUR 39K-66KAccess Control | Azure Databricks | CI/CD | Cloud Architecture | Cloud Cost OptimizationGreat office locations | Health insurance | Hybrid work | Life insurance | Referral bonusesSenior-level Full TimeLisboa, PT2d ago
-
Sr Machine Learning Engineer EUR 60K-89KAWS | AWS Bedrock | Access Control | Agent Frameworks | AgileSenior-level Full TimePortugal - ACC2d ago
-
AI Engineer (Machine Learning & Generative AI) EUR 50K-68KAPI | CI/CD | Calibration | Classification | Cloud servicesSenior-level Full TimePortugal - ACC2d ago
-
Senior-level Full TimePortugal - ACC2d ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R2d ago
-
AWS Data | AWS Data Lakes | Amazon Web Services | Apache Spark | Data AnalysisFlexible work schedule | Hybrid work modelSenior-level Full TimeToronto, Ontario; Remote, Canada; Toronto, Ontario; … R2d ago
-
CI/CD | Data Ingestion | Data Modeling | Data Quality | Data ReconciliationOnsite Days Per Week | Remote work flexibilityMid-level Full TimePorto/remote, Porto/remote R2d ago
-
Senior AI Engineer w/ ML EUR 39K-60KAmazon Web Services | Artificial Intelligence | Asynchronous APIs | Azure | Cloud platformHealth insurance | Paid time off | Udemy accessSenior-level Full TimeLisboa, Lisboa2d ago