Senior Data Engineer (Azure/Databricks/PySpark) - Hybrid Porto (2 days/week office)
Tasks
- Build Azure Data Factory pipelines
- Build Azure Databricks processing jobs
- Build Azure Synapse Analytics solutions
- Create data models
- Design data lakehouse architecture
- Develop ETL/ELT pipelines
- Gather requirements and translate into solutions
- Implement CI/CD pipelines
- Integrate multiple data sources
- Process large datasets with PySpark
- Support full data lifecycle maintenance
- Write SQL for data transformations
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake | Data Lakehouse | Data Modeling | Dimensional Modeling | ELT | ETL | IaC | Infrastructure as Code | Microsoft Fabric | Power BI | PySpark | Python | Relational modeling | SQL | Synapse Analytics | T-SQL | “as-code”
Education
N/A
Roles
Related jobs
-
Data Engineer GCP - Google Cloud Platform EUR 40K-65KBigQuery | Cloud platform | Data Modeling | Data Pipelines | DataflowAnnual leave | Continuous learning | Flexible benefits plan | Meal allowance | Private medical insuranceMid-level Full TimePorto, Portugal1d ago
-
Data Engineer GCP - Google Cloud Platform EUR 40K-65KBigQuery | Cloud platform | Data Modeling | Dataflow | Google CloudAnnual leave | Flexible benefits plan | Meal allowance | Private medical insuranceEntry-level Full TimePorto, Portugal1d ago
-
Agile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DevOpsFull remote work | Portugal locationSenior-level Full TimeLisbon, Portugal R1d ago
-
Agile | Generative AI | Langchain | Language Models | Large Language ModelsGym Ticket | Health insurance | Hybrid work | Meal cardEntry-level Full TimeLisbon, Lisbon, Portugal1d ago
-
Machine Learning Ops Engineer @JobCloud EUR 38K-66KAWS | CI/CD | Cloud platform | Data Governance | Data PipelinesAnnual paid vacation | Conference budget | Full Remote or Hybrid Work | Gym allowance | Meal allowanceMid-level Full TimeVila Nova de Gaia, Portugal2d ago
-
Machine Learning Ops Engineer @JobCloud EUR 38K-66KAWS | Amazon ECS | CI/CD | Cloud platform | Data PipelinesConference budget | Gym allowance | Hybrid work | Meal allowance | Paid sick leaveMid-level Full TimeVila Nova de Gaia, Portugal2d ago
-
Senior ML Engineer @JobCloud EUR 50K-74KAWS | Agent systems | Cloud Computing | Containerization | Data QualityConference budget | Flexible work arrangement | Fully remote or hybrid work | Gym allowance | Meal allowanceSenior-level Full TimeVila Nova de Gaia, Portugal R2d ago
-
Senior ML Engineer @JobCloud EUR 50K-74KAWS | Agentic AI | Containerization | Data Quality | DockerConference budget | Gym allowance | Hybrid work | Meal allowance | Paid time offSenior-level Full TimeVila Nova de Gaia, Portugal2d ago
-
Data Engineer EUR 41K-51KDBT | Data Modeling | Data Quality | Data Transformation | Data pipelineCareer development | Fast-growth startup environment | Hybrid work | Training and certificationMid-level Full TimeLisbon, Portugal2d ago
-
Senior GenAI Engineer EUR 48K-84KAI Services | Azure | Azure AI | Azure AI Services | Azure DataHealth insurance | Hybrid work model | Provision of work equipment | Remote workSenior-level Full TimeLisbon, Portugal2d ago
-
Distributed Cloud | Kubernetes Database Engineer EUR 69K-70KAnsible | Backup and Recovery | CI/CD | Data encryption | Disaster RecoveryMid-level Full TimePorto, Porto, Portugal2d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R2d ago
-
FinOps & Product Analytics Engineer EUR 59K-72KAWS | Amazon Redshift | Anomaly Detection | Anthropic | BigQueryFlexible hours | Home office stipend | Hybrid work | Meal allowance | Paid parental leaveMid-level Full TimePortugal Lisbon2d ago
-
Data Engineer EUR 30K-49KAWS | Alteryx | Apache Spark | Azure Data | Azure Data FactoryHybrid workMid-level Full TimeLisbon - Antonio, Portugal R2d ago
-
Data Engineer (Google) EUR 35K-46KApache Airflow | BigQuery | CI/CD | Cloud Composer | Data ModelingHybrid work flexibility | Professional community support | Remote work | Volunteer programMid-level Full TimeLisboa, PT2d ago
-
C# | MATLAB | NumPy | Pandas | PythonNon permanent assignment | Part-time project workSenior-level Full TimePortugal - Remote R2d ago
-
Senior Machine Learning Engineer: Ranking (Remote) USD 80K-120KAirflow | Databricks | Feature Store | Luigi | Machine LearningApple laptops provided | Fully remote team | Maternity and paternity leave | Regular team offsites | Training and development budgetSenior-level Full TimePortugal - Remote R2d ago
-
Mid-Level AI Engineer EUR 45K-70KAWS | Big Data | Event Driven | Event-driven architecture | Google CloudFlexible working hours | Friday afternoons off | Remote-first environment | Training programs | Transportation supportMid-level Full TimeLisboa, Portugal R3d ago
-
Mid-Level AI Engineer EUR 45K-70KAWS | BERT | Big Data | Event Driven | Event-driven architectureFlexible working hours | Friday afternoons off | Quarterly off-sites | Remote-first environment | Training programsMid-level Full TimeLisboa, Portugal R3d ago
-
Application Security | DAST | Dependency management | Fortify | KubernetesCareer progression | Free psychologist consultations | Health insurance | Job stability | Performance bonusesEntry-level Full TimePorto, Oporto3d ago
-
(Senior) Data Engineer - R&D Digital Solutions EUR 46K-46KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkCollaborative work style | Flexible working model | International work environment | Promotion opportunities | Training opportunitiesSenior-level Full TimeLousado, Braga, Portugal3d ago
-
Data Engineer – Cloud Platform (f/m/div.) EUR 45K-72KApache Spark | Azure Data | Azure Data Factory | Azure Purview | Azure SynapseCanteen | Career progression | Flexible work conditions | Free parking | Health and wellness activitiesSenior-level Full TimeAveiro, Portugal3d ago
-
Kubernetes Database Engineer EUR 72K-96KAnsible | Automation | CI/CD | Disaster Recovery | EncryptionOn-call rotation | Remote work | Shift based operationsSenior-level Full TimePorto, 13, Portugal3d ago
-
Senior Data Engineer EUR 50K-70KAWS S3 | Amazon Web Services | Apache Airflow | Apache Spark | Azure DatabricksAnnual team trip | Flexible working hours | Health insurance | Laptop and peripherals | Open holidaysSenior-level Full TimePorto, Porto District, Portugal - Remote R3d ago
-
Data Engineer / Data Analyst EUR 32K-36KApache Spark | DBT | Data Quality | Data pipeline | Dimensional ModelingFlexible benefits | Medical insurance | Unlimited training accessMid-level Full TimeLisboa, Lisboa3d ago