Data Engineer
Tasks
- Apply GitOps best practices
- Collaborate with data architects
- Coordinate requirements and milestones with stakeholders
- Define and perform data quality tests
- Design, build, maintain batch data pipelines
- Develop support real time data streams
- Document technical specifications workflows and deployments
- Implement CI CD monitoring and error handling
- Implement data transformations with Medallion Architecture
- Manage deploy infrastructure with Terraform
- Optimize troubleshoot large scale data jobs
- Orchestrate workflows with Airflow
- Perform code reviews
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Kubernetes | Azure Kubernetes Service | Batch Data Processing | Batch data | CI/CD | Data Governance | Data Lake Storage Gen2 | Data Privacy | Data Processing | Data Quality | Databricks | Error Handling | GitOps | Infrastructure as Code | Kubernetes Service | Medallion Architecture | Monitoring | PySpark | Streaming Data | Streaming data processing | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Energy Sector | Data Engineer EUR 31K-52KAWS | AWS CloudFormation | AWS Lambda | AWS SDK | AWS SDK for JavaScriptMid-level Full TimeLisboa, Lisboa, Portugal18h ago
-
API | AWS | AWS Kinesis | Apache Airflow | Apache KafkaRemote workSenior-level Full TimePorto, Portugal R1d ago
-
Sr. Platform Engineer (Analytics, Data & AI) EUR 49K-64KAzure Container | Azure Container Instances | Azure Cost Management | Azure Databricks | Azure DevOpsAnnual leave | Flexible working hours | Free parking | Gym access | Hybrid work modelSenior-level Full TimePorto, PT, 4000-4572d ago
-
Amazon SageMaker | Apache Airflow | CI/CD | Distributed Systems | DockerCross-functional collaboration | Remote workSenior-level Full TimePorto, Portugal R2d ago
-
ADLS Gen2 | Analysis Services | Apache Airflow | Azure Analysis | Azure Analysis ServicesMid-level Full TimeLisbon, Portugal2d ago
-
Staff Data Engineer EUR 85K-105KAWS | Airflow | Apache Flink | Apache Hadoop | Apache SparkHome office stipend | Manager training | PTO | Paid parental leave | Professional development coursesSenior-level Full TimePortugal4d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Laid-back atmosphere | Remote workMid-level Full TimePorto, Portugal5d ago
-
Data Engineer Internship EUR 25K-25KAWS | Airflow | Azure | DBT | Data ModelingHands on production experience | International diverse team | MentorshipEntry-level Full Time InternshipPT-Lisbon, Portugal5d ago
-
GCP Data Engineer (French Speaker) | BPCE-SI EUR 30K-40KApache Airflow | Apache Dataflow | BigQuery | Cloud Composer | Cloud StorageElectric bikes | English CV requirement | Green transportation budget | Hybrid work | Lactation RoomMid-level Full TimePortugal, Portugal5d ago
-
Data Platform Engineer (Data Integration) EUR 29K-41KAWS | Agile | CI/CD | Cloud Computing | Data ModelingFlexible working model | International work environment | Training opportunitiesMid-level Full TimeLousado, Braga, Portugal5d ago
-
CRM | Data Quality | Data Visualization | Power Automate | Power BIElectric bikes | Flexible hybrid work policy | Green transportation budget | Wellbeing programsSenior-level Full TimePorto, Porto, Portugal5d ago
-
Senior-level Full TimeLisboa, Portugal5d ago
-
AWS | AWS CDK | AWS Lambda | Amazon EC2 | Amazon ECSCareer coaching | Career progression | Health insurance | Hybrid work | Meal cardSenior-level ContractPortugal6d ago
-
Conversational Agent AI Platform Engineer EUR 60K-89KAPI Management | Airflow | Argo CD | CI/CD | DevSecOpsEntry-level Full TimeLisbon, Lisbon, Portugal6d ago
-
DevOps Engineer (all genders) EUR 42K-66KAWS | Amazon Elastic Kubernetes Service | Autoscaling | Azure | Azure KubernetesMid-level Full TimeLisbon, Lisbon, Portugal6d ago
-
Forward Deployed Engineer (all genders) EUR 60K-80KABAC | AI Agents | API Integration | Amazon Web Services | Asynchronous programmingMid-level Full TimeLisbon, Lisbon, Portugal6d ago
-
Mid-level Full TimeLisbon, Lisbon, Portugal6d ago
-
[Job-28122] Senior Data Engineering EUR 48K-65KApache Spark | Cloud Azure | Databricks | Python | SQLCareer development | Paid dental benefits | Paid health benefits | Paid parental leave | Paid sick leaveSenior-level Full TimePortugal7d ago
-
Software Engineer - Data Engineering EUR 18K-23KAirbyte | Airflow | Apache Beam | BigQuery | Data integrationHybrid work arrangement | Inclusive culture | Learning and development support | Life event leave | Social eventsMid-level Full TimeLisbon, Portugal R7d ago
-
Platform Engineer - Compute EUR 70K-98KAWS | Argo CD | CI/CD | Crossplane | DockerCollaborative environment | Remote work | Training and developmentEntry-level Full TimePortugal R7d ago
-
Data Engineer EUR 40K-50KAWS | Agile | Apache Spark | CI/CD | Data LakesComprehensive benefits | Fitness reimbursement | Work anywhereMid-level Full TimePortugal - Lisbon7d ago
-
Senior-level Full TimeLisbon8d ago
-
Senior-level Full TimeFuze Portugal - Aveiro Office8d ago
-
Senior-level Full TimeFuze Portugal - Aveiro Office8d ago
-
Data Engineer - Platform & Pipelines EUR 35K-49KAzure | Batch Processing | BigID | Data Modeling | Data Pipeline MonitoringMid-level Full TimeLisbon, PT8d ago