Data Engineer
Tasks
- Apply GitOps best practices
- Collaborate with data architects
- Coordinate requirements and milestones with stakeholders
- Define and perform data quality tests
- Design, build, maintain batch data pipelines
- Develop support real time data streams
- Document technical specifications workflows and deployments
- Implement CI CD monitoring and error handling
- Implement data transformations with Medallion Architecture
- Manage deploy infrastructure with Terraform
- Optimize troubleshoot large scale data jobs
- Orchestrate workflows with Airflow
- Perform code reviews
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Kubernetes | Azure Kubernetes Service | Batch Data Processing | Batch data | CI/CD | Data Governance | Data Lake Storage Gen2 | Data Privacy | Data Processing | Data Quality | Databricks | Error Handling | GitOps | Infrastructure as Code | Kubernetes Service | Medallion Architecture | Monitoring | PySpark | Streaming Data | Streaming data processing | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Entry-level Full TimeLisbon19h ago
-
Junior Data Engineer ZAR 228K-264KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaAutonomy | Flexible work practices | Learning and development support | Remote-firstEntry-level Full TimePortugal; South Africa R21h ago
-
Data Engineer ZAR 450K-500KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Learning and development | Mentorship | Remote workMid-level Full TimePortugal; South Africa R21h ago
-
Senior Data Governance Engineer (m/f/d) EUR 46K-46KAccess Control | Amazon Athena | Amazon Redshift | Collibra | DBTCoverflex advantage system | Employee discounts | Flexible working hours | Hybrid work model | No dress codeSenior-level Full TimeLisbon, Portugal23h ago
-
Data Engineer EUR 35K-39KAWS CloudFormation | Apache Airflow | BigQuery | Cloud platform | DBTFlexible work hours | Half day Friday | Inclusive international environment | Learning and training access | Paid volunteering daysMid-level Full TimeLisbon, Lisbon, Portugal R1d ago
-
Data Engineer EUR 42K-70KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHealth insurance | Hybrid work | Meal allowance | Paid vacation | Referral bonusSenior-level Full TimePorto, Portugal1d ago
-
Senior Software Engineer / Team Lead (C/C++ Embedded) - Hybrid Vila do Conde (2 days/week office) EUR 57K-75KARM Cortex | AUTOSAR | Activity Diagrams | Agile | Brushless DCHybrid work modelSenior-level Full TimeVila do Conde, Portugal R2d ago
-
Airbyte | Apache Airflow | DBT | Data Modeling | Data QualityFully remote | Home office setup budget | Language learning sessions | Paid sick days | Paid time offSenior-level Full TimePortugal R2d ago
-
AI Engineer EUR 61K-81KAgentic Workflows | CI/CD | Cost Optimization | Evaluation | Language ModelsSenior-level Full TimeLisbon, Lisbon, Portugal - Remote R2d ago
-
Senior Data Platform Engineer EUR 54K-84KAWS Glue | Apache Flink | Apache Hudi | Apache Iceberg | Apache SparkDiscretionary vacation | Equity shares | Flexible working hours | Health, dental, and vision insurance | Meal allowanceSenior-level Full TimePorto2d ago
-
Senior Data Engineer EUR 54K-79KAirbyte | Ansible | Apache Airflow | CI/CD | DBTCareer development support | Collaborative team | Creative freedom | Learning Support | Self serve toolingSenior-level Full TimePortugal2d ago
-
AWS | Agent Orchestration | Agile methodologies | Amazon Redshift | Apache AirflowFlexible working hours | Hybrid work model | No dress code | Private health insurance | Training and developmentSenior-level Full TimeLisbon, Portugal2d ago
-
BERT | CI/CD | Docker | FastAPI | GPTHybrid work | Onsite flexibility | Training and mentoringMid-level Full TimePorto, Portugal R3d ago
-
Anomaly Detection | Dashboarding | Data Modeling | Data Quality | Data ReconciliationCollaborative inclusive work environment | Continuous learning opportunities | Education support | Employee discounts | Family-friendly benefitsMid-level Full TimePortugal3d ago
-
AWS | Apache Flink | Apache Kafka | Apache Spark | Cloud platformAutonomy | Flexible time off | Flexible work hours | Fully remote | Global health coverageSenior-level Full TimePortugal R3d ago
-
Machine Learning Engineer EUR 57K-85KAWS | Argo Workflows | ArgoCD | Azure | DatabricksAnnual learning budget | Equity | Home office starter budget | Hybrid work model | Private medical insuranceMid-level Full TimeLisbon, Portugal3d ago
-
(Senior) Software Engineer (AI / ML) EUR 56K-79KArtificial Intelligence | CI/CD | Computer Vision | Docker | Docker ComposeAnnual retreats | Company computer and monitor | Flexible working arrangements | Health insurance | Paid annual leaveSenior-level Full TimeLisboa, Lisboa, Portugal3d ago
-
Data Engineer Lead | BPCE-SI EUR 40K-55KData Engineering | Data Quality | DataStage | ETL | IBM DataStageElectric bikes | Green transportation budget | Hybrid work | Lactation Room | Prayer roomSenior-level Full TimeLisbon, Lisbon, Portugal3d ago
-
Embedded Engineer - Audio (Co) (m/f/div) EUR 57K-72KBare Metal | C++ | CAN | CI/CD | CMakeCanteen | Career progression | Flexible work conditions | Free parking | GymSenior-level Full TimeOvar, Aveiro, Portugal3d ago
-
Active Directory | Airflow | Asset bundles | Autoloader | Azure Active DirectoryHealth insurance from start | Hybrid work model | Remote work when possible | Work equipment providedMid-level Full TimeLeiria, Portugal3d ago
-
Data Engineer EUR 61K-63KAWS | Apache Airflow | Apache Kafka | Apache Spark | Automated testingFlexible working hours | Hybrid work model | Lunch vouchers | Private health insurance | Transport subsidyMid-level Full TimePortugal, Porto, Professionals4d ago
-
CI/CD | Fastlane | Git | Multithreading | SOLIDAsynchronous culture | Portfolio support | Remote workSenior-level Full TimeBraga, Portugal5d ago
-
Senior-level Full TimePortugal, Lisbon, Portugal6d ago
-
Senior Data Engineer – AI & Agentic Pipelines EUR 38K-63KAWS | Agile | Amazon Redshift | Apache Airflow | CI/CDFlexible working hours | Hybrid work model | Private health insurance | Training and development | Volunteer daySenior-level Full TimeLisbon, Portugal6d ago
-
Data Engineer EUR 36K-48K.NET | Apache Spark | Autoloader | C# | CI/CDHealth insurance | Hybrid work model | Remote work whenever possible | Work equipment providedMid-level Full TimeLisbon, Portugal6d ago