Senior Data Engineer (Python/PySpark/Kafka) - Full Remote Portugal
Tasks
- Architect lakehouse infrastructure
- Build batch data pipelines
- Build streaming data pipelines
- Create AI ready governed data infrastructure
- Develop data governance and lineage framework
- Establish data contracts with backend teams
- Migrate workloads to Apache Iceberg format
- Model data using SQL
- Support adoption of data platform capabilities
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | BigQuery | CI/CD | DBT | Dagster | Data Governance | Data Lineage | Data Modeling | Databricks | Datahub | Delta Lake | Infrastructure as Code | Machine Learning | PySpark | Python | SQL | Snowflake | Trino | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Data Engineer EUR 55K-69KAirflow | Amazon S3 | ClickHouse | Data Lake | Data WarehouseCo-working | Company paid sick leave | English learning courses | Gym or swimming pool | Home office setup assistanceSenior-level Full TimePortugal - Remote R1d ago
-
Senior AI Engineer - Hybrid Lisbon EUR 64K-93KAgile | Amazon Web Services | Apache Hadoop | Apache Spark | CI/CDEnglish B2 requirement | Hybrid workSenior-level Full TimeLisbon, Portugal R1d ago
-
Amazon Web Services | Apache Flink | Apache Kafka | Apache Spark | CassandraHybrid workSenior-level Full TimePorto, Portugal R1d ago
-
API Design | Agentic architecture | CI/CD | Cloud Computing | DockerEmployee stock option plan | Flexible scheduling | Fully remote | Health insurance | Home office setup allowanceMid-level Full TimePortugal R1d ago
-
API Integration | Amazon Redshift | Bitbucket | CI/CD | Data GovernanceAgile team environment | End of week summaries | Remote work | Weekly update callsMid-level Full TimePortugal R2d ago
-
AI Engineer (essentially remote) EUR 56K-80KAWS | Azure | Deep learning | Distributed Computing | Google CloudCareer progression | Free psychologist consultations | Health insurance | Job stability | Opportunity to lead major projectsSenior-level Full TimeLisboa/ Porto, Lisboa/ Porto R2d ago
-
Agile | Android | C# | C++ | Computer VisionCareer growth programs | Health insurance | Hybrid work | Life insurance | Referral bonusSenior-level Full TimeLisboa, PT R3d ago
-
C++ | Deep learning | Ggml | JavaScript | Language ModelsCollaboration with top talent | Exposure to advanced AI technologies | Fully remote | Global distributed work environment | High ownershipSenior-level Full TimePortugal R4d ago
-
Lead Agentic AI Engineer EUR 56K-79KANN | Agent Orchestration | Agile | Approximate Nearest Neighbor | CI/CDSenior-level Full TimePortugal - Remote R4d ago
-
DS/ML Engineer EUR 58K-79KAmazon SageMaker | Entity Resolution | Experiment Management | Kubeflow | MLOpsAutonomy | Mentorship | Work anywhere | Work from homeSenior-level Full TimePortugal - Lisbon R5d ago
-
A/B | A/B Testing | AWS | Apache Airflow | B testingAnnual bonus | Conference budget | Health insurance | Life insurance | Permanent contractSenior-level Full TimeRemote Portugal, Portugal R5d ago
-
GCP Data Engineer | BPCE-SI EUR 35K-54KApache Airflow | BigQuery | Cloud APIs | Cloud Composer | Cloud platformElectric bikes | Flexible work policy | Green transportation budget | Hybrid work policy | Inclusive DEI strategyMid-level Full TimePortugal, Portugal R7d ago
-
Data Engineering Specialist EUR 28K-49KBI | Classification | Data Bricks | Data Engineering | Data LakesHybrid work | Inclusive work culture | Professional developmentMid-level Full TimeLisbon - Antonio, Portugal R8d ago
-
Security Engineer, Data Protection - Associate EUR 44K-67KAccess Control | Access Control Lists | Address translation | Automation | CASBEmployer paid dental insurance | Employer-paid health insurance | Paid time off | Professional development and certifications | Remote workMid-level Full TimeLisbon, Portugal R8d ago
-
Data Engineer EUR 38K-65KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SynapseFlex Options | Health insurance | Meal allowance | No-term contract | Paid vacationSenior-level Full TimeLisbon, Portugal R11d ago
-
Mid-level Full TimeAnywhere, Portugal R12d ago
-
API Security | Access Control | Airflow | Amazon Redshift | BigQueryFlexible hours | Remote workSenior-level Full TimePortugal - Remote R14d ago
-
Sr. Applied AI Engineer EUR 58K-81KAgent Orchestration | Agentic loops | Asynchronous services | Benchmarking | CachingEmployee resource groups | Flexible work environment | Hybrid work model | Remote work optionSenior-level Full TimeLisbon, Portugal R15d ago
-
AWS Lambda | AWS S3 | Apache Airflow | Apache Kafka | CI/CDHealth benefits | Mentoring | Professional development | Remote workSenior-level Full TimePorto, Portugal R16d ago
-
Senior Software Engineer (big data) EUR 72K-88KAWS | Algorithms | Apache Iceberg | Apache Spark | CI/CDSenior-level Full TimeRemote Portugal R16d ago
-
Senior Software Engineer (big data) EUR 72K-88KAWS | Apache Iceberg | Apache Spark | CI/CD | Data LakehouseSenior-level Full TimeRemote Portugal R16d ago
-
Senior-level Full TimeRemote, Portugal R18d ago
-
AWS | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkRemote work | Travel up to 15%Senior-level Full TimePorto, Portugal R22d ago
-
Agile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DevOpsFull remote work | Portugal locationSenior-level Full TimeLisbon, Portugal R23d ago
-
Senior ML Engineer @JobCloud EUR 50K-74KAWS | Agent systems | Cloud Computing | Containerization | Data QualityConference budget | Flexible work arrangement | Fully remote or hybrid work | Gym allowance | Meal allowanceSenior-level Full TimeVila Nova de Gaia, Portugal R23d ago