Data Platform Engineer (Spark/Kafka/Databricks) – Full Remote Portugal
Tasks
- Build scalable data infrastructure
- Collaborate with data and ML engineers
- Create infrastructure as code
- Design Lakehouse architecture
- Develop distributed data processing pipelines
- Ensure data quality
- Implement streaming data pipelines
- Manage CI CD for data workflows
- Optimize SQL query performance
- Orchestrate data workflows
- Set up data observability
Perks/Benefits
Skills/Tech-stack
AWS | Amazon Redshift | Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Azure | CI/CD | Cloud platform | DBT | Dagster | Databricks | Delta Lake | Docker | Git | Google BigQuery | Google Cloud | Google Cloud Platform | Great Expectations | Kubernetes | Monte Carlo | Prefect | Pulumi | Python | SQL | Snowflake | Terraform
Education
N/A
Related jobs
-
Data Modeling | Data pipeline | Elasticsearch | Java | KibanaBirthday day off | Career mentoring | Health insurance | Life insurance | Referral bonusMid-level Full TimeLisbon, Portugal R1d ago
-
Senior Cloud Integration & Data Modelling Consultant (Microsoft Fabric/Power BI) – Full Remote Portugal EUR 31K-41KAgile | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics15th month salary | Birthday off | Family coverage | Health insurance | Mobility programSenior-level Full TimePorto, Portugal R1d ago
-
Agile | Azure Data | Azure Data Factory | Azure SQL | Azure SQL Database15th month salary | Birthday off | Health insurance | Mobility program | Work-life balanceSenior-level Full TimePorto, Portugal R1d ago
-
A/B | A/B Testing | Amazon SageMaker | Apache Airflow | Apache Spark15th month salary | Birthday off | Health insurance | Mobility program | Work-life balanceSenior-level Full TimeLeiria, Portugal R1d ago
-
AI Engineer Senior - Full Remote PT EUR 28K-37KAPI Design | AWS | Application engineering | Azure | C Sharp15th month salary | Birthday off | Health insurance | Mobility program for digital nomads | Work-life balanceSenior-level Full TimeLisbon, Portugal R1d ago
-
Senior GCP Data Engineer EUR 56K-74KAgile | BigQuery | CI/CD | Cloud Functions | Cloud platformAgile culture | Collaborative environment | Ongoing training and mentoring | Travel opportunitiesSenior-level Full TimePortugal / Brazil - Remote R1d ago
-
Data Engineer EUR 53K-70KAPI | Agile | Artificial Intelligence | Big Data | Data ModelingCareer advancement | Employee assistance program | Health insurance | Training opportunities | Work-life balanceSenior-level Full TimeHíbrido Venda do Pinheiro/ Porto, Híbrido … R2d ago
-
AI Agents | API Integration | Automation | JavaScript | Language ModelsAccess to cutting-edge technologies | Continuous growth | Contract to long term engagement | Fully remote | High autonomyMid-level Full TimePortugal R3d ago
-
APIs | AWS | Automation | Chatbots | Design PatternsAnniversary bonus | Annual leave | Company events | Health insurance | Learning and development planSenior-level Full TimeLisbon, Lisbon, Portugal - Remote R3d ago
-
Data Engineer, Fraud EUR 98K-98KApache Airflow | Apache Superset | CI/CD | ClickHouse | DBTFlexible work hours | Global co-working access | Retention bonus scheme | Team events and gatherings | Workstation providedSenior-level Full TimeLisbon, Lisbon, Portugal - Remote R3d ago
-
Staff Data Platform Engineer (Remote) EUR 64K-80KAirflow | Amazon Web Services | Apache Flink | Apache Iceberg | Apache SparkAI tool access | Remote work allowanceSenior-level Full TimeLisbon, Portugal R6d ago
-
Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | Control-MCareer coaching | Career progression opportunities | Discounts | Health insurance | Meal cardMid-level ContractLisbon R6d ago
-
Full Stack AI Engineer (Remote in Portugal) EUR 52K-65K.NET | API | APIM | Agents | AnthropicAutonomy and responsibility | Equipment provided | Fun company events | Home-office allowance | Online gym accessMid-level Full TimePortugal-Supports R8d ago
-
Senior Data Scientist and AI Dev EUR 55K-78KAI Services | AWS | Azure AI | Azure AI Services | Azure Machine LearningDiscounts | Full-time contract | Health insurance | Meal allowance | Paid vacationSenior-level Full TimeLisbon, Portugal R8d ago
-
Data Engineer / BI Developer (SQL Server/SSIS/Power BI) - Hybrid Lisbon (2-3 days/week office) EUR 24K-30KAzure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics15th month salary | Birthday off | Family health coverage | Health insurance | Mobility programMid-level Full TimeLisbon, Portugal R8d ago
-
API Design | AWS | Apache Kafka | Azure | Data PipelinesFull remote | Remote-first collaborationSenior-level Full TimePorto, Portugal R9d ago
-
AWS | Azure | Data Pipelines | Distributed Systems | DjangoFully remote | Global remote workSenior-level Full TimePorto, Portugal R9d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon Aurora | Amazon RDSBirthday Day | Health insurance | Life insurance | Referral award | Remote workSenior-level Full TimeLisbon, Portugal R9d ago
-
Database Engineer EUR 60K-86KAnsible | Backup and Recovery | CI/CD | CloudWatch | Database UpgradesSenior-level Full TimeFuze Portugal - Remote R9d ago
-
AWS | Airflow | Amazon Redshift | BigQuery | CI/CDFlexible work hours | Remote workSenior-level Full TimePortugal - Remote R9d ago
-
AWS | AWS S3 | Agile | Apache Airflow | Apache KafkaFull remote workSenior-level Full TimePortugal, Portugal R10d ago
-
AWS | Docker | Golang | JavaScript | NoSQLClear growth path | Employment contract 1099 | Fully remote work environment | Work with global teamMid-level Full TimeBelgrade R11d ago
-
AI Solutions Builder EUR 67K-90KAWS | Agentic AI | CRM data | Command Line | Data integrationDirect collaboration with executive team | Fast paced collaborative team | Fully remote work | Growth opportunities | High ownership autonomySenior-level Full TimeEurope; Portugal - Remote; Serbia - … R13d ago
-
AWS Redshift | Airbyte | Amazon S3 | Apache Airflow | Apache SparkFully remote | Health technology impactMid-level Full TimePortugal, Portugal R14d ago
-
API Integration | Context engineering | Data Pipelines | Data Validation | Deep learningHealthcare dental insurance | In-office four days per week | Paid time off | Remote work one day per weekExecutive-level Full TimeLisbon, Portugal R14d ago