Data Platform Engineer (Spark/Kafka/Databricks) – Full Remote Portugal
Leiria, Portugal
R
EUR 30K-40K Senior-level Full Time
Tasks
- Build scalable data infrastructure
- Collaborate with data and ML engineers
- Create infrastructure as code
- Design Lakehouse architecture
- Develop distributed data processing pipelines
- Ensure data quality
- Implement streaming data pipelines
- Manage CI CD for data workflows
- Optimize SQL query performance
- Orchestrate data workflows
- Set up data observability
Perks/Benefits
Skills/Tech-stack
AWS | Amazon Redshift | Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Azure | CI/CD | Cloud platform | DBT | Dagster | Databricks | Delta Lake | Docker | Git | Google BigQuery | Google Cloud | Google Cloud Platform | Great Expectations | Kubernetes | Monte Carlo | Prefect | Pulumi | Python | SQL | Snowflake | Terraform
Education
N/A
Language: en
Views: 2
Clicks: 1
Saves: 0
Related jobs
-
Adversarial Testing | Bias Assessment | Factual consistency | Hallucination detection | LLM EvaluationFlexible contract work | Fully remote | Health insurance not included | Paid time off not includedSenior-level Contract Full TimePortugal R1d ago
-
Senior Machine Learning Engineer EUR 54K-65KAPI Gateways | Authentication | CI/CD | Cloud Platforms | Cost monitoringAnnual leave | Company gym access | Continuous learning opportunities | Flexible working hours | Free parkingSenior-level Full TimePorto, PT, 4000-457 R2d ago
-
Senior Data Engineer USD 150K-200KAPIs | Amazon QuickSight | Amazon Web Services | Backup | CI/CDBusiness English classes | Continuous learning support | Defined career path | Every other Friday off | Explore programSenior-level Full TimeLatAm, North Macedonia, Portugal, Serbia R2d ago
-
Senior Machine Learning Engineer EUR 68K-89KA/B | A/B Testing | AWS | B testing | BentoMLCode review culture | Hybrid work model | Mentorship | Remote work flexibilitySenior-level Full TimePortugal - All - Fully Flexible R3d ago
-
API Design | Backend architecture | Command Line | Command-line Interface | Database systemsCompany-provided equipment | Continuous learning allowance | Flexible working hours | Fully remote work | Health insurance allowanceSenior-level Full TimePortugal R3d ago
-
Anthropic API | Async Programming | Autogen | CI/CD | Cloud Data15th month salary | Birthday off | Health insurance | Mobility program | Work-life balanceSenior-level Full TimePorto, Portugal R4d ago
-
AWS | Autoscaling | Azure | Bash | CI/CDFully remote within Europe | Healthcare coverage | Paid parental leave | Professional growth | Relocation assistanceMid-level Full TimePortugal R4d ago
-
Data Analyst & Administrator Trainee EUR 28K-28KDashboard Development | Data Analysis | Data Integrity | Data Visualization | Data cleaningCross-functional team | Flexible working hours | Hybrid work schedule | MentorshipEntry-level Full TimeLisboa, Portugal R5d ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R5d ago
-
Senior AI Engineer - AI Systems EUR 48K-65KAnthropic API | Application engineering | Async | Autogen | CI/CDHealth insurance | Meal allowance | No-term contract | Paid vacation | Referral bonusSenior-level Full TimeLisbon, Portugal R5d ago
-
Forward Deployed AI Engineer EUR 65K-78KAI Agents | API Integration | AWS | Agentic Workflows | AutogenAnnual leave increased every 3 years | Continuous learning | Flexible benefits plan | Hybrid work | Meal allowanceMid-level Full TimeLisbon, Portugal R5d ago
-
Forward Deployed AI Engineer EUR 65K-78KAI Agents | API Integration | Amazon Web Services | Autogen | AzureFlexible benefits plan | Flexible hybrid work model | Meal allowance | Paid time off | Private medical insuranceMid-level Full TimeLisbon, Portugal R5d ago
-
Alerting | Amazon Aurora | Amazon Redshift | CI/CD | DashboardsContinuous improvement culture | Cross-functional collaboration | Exposure to modern data platforms | Fully remote work | Opportunity to influence engineering standardsSenior-level Full TimePortugal R5d ago
-
Azure | Data Drift | Data Modeling | Data Processing | Data QualityFlexible schedule | Freelance service agreement | Remote workMid-level Full TimePortugal - Remote R6d ago
-
Junior AI & Data Engineer EUR 18K-27KAgile | CI/CD | Docker | Kubernetes | Machine LearningCareer development | Discounts | Flexible work hours | Health insurance | Hybrid work modelEntry-level Full TimeLisboa, PT, 1200-246 R6d ago
-
A/B | A/B Testing | B testing | Chroma | EmbeddingsHybrid work modelSenior-level Full TimeLisbon, Portugal R6d ago
-
AWS | Azure | BERT | CI/CD | Deep learningBirthday off | Family coverage | Health insurance | Mobility program | Real work/life balanceEntry-level Full TimePorto, Portugal R6d ago
-
Staff/Lead Python Engineer (FastAPI, Orchestration) EUR 82K-112KAsynchronous programming | Cloud platform | Concurrent programming | FastAPI | GenAIAnnual learning and development budget | Co-working budget | Company laptop | Enhanced parental leave | Flexible scheduleSenior-level Full TimeRemote Anywhere R6d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R8d ago
-
Machine Learning Engineer EUR 56K-86KA/B | A/B Testing | Alerting | B testing | BigQueryAgile working | Enhanced annual leave | Paid family leave | Paid volunteering days | Support for growth and developmentSenior-level Full TimePorto, Portugal R9d ago
-
Senior AI-First Data Engineer EUR 75K-125KApache Airflow | Business Intelligence | CRM | Customer Data | Customer data platformsRemote-friendlySenior-level Full TimeArmenia - Remote; Europe; Georgia - … R10d ago
-
Senior Data Engineer EUR 69K-103KAirflow | CI/CD | DBT | Data Modeling | Data QualityHybrid work model | Remote work flexibilitySenior-level Full TimePortugal - Lisbon - Hybrid R11d ago
-
Senior AI Engineer EUR 56K-79KAsync | Autogen | CI/CD | Cloud Computing | CrewAIChild care vouchers | Choose laptop and peripherals | Flexible working hours | Health insurance | Open holidaysSenior-level Full TimePorto, Porto District, Portugal - Remote R13d ago
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R15d ago
-
Databricks Engineer EUR 31K-39KApache Spark | Azure | CI/CD | Data Lake | Data WarehouseGrowth opportunities | Health insurance | Hybrid work | International exposure | Life insuranceMid-level Full TimeLisboa, Lissabon, Portugal R15d ago