Senior Data Engineer - Product
Tasks
- Apply you build it you run it DevOps practices
- Design ETL ELT data pipelines
- Ensure Spark job stability on EMR or Kubernetes
- Improve JupyterLabs and DS API developer experience
- Maintain ingestion pipelines using Firehose Glue and S3
- Monitor services and participate in on call rotation
- Operate and evolve Hadoop ecosystem components
- Re architect big data processing components
- Tune and debug Apache Spark jobs
Perks/Benefits
- Continuous learning
- Dedicated compensation
- On-call rotation
- Open collaborative environment
- Remote work support
Skills/Tech-stack
AWS Glue | AWS S3 | Airflow | Apache Spark | Continuous Delivery | DS API | DevOps | ELT | EMR | ETL | Firehose | HDFS | Hadoop | Iceberg | Java | JupyterHub | JupyterLabs | Kafka | Kubernetes | Linux | Monitoring | Nessie | Python | Scala | Trino | YARN
Education
N/A
Roles
Related jobs
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R2d ago
-
Data Engineer (Mid-level) EUR 31K-39KAzure | Azure DevOps | CI/CD | Databricks | Delta LakeHealth insurance | Hybrid work | Life insurance | Meal allowance | Mobile phone budgetMid-level Full TimeLisboa, Lissabon, Portugal R2d ago
-
AWS | Amazon Bedrock | Guardrails | LLM Evaluation | LLMOpsAdditional salary month 15 | Birthday off | Health insurance | Mobility program | Work-life balanceSenior-level Full TimePorto, Portugal R4d ago
-
AWS Lambda | Airflow | Amazon IAM | Amazon S3 | CI/CDFlexible working hours | Fully remote | Professional growth opportunities | Supportive team culture | Work-life balanceMid-level Full TimePortugal R5d ago
-
AI Engineer EUR 39K-48KAI Agents | AI Foundry | AI Search | API Versioning | Agent systemsFlexible leave | Global Wellbeing Days | Paid time off | Remote working opportunitiesSenior-level Full TimeLisbon, Portugal R5d ago
-
Senior Data Platform Engineer (Kafka/Docker/Kubernetes) - Hybrid Lisbon (2 days/week office) EUR 42K-54KApache Flink | Apache Kafka | Apache Spark | CI/CD | DockerHybrid workSenior-level Full TimeLisbon, Portugal R5d ago
-
Agent Frameworks | Context Management | Embeddings | Language Models | Language ProcessingAnnual leave | Flexible schedule | Health insurance | Hybrid work model | Professional development budgetSenior-level Full TimePorto, Portugal R5d ago
-
Analytics Engineer - OpenData EMEA (Remote) EUR 50K-85KCode review | Data Cleansing | Data Frames | Data Modeling | Data ObservabilityCharitable contributions | Family health insurance | Fitness reimbursement | Private pension contributions | Work from anywhereMid-level Full TimePortugal - Lisbon R5d ago
-
AI Engineer EUR 39K-48KAI Foundry | AI Search | API Design | Agent systems | Agentic WorkflowsFlexible leave | Global Wellbeing Days | Growth opportunities | Mentorship | Paid time offSenior-level Full TimeLisbon, Portugal R6d ago
-
API Integration | Batch Processing | BigQuery | CI/CD | Cloud platformCareer coaching | Career progression | Health insurance | Meal card | Welcome kitMid-level ContractLisbon R6d ago
-
API Integration | Apache Hadoop | Apache Hive | Apache Kafka | Apache SparkCareer progression | Discounts | Health insurance | Meal card | Welcome kitSenior-level ContractLisbon R6d ago
-
Apache Airflow | BigQuery | Cloud platform | DBT | DataflowAnnual off-site events | Co-working space allowance | ESOP (equity) | Flexible asynchronous schedule | Fully remoteSenior-level Full TimePortugal R6d ago
-
Senior AI Engineer (Remote) EUR 56K-79KAPIs | AWS | Agent workflows | Azure | Cost OptimizationHybrid work | Remote work | Stock options program | Travel flexibility | Work and Swim programSenior-level Full TimePortugal R6d ago
-
Machine Learning Engineer EUR 60K-76KData Pipelines | Data Preparation | Debugging | Machine Learning | Model DeploymentEmployee assistance programme | Extra holidays | Extra parental leave | Gradual Return to Work Support | Home office supportMid-level Full TimeLisboa, PT / Porto, PT / … R8d ago
-
Object-Oriented | Object-oriented programming | Pandas | PySpark | PythonCareer progression | Health insurance | Meal card | Remote/hybrid/on-site flexibility | Special discountsSenior-level ContractPorto; Lisbon R10d ago
-
Senior Data Engineer (Microsoft Fabric) EUR 53K-65KAzure | Azure Entra | Azure Entra ID | Azure Key Vault | CI/CDAgile environment | Autonomous role | Consultancy experience | Flexible growth opportunities | Training & mentoringSenior-level Full TimeBrazil / Portugal-%LABEL POSITION TYPE REMOTE … R11d ago
-
AWS | Access Control | Airflow | Amazon Redshift | AuthenticationFlexible hours | Remote workSenior-level Full TimePortugal - Remote R11d ago
-
Data Engineer (w/ Databricks) EUR 64K-74KAWS | Agile | Azure | Compliance | Data GovernanceHealth insurance | Remote work | Work equipmentSenior-level Full TimeLisbon, Portugal R12d ago
-
Staff ML Engineer EUR 56K-84KAWS | Amazon SageMaker | Apache Airflow | CI/CD | Data PipelinesHome office stipend | PTO | Paid parental leave | Professional development | Remote-first work environmentSenior-level Full TimePortugal R12d ago
-
CI/CD | Data Modeling | DevOps | Git | JenkinsCareer progression | Discounts | Health insurance | Hybrid work | Meal cardMid-level ContractPorto R13d ago
-
Senior-level Full TimePortugal - Remote R13d ago
-
AWS | Azure | CI/CD | Cloud platform | DataikuCareer progression | Discounts | Health insurance | Meal card | Remote/hybrid optionsSenior-level ContractPorto R14d ago
-
Senior Machine Learning Engineer (NLP) EUR 90K-90KAgent systems | Conversational AI | Data strategy | Document processing | Entity MatchingFlexible office schedule | Hybrid workSenior-level Full TimePorto, Portugal R16d ago
-
Data Ops Engineer (Snowflake/Databricks/DBT) - Remote Portugal/Madrid (Occasional Travel to Salamanca) EUR 24K-30KAgile | Azure | CI/CD | DBT | Data Architecture15th month salary | Birthday off | Health insurance | Mobility program | Work-life balanceMid-level Full TimeLisbon, Portugal R17d ago
-
API Design | AWS | Asynchronous | CI/CD | DNSConference budget | Flexible schedule | Professional development budget | Remote workSenior-level Full TimePortugal - Remote R17d ago