Senior Data Engineer - Product
Tasks
- Apply you build it you run it DevOps practices
- Design ETL ELT data pipelines
- Ensure Spark job stability on EMR or Kubernetes
- Improve JupyterLabs and DS API developer experience
- Maintain ingestion pipelines using Firehose Glue and S3
- Monitor services and participate in on call rotation
- Operate and evolve Hadoop ecosystem components
- Re architect big data processing components
- Tune and debug Apache Spark jobs
Perks/Benefits
- Continuous learning
- Dedicated compensation
- On-call rotation
- Open collaborative environment
- Remote work support
Skills/Tech-stack
AWS Glue | AWS S3 | Airflow | Apache Spark | Continuous Delivery | DS API | DevOps | ELT | EMR | ETL | Firehose | HDFS | Hadoop | Iceberg | Java | JupyterHub | JupyterLabs | Kafka | Kubernetes | Linux | Monitoring | Nessie | Python | Scala | Trino | YARN
Education
N/A
Roles
Related jobs
-
Senior Machine Learning Engineer EUR 66K-88KEmbeddings | Evaluation | Experimentation | LLM | Machine LearningCommunity days | Global Lifestyle Reimbursement Account | Laptop workstation | Life/risk assurance | Meal allowanceSenior-level Full TimeHybrid - Lisbon, Portugal R3d ago
-
API Integration | ComfyUI | ControlNet | Dataset Preparation | Diffusion ModelsFitness and wellness allowance | Fully remote | Home office equipment allowance | Learning Support | Medical insuranceSenior-level Full TimePortugal R3d ago
-
API Development | ActiveSync | C# | Caldav | Continuous Deployment15th month salary | Birthday off | Health insurance | Mobility program | Work-life balance programSenior-level Full TimeBraga, Portugal R4d ago
-
AWX | Agile | Ansible | CI/CD | Docker15th month salary | Birthday off | Family coverage | Health insurance | Mobility programMid-level Full TimeBraga, Portugal R4d ago
-
Data Engineer II EUR 55K-68KAWS | Airflow | Amazon S3 | Apache Spark | Data ModelingBalance days | Laptop Workstation Setup | Life/risk assurance | Meal allowance | Paid annual leaveMid-level Full TimeHybrid - Lisbon, Portugal R4d ago
-
Generative AI Pipeline Engineer (Tech Lead) EUR 75K-85KAPI Integration | ComfyUI | ControlNet | Diffusers | GPUFitness allowance | Home-office allowance | Medical insurance coverage | Ongoing learning | Paid vacationSenior-level Full TimeLisbon, Remote, PT R5d ago
-
AWS | Azure | Cloud Computing | Data Analysis | GCPAutonomy | Competitive compensation based on experience | Continuous learning | Flexible schedule | Fully remoteMid-level Full TimePortugal R5d ago
-
Cloud infrastructure | Data Analysis | Data Ingestion | Data Modeling | Data PipelinesCompany-provided equipment | Continuous learning allowance | Flexible working hours | Fully remote | Health insurance allowanceSenior-level Full TimePortugal R6d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon ECSFlexible working environment | Fully remote | International team collaboration | Professional growthSenior-level Full TimePortugal R6d ago
-
BI Specialist USD 52K-78KAgile | Data Governance | Data Modeling | Data Quality | Data VisualizationSenior-level Full TimePortugal - Remote R6d ago
-
BigQuery | Cloud Composer | Cloud platform | Data Vault | ELTCareer progression opportunities | Health insurance | Meal card | Welcome kit | Work-life balance supportSenior-level ContractPorto, Lisbon, Porto, Portugal R6d ago
-
Data Scientist - Machine Learning EUR 18K-23KCI/CD | Cloud platform | Git | Google Cloud | Google Cloud PlatformAdditional leave | Hybrid work | Learning and development | MentorshipMid-level Full TimeLisbon, Portugal R7d ago
-
Senior Machine Learning Engineer EUR 54K-65KAPI Gateways | Authentication | CI/CD | Cloud Platforms | Cost monitoringAnnual leave | Company gym access | Continuous learning opportunities | Flexible working hours | Free parkingSenior-level Full TimePorto, PT, 4000-457 R10d ago
-
Senior Data Engineer USD 150K-200KAPIs | Amazon QuickSight | Amazon Web Services | Backup | CI/CDBusiness English classes | Continuous learning support | Defined career path | Every other Friday off | Explore programSenior-level Full TimeLatAm, North Macedonia, Portugal, Serbia R11d ago
-
Senior Machine Learning Engineer EUR 68K-89KA/B | A/B Testing | AWS | B testing | BentoMLCode review culture | Hybrid work model | Mentorship | Remote work flexibilitySenior-level Full TimePortugal - All - Fully Flexible R11d ago
-
Anthropic API | Async Programming | Autogen | CI/CD | Cloud Data15th month salary | Birthday off | Health insurance | Mobility program | Work-life balanceSenior-level Full TimePorto, Portugal R13d ago
-
Data Analyst & Administrator Trainee EUR 28K-28KDashboard Development | Data Analysis | Data Integrity | Data Visualization | Data cleaningCross-functional team | Flexible working hours | Hybrid work schedule | MentorshipEntry-level Full TimeLisboa, Portugal R13d ago
-
Algorithms | Concurrency | Data Structures | Data layout | Distributed SystemsCharitable donation match | Flexible work schedule | Health coverage | Parental leave | Remote workSenior-level Full TimePortugal R13d ago
-
Algorithms | Concurrency | Data Structures | Distributed Systems | ElasticsearchDonation matching | Flexible schedule | Health coverage | Parental leave | Remote workSenior-level Full TimePortugal R13d ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R13d ago
-
Senior AI Engineer - AI Systems EUR 48K-65KAnthropic API | Application engineering | Async | Autogen | CI/CDHealth insurance | Meal allowance | No-term contract | Paid vacation | Referral bonusSenior-level Full TimeLisbon, Portugal R14d ago
-
Forward Deployed AI Engineer EUR 65K-78KAI Agents | API Integration | AWS | Agentic Workflows | AutogenAnnual leave increased every 3 years | Continuous learning | Flexible benefits plan | Hybrid work | Meal allowanceMid-level Full TimeLisbon, Portugal R14d ago
-
Forward Deployed AI Engineer EUR 65K-78KAI Agents | API Integration | Amazon Web Services | Autogen | AzureFlexible benefits plan | Flexible hybrid work model | Meal allowance | Paid time off | Private medical insuranceMid-level Full TimeLisbon, Portugal R14d ago
-
Junior AI & Data Engineer EUR 18K-27KAgile | CI/CD | Docker | Kubernetes | Machine LearningCareer development | Discounts | Flexible work hours | Health insurance | Hybrid work modelEntry-level Full TimeLisboa, PT, 1200-246 R14d ago
-
A/B | A/B Testing | B testing | Chroma | EmbeddingsHybrid work modelSenior-level Full TimeLisbon, Portugal R15d ago