Senior Data Engineer
Tasks
- Automate data workflows with Airflow
- Build scalable data solutions with AWS analytics services
- Deploy containerized data services with Docker and ECS
- Design batch ETL pipelines
- Design streaming ETL pipelines
- Implement IAM roles and encryption with KMS
- Manage data infrastructure with Infrastructure as Code
- Monitor data infrastructure availability and latency
- Optimize AWS data storage and instance costs
- Optimize Spark cluster performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | AWS Data | AWS Data Catalog | AWS Glue | AWS Lambda | Agile | Amazon Athena | Amazon CloudFormation | Amazon ECS | Amazon EMR | Amazon KMS | Amazon Kinesis | Amazon MWAA | Amazon Redshift | Amazon Redshift Spectrum | Amazon S3 | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Avro | CI/CD | Data Catalog | Databricks | Delta Lake | Docker | Docker Swarm | ECS | Git | IAM | Iceberg | Jenkins | Kanban | Open table | Open table format | OpenShift | Parquet | Python | QlikSense | QlikView | Redshift Spectrum | SQL | Scrum | Snowflake Schema | Star Schema | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Big Data | Data Analysis | Data Ingestion | Data Visualization | Data cleaningFlexible weekly hours | Freelance opportunities | Part-time project-based workMid-level FreelanceSpain - Remote R16h ago
-
Applied AI Consultant Engineer EUR 68K-80KAPI Integration | Agent systems | Agent/tool use | Data Transformation | Data cleaningHybrid workSenior-level Full TimeBarcelona, Spain16h ago
-
Senior AI Engineer EUR 66K-90KCustom accelerators | Deep learning | Distributed Training | High Performance | High-Performance ComputingCareer development opportunities | Flexible scheduling | Hybrid work environment | MentorshipSenior-level Full TimeHybrid (08034, Barcelona, Barcelona/Catalunya/Espanya, Spain) R1d ago
-
Data Engineer Datastage EUR 36K-45KData Modeling | ETL | IBM DataStage | PLSQL | PythonChildcare card | Employee discounts portal | Flexible remuneration | Gympass | Health insuranceMid-level Full TimeMadrid, Spain1d ago
-
Data Engineer (Python - PySpark - Cloudera) EUR 36K-45KApache Hadoop | Cloudera | Databricks | HDFS | PySparkAccident insurance | Continuous training | Discount club | Flexible compensation | Life insuranceSenior-level Full TimeMadrid, MD, Spain1d ago
-
C# | C++ | Computer Vision | Git | GolangFlexible working hours | International work environment | Meal allowance | Mentorship | Paid student positionEntry-level Full TimeBarcelona, Spain1d ago
-
Data Scientist IA Generativa EUR 28K-35KCI/CD | Docker | Embeddings | FastAPI | Fine TuningCertification support | English classes | Fin de Año off | Flexible schedule | Free coffee and teaEntry-level Full TimeMadrid, Spain1d ago
-
Cloud Database Administrator (DBA) EUR 56K-57KAWS RDS | Access Management | Ansible | Autonomous Database | Azure SQLFlexibility | Professional development | Social benefits | Stable employment | Unlimited certifications accessSenior-level Full TimeES158 - DXC Zaragoza (ES158), Spain1d ago
-
Tech Lead MLOps Engineer EUR 36K-45KAWS | Apache Airflow | Azure | Bash | CI/CDContract indefinite | Flexible compensation package | Flexible working hours | Free company transport | Health insuranceSenior-level Full TimePalau-solità i Plegamans, Catalonia, Spain1d ago
-
Senior Machine Learning Engineer (MLOps) EUR 60K-90KAWS | Airflow | Athena | CI/CD | DevOpsAccess to LinkedIn Learning | Gym allowance | Meal vouchers | Private health insurance | TGIF eventsSenior-level Full TimeBarcelona, Barcelona1d ago
-
Especialista en AI/ML/Data EUR 36K-45KData Pipelines | Generative AI | Language Models | Large Language Models | Machine LearningCareer development plan | Childcare voucher | Hybrid telework | Meal allowance | Training programsEntry-level Full TimeMadrid, ES1d ago
-
Langchain | Language Models | Large Language Models | MLOps | NumPyPart-time remote work | Project based workMid-level FreelanceSpain - Remote R1d ago
-
Lead Machine Learning Engineer EUR 60K-72KAWS | Azure Machine Learning | CNN | Classification | Cloud platformEducation budget | International team | Open and transparent culture | Sport budgetSenior-level Full TimeValencia, Valencian Community, Spain2d ago
-
Senior DataOps Engineer EUR 84K-102KAWS | Apache Spark | Argo Workflows | ArgoCD | CI/CDCoworking accommodation week | Flexibility in work schedule | Language classes | Learning and development budget | Referral bonus programSenior-level Full TimeBarcelona2d ago
-
Senior Backend Engineer (AI focus) EUR 95K-118KAI APIs | API Integration | ETL | JavaScript | Node.jsRemote work flexibility | Stock grant opportunities | WeWork accessSenior-level Full TimeSpain R3d ago
-
Data Management Technician EUR 41K-41KChange Management | IIS 7.5 | Incident Management | Java | MQDevelopment opportunities | Equal opportunity employer | Reward and recognition | Volunteering opportunities | WellnessMid-level Full TimeGranada, Spain4d ago
-
Senior Database Engineer (Hybrid) EUR 40K-71KAWS Performance Insights | Amazon Aurora | Amazon DocumentDB | Amazon DynamoDB | Amazon RDSFree access to digital magazines | Fresh fruit | Health insurance | Meal card | Nursery cardSenior-level Full TimeBarcelona, Spain4d ago
-
Agile | C++ | Java | Machine Learning | Neural NetworksContinuous learning | Flexible working hours | Professional development | Remote workSenior-level Full TimeMadrid, Spain4d ago
-
Machine Learning Engineer EUR 38K-55KAWS | CI/CD | Docker | Machine Learning | Model DeploymentFlexible benefits | Fresh fruit and specialty coffee | Hybrid work model | International team | Meal vouchersMid-level Full TimeBarcelona, Spain4d ago
-
Data Engineer-Bioinformatics Technician (Physiology and Pathophysiology of the Digestive Tract) EUR 36K-36KBioinformatics | Data Curation | Data Governance | Data Transformation | Data ValidationAnnual leave | Corporate discounts | Flexible working hours | Health insurance | International mobility supportEntry-level Full TimeBarcelona, Spain4d ago
-
Site Reliability Engineer II - Platform Security GBP 79K-110KAnsible | Chef | Clojure | Docker | GitFlexible schedule | Health coverage | Parental leave | Vacation days | Volunteer timeMid-level Full TimeGreece; Ireland; Norway; Poland; Portugal; Spain; …4d ago
-
Site Reliability Engineer II - Platform Security EUR 36K-60KAnsible | CI/CD | Chef | Clojure | DockerDonation matching | Flexible schedule | Health coverage | Parental leave | Vacation daysMid-level Full TimeSpain4d ago
-
Senior Data Engineer EUR 54K-68KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Data EnrichmentFixed term roleSenior-level Full TimeVIC, AU, 30004d ago
-
Especialista en AI/ML/Data EUR 28K-35KAWS | Agile | Airflow | Azure | Azure DataCertification support | Flexible work arrangements | Performance-driven culture | Professional development | Strategic project exposureEntry-level Full TimeMadrid, ES4d ago
-
Especialista en AI/ML/Data EUR 36K-45KAWS | Artificial Intelligence | Azure | CI/CD | Cloud platformAccess to certifications | Career growth | Continuous learning | Flexible working hours | Remote workEntry-level Full TimeSevilla, ES4d ago