Data Engineering Team Lead
Tasks
- Aggregate high throughput features with Scala
- Architect scalable data pipelines
- Build data quality observability frameworks
- Collaborate with CTO and product teams on integration
- Collaborate with Chief Data Officer on technical strategy
- Coordinate pipeline execution using Apache Airflow
- Define data governance and compliance policies
- Develop feature store pipelines
- Ensure production stability using you build it you run it
- Implement automated monitoring and alerting
- Lead data engineering teams and sub teams
Perks/Benefits
Skills/Tech-stack
AWS EMR | Amazon Athena | Amazon EC2 | Amazon S3 | Amazon Web Services | Apache Airflow | Apache Spark | Bash | Docker | Git | Jenkins | Kubernetes | MySQL | Python | Redis | SQL | Scala | Web Services
Education
Related jobs
-
Senior Data Engineer EUR 60K-84KCI/CD | ClickHouse | Docker | Kafka | KubernetesCareer development | Flexible working hours | Learning time | Remote-first | Social benefitsSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R2d ago
-
Automated testing | C++ | Cloud Computing | Code review | Continuous integrationFlexible location | International collaboration | Mentorship opportunities | Remote work | Supportive inclusive cultureSenior-level Full TimeSpain2d ago
-
Cloud Computing | Cloud infrastructure | Containerization | Deployment Patterns | Distributed ComputingCareer development | Continuous learning opportunities | Exposure to cutting-edge AI technologies | Flexible working environment | International collaborationSenior-level Full TimeSpain2d ago
-
Senior-level Full TimeBarcelona, ESP-CT, Spain2d ago
-
Senior Data Engineer - Platform EUR 62K-87KCloud Functions | Cloud Run | Cloud platform | Data Governance | Data LakesHybrid work | Open Source friendly | Training opportunitiesSenior-level Full TimeMadrid2d ago
-
Entry-level Full TimeGetafe / Madrid, ES2d ago
-
Google Cloud AI Engineer EUR 106K-109KAI Agent Builder | Agent Builder | BigQuery | Cloud platform | Data ProcessingSenior-level Full TimeMadrid, MD, Spain3d ago
-
Big Data Developer EUR 38K-54KAmazon EMR | Apache Hive | Apache Spark | Azure Databricks | ClouderaCareer development opportunities | Challenging work environment | Multicultural international projects | Training opportunitiesMid-level Full TimeMadrid, MD, Spain3d ago
-
DAX | Data Governance | Data Modeling | Data Quality | Data WarehousingFlexible working arrangements | In person and virtual workshopsEntry-level Full TimeMadrid - Tres Cantos (Crisa), Spain3d ago
-
Senior Embedded Software Engineer EUR 57K-76KC# | C++ | CI/CD | Cameo | Continuous integrationAccident insurance | Dental insurance | Flexible working hours | Free coffee | Free fruitSenior-level Full TimeTres Cantos, Madrid, Spain; PTM3d ago
-
Internship: Embedded Software Engineer EUR 22K-32KARM | C# | C++ | FPGA | GitAccident insurance | Dental insurance | Flexible work hours | Free fruit and coffee | Health insuranceEntry-level InternshipTres Cantos, Madrid, Spain; PTM3d ago
-
A/B | A/B Testing | AWS Glue | Amazon Athena | Amazon EMRMid-level Full TimeMadrid, Community of Madrid, ESP3d ago
-
AI Reasoning | API Integration | Agent systems | Autogen | Autonomous WorkflowHybrid work | Inclusive workplace | International team collaboration | Professional development | Remote workMid-level Full TimeSpain3d ago
-
API Development | Agentic AI | Automated testing | CI/CD | Clean architectureCareer development | Continuous learning | Flexible work arrangements | Hybrid work | Professional growthSenior-level Full TimeSpain3d ago
-
Data Platform Architect EUR 50K-55KAirbyte | Apache Airflow | Batch Processing | BigQuery | CI/CDBirthday day off | Flexible compensation | Full-time role | Health discounts | International work environmentSenior-level Full TimeEspaña, Spain R3d ago
-
Senior Backend Engineer (MLOps) EUR 69K-79KAWS | Alerting | Apache Kafka | Apache Spark | CI/CDMedical insurance | Travel opportunitiesSenior-level Full TimeMadrid, Madrid, Spain (Hybrid) R3d ago
-
Senior Backend Spark Developer EUR 75K-99KAgile | Apache Hive | Apache Spark | Azure Databricks | CI/CDCareer development opportunities | Challenging multicultural environment | International projects | Training opportunitiesSenior-level Full TimeMálaga, AN, Spain3d ago
-
Marketing Experimentation & Optimization Lead EUR 65K-90KA/B | A/B Testing | B testing | Control Groups | Experiment designEnglish & Spanish lessons | Event and Experience Discounts | Flexible remuneration | Health insurance | Home office friendly setupSenior-level Full TimeSpain3d ago
-
Access Controls | Airflow | Amazon Redshift | BigQuery | Business MetricsAccess to modern technologies | Flexible working hours | Fully remote | Ownership and influence over architecture | Paid vacationSenior-level Full TimeSpain R3d ago
-
Big Data Developer EUR 38K-54KAgile | Amazon EMR | Apache Hive | Apache Spark | Azure DatabricksCareer development opportunities | International projects | Multicultural environment | Training opportunitiesMid-level Full TimeMálaga, AN, Spain3d ago
-
Data Flows | Data Modeling | ETL | LLM | Microsoft FabricChildcare support | Meal vouchers | Medical insurance | Paid vacation | Professional Certification SupportMid-level Full TimeMadrid, MD, Spain R4d ago
-
Data Engineer EUR 64K-78KAPI Development | Angular | Apache Airflow | BigQuery | DBTContinuous learning | Hybrid work flexibility | Personal development | Wellbeing programsMid-level Full TimeMadrid HQ (KES51610), Spain4d ago
-
Data Engineer (Híbrido) EUR 32K-40KApache Airflow | Apache Spark | CI/CD | Cloud Object Storage | EnglishEmployee benefits club | Hybrid work in Madrid with three days in office | Unlimited technology trainingMid-level Full TimeMadrid, Madrid R4d ago
-
AWS DataBrew | AWS Glue | AWS Glue Studio | Agile | Amazon AthenaMid-level Full TimeEDIF. LAS TABLAS III [00012989 BCO. …4d ago