Lead Data Engineer
Tasks
- Build data interfaces
- Build data lake solutions
- Build data warehouse solutions
- Capture validate consolidate data
- Collaborate with data architects and analytics teams
- Create data models
- Design cloud data pipelines
- Develop APIs
- Develop ETL/ELT pipelines
- Develop data transformations
- Enforce data quality rules
- Ensure code versioning best practices
- Ensure delivery quality assurance
- Ensure timely data availability
- Handle data quality exceptions
- Implement CI/CD
- Implement cloud data pipelines
- Implement event streaming
- Lead onboarding new data sources
- Maintain technical documentation
- Monitor data interfaces
- Monitor pipeline execution
- Operate cloud data pipelines
- Participate in agile events
- Provide technical leadership
- Reprocess data pipelines
- Support user stories implementation
Perks/Benefits
- N/A
Skills/Tech-stack
API | Agile | CI/CD | DBT | Data Lake | Data Modeling | Data Quality | Data Warehouse | Databricks | ELT | ETL | Event Streaming | PySpark | Python | Snowflake | Technical documentation | Version control
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AKS | Autogen | Azure DevOps | Azure Machine Learning | CI/CDCareer Development Programs | Hybrid work model | Recognition and rewards programs | Volunteering opportunities | Well-being programsSenior-level Full TimeMalaga, ES, 29590 R13h ago
-
Cloud Engineer, Data Platforms EUR 60K-88KApache Spark | Azure | Azure Databricks | Azure DevOps | Azure Key VaultHybrid workSenior-level Full TimeMadrid Manoteras, Spain13h ago
-
Principal Full Stack ML Engineer – Evinova EUR 105K-105KAPI documentation | AWS CDK | AWS IAM | Amazon CloudWatch | Amazon EKSSenior-level Full TimeSpain - Barcelona13h ago
-
Senior Machine Learning Engineer EUR 56K-84KApache Flink | Apache Spark | Automation | Batch inference | CI/CDCoworking house support | Flexible work schedules | Referral bonus program | Remote and in person flexibility | Social budgetSenior-level Full TimeMadrid1d ago
-
Senior AI Engineer (All genders) EUR 62K-88KAI Security | Amazon Bedrock | Autogen | Azure OpenAI | CI/CDAnnual vacation days | Bike leasing | Employee product discount | Hybrid working | Private medical health insuranceSenior-level Full TimeMadrid, Spain2d ago
-
Senior AI Engineer (All Genders) EUR 56K-84KCI/CD | Context engineering | Docker | Embeddings | JavaAnnual vacation days | Bike leasing | Hybrid working | Private medical health insurance | Product discountSenior-level Full TimeMadrid, Spain2d ago
-
Mid-level Full TimeSpain, Madrid2d ago
-
Ingeniero/a de MLOPS EUR 30K-36KAnsible | CI/CD | DVC | Docker | GitHub ActionsCareer development plan | Company events | Flexible compensation benefits | Indefinite contract | Paid time offMid-level Full TimeMadrid, MD, Spain2d ago
-
Data engineer (BI) - H/F/X EUR 61K-90KAPI Authentication | API authorization | Apache Airflow | Automated testing | CI/CDE-learning courses | Flexible work-from-home days | Meetups and conferencesSenior-level Full TimeBarcelona2d ago
-
Analytics Engineer EUR 33K-46KAmazon Web Services | Apache Airflow | Apache Kafka | Data Contracts | Data ModelingCollaborative team | Flexible location | Multinational environmentEntry-level Full TimeBarcelona2d ago
-
Lead Data Science EUR 65K-90KBayesian Modeling | Causal Inference | Experimentation | Forecasting | Machine LearningEnglish classes | Event discount | Flexible hybrid model | Gympass membership | Health insuranceSenior-level Full TimeMadrid R3d ago
-
Data Scientist – Generative AI Specialist EUR 30K-40KAgile | Anchors | Apache Spark | CNN | ChromaDBEnhanced parental leave support | Hybrid work | Meal vouchers | Private health insurance | Professional development coursesEntry-level Full TimeMadrid, Spain3d ago
-
Senior-level Full TimeMadrid, Europe, Spain3d ago
-
Junior Data Engineer (Python/Spark) EUR 28K-35KData Modeling | Databricks | ETL | Integration Testing | PySparkChildcare support | Continuous training | Flexible hours | Free expert services | Hybrid workEntry-level Full TimeReus, CT, Spain R3d ago
-
AI machine learning | Azure | DAX | Data Modeling | Data QualityDiscounts on training and programs | Flexible benefits | Flexible work hours | Health insurance | Intensive work scheduleMid-level Full TimeBarcelona, Spain R3d ago
-
Senior MLOps Engineer EUR 60K-78KApache Airflow | BigQuery | CI/CD | Cloud Run | Cloud platformFlexible time off | Food or nursery benefits | Health insurance | Subsidized ClassPass | Tax-free payroll deductionsSenior-level Full TimeBarcelona, Spain3d ago
-
LLM Engineer EUR 51K-68KCI/CD | Docker | Embeddings | Fine Tuning | Generative AIAnnual leave | Commuting allowance | Employee referral scheme | Flexible schedule | Home working allowanceMid-level Full TimeBarcelona, Spain3d ago
-
Mobile Analytics Lead (Product & Growth) EUR 38K-53KA/B | A/B Testing | Adjust | Amplitude | AppsflyerAnnual learning budget | Birthday off | Dental insurance | Flexible schedule | FlextimeSenior-level Full TimeSpain - Remote R3d ago
-
Knowledge Graph Engineer, R&D Data Science & Digital Health - Data Strategy and Products EUR 52K-80KAmazon Neptune | Azure DevOps | CI/CD | Containerization | Continuous DeliveryMid-level Full TimeES022 Janssen Madrid, Spain3d ago
-
Agentic Systems | Benchmarking | CDISC | Cybersecurity | Data GovernanceCareer development | Hybrid work | Inclusive work environment | Training and documentationMid-level Full TimeES022 Janssen Madrid, Spain3d ago
-
Mid-level Full TimeGetafe, Spain3d ago
-
Embedded Software Engineer - HW/SW Co-Design EUR 60K-85KARM Fast Models | C# | C++ | CI/CD | ContainerizationSenior-level Full TimeSpain, Valencia, Cortes Valencianas3d ago
-
Senior-level Full TimeBarcelona, Spain3d ago
-
Data Engineer Sr – Ingles EUR 35K-42KAWS Athena | AWS Glue | AWS Lambda | AWS S3 | Amazon EC2Employee discount club | Flexible compensation | Good working environment | Paid vacation days | Remote or hybrid workSenior-level Full TimeESPAÑA, ESPAÑA3d ago
-
Data Engineer Scala/Spark EUR 36K-45KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | Cloud ComputingCertifications support | Continuous learning | Flexible work-life balance | Hybrid work model | MentoringEntry-level Full TimeValencia, ES3d ago