Data Engineer 2
ESP-CORP Madrid-JLL Madrid/Castellana 79, Spain
EUR 68K-90K (estimate) Senior-level Full Time
Tasks
- Build integrations with market data vendors trading and risk systems
- Collaborate to define data ingestion
- Configure and optimize Databricks workspaces clusters and scheduling
- Create automated tests for data pipelines
- Design and implement data pipelines
- Document data infrastructure and ETL processes
- Implement security best practices
- Monitor and tune data pipeline performance
- Troubleshoot data processing issues
Perks/Benefits
Skills/Tech-stack
AWS | Access Control | Apache Spark | Audit Logging | Azure | BigQuery | Cloud platform | Data Governance | Data Quality | Data Warehousing | Databricks | Delta Lake | DevOps | Dimensional Modeling | ETL | Encryption | Google Cloud | Google Cloud Platform | Integration Testing | PySpark | Python | SQL | Security Testing | Unit Testing | Workflow automation
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
.NET | AKS | ASP.Net Core | Application Insights | AzureCultural and sports activities | Flexible compensation plan | Flexible schedule | Health and wellbeing program | Hybrid workMid-level Full TimeZaragoza, ES R1d ago
-
Amazon Kinesis | Apache Iceberg | Go | PySpark | SQLCollaborative team culture | English classes | Flexible benefits | Flexible schedule | Medical insuranceSenior-level Full TimeMálaga, Spain1d ago
-
BigQuery | ClickHouse | Cloud platform | Data Modeling | DataformEnglish classes | Flexible benefits | Flexible working hours | Medical insurance | Paid time offMid-level Full TimeMálaga, Spain1d ago
-
AWS | Apache Airflow | Data Modeling | Dimensional Modeling | PySparkCertifications support | English classes | Flexible benefits | Flexible schedule | Medical insuranceMid-level Full TimeMálaga, Spain1d ago
-
Market Data Engineer EUR 65K-65KAWS EKS | Airflow | Amazon S3 | Apache Arrow | Apache IcebergFlexible schedule | Fully remote | Health insurance coverage | Professional development support | Sports compensationMid-level Full TimeBarcelona, CT, Spain R1d ago
-
Internship - Data Engineer EUR 16K-19KApache Airflow | Cloud PubSub | DBT | Data Governance | Data QualityFlexible hours | Ongoing training and development | Remote work options | Team building retreatsEntry-level Full Time InternshipMadrid (Remote), Madrid R1d ago
-
Applied AI Engineer & AI Enablement EUR 75K-93KAWS | Classification | Cloud platform | CrewAI | Deep learningEntry-level Full TimeBarcelona - Hybrid, Madrid - Hybrid R1d ago
-
Algorithms | Biometrics | Data Visualization | Data Wrangling | Design of ExperimentsNo Relocation Assistance Provided | On-site work environmentSenior-level Full TimeSant Cugat del Valles, Spain2d ago
-
Data Engineer EUR 34K-40KAWS | Amazon Athena | Amazon CloudWatch | Amazon EMR | Amazon EventBridgeChildcare tickets | Employee discounts | Hybrid work | Medical insurance | Restaurant ticketsSenior-level Full TimeMADRID, MADRID2d ago
-
BRA Data & Analytics Spec III EUR 42K-61KAzure | Behavior scoring | Big Data | Cloud Computing | Cloud platformSenior-level Full TimeSANTANDER SEDE - 17 ANDAR, Brazil2d ago
-
Associate AI Engineer (6-month contract) EUR 58K-75KAI Governance | AI Services | Agent systems | Agent-based | Agent-based ArchitecturesMid-level Contract Full TimeMadrid2d ago
-
Data Engineer Senior Verti EUR 36K-45KAWS | AWS EMR | AWS Lambda | Amazon S3 | Apache AirflowCollaborative culture | Modern technology environment | Professional growthSenior-level Full TimeMADRID, M, ES2d ago
-
3 2 | Bash | C plus plus | C# | CAN busInternship | Remote work unavailableEntry-level InternshipValencia, V, ES2d ago
-
AWS | Apache Spark | Azure | Data Modeling | ETLContinuous learning | Cultural and sports activities | Flexible work hours | Health programs | Hybrid workMid-level Full TimeSevilla, ES R2d ago
-
AWS | Apache Spark | Azure | Data Modeling | DatabricksCultural and sports activities | Feedback culture | Flexible schedule | Health program | Hybrid workMid-level Full TimeZaragoza, ES R2d ago
-
Adversarial Networks | Agile | Computer Vision | Deep learning | Generative Adversarial NetworksContinuous learning | Cultural and sports activities | Flexible compensation plan | Flexible schedule | Health programMid-level Full TimeSevilla, ES R2d ago
-
Credit Conversion Factor | Credit Risk | Credit risk modeling | Data Processing | Data QualityMid-level Full TimeCIUDAD BBVA [00018800 BCO. BILBAO VIZCAYA …2d ago
-
AI Agents | Developer experience | Langchain | Language Models | Large Language ModelsAI program allowance | Company laptop | Dental insurance | Family focused programs | Flexible paid time offSenior-level Full TimeSpain R2d ago
-
Distributed Computing | Docker | GPUs | Hugging Face | KubernetesConference budget | Dental insurance | Equity participation | Flexible working hours | Health insuranceMid-level Full TimeSpain2d ago
-
API Development | CI/CD | Cloud Storage | Cloud infrastructure | ContainerizationConference stipend | Hardware stipend | Professional learning stipend | Remote-first work environment | Technical leadership opportunitiesSenior-level Full TimeSpain R2d ago
-
Ingeniero/a de Datos IA Generativa (RAG) EUR 35K-40KChunking | Data Ingestion | Data Processing | ETL | Graph DatabasesCareer development | Continuous training | Flexible hours | Remote work | Social benefitsMid-level Full TimeMadrid, Spain R2d ago
-
Ingeniero/a de IA Generativa (LLMs y Agentes) EUR 35K-41KAPI Development | AWS | Apache Spark | Autogen | CI/CDCareer development | Continuous training | Flexible schedule | Remote work | Social benefitsMid-level Full TimeMadrid, Spain R2d ago
-
Senior Data Engineer (Fintech) EUR 57K-76KAWS | Artificial Intelligence | DBT | Data Governance | Data ProductsCareer growth and professional development | Flexible benefits package | Flexible hybrid working | Private health insurance | Remote optionsSenior-level Full TimeBarcelona, Spain2d ago
-
GenAI Engineer - Staff - EY GDS Spain - Hybrid EUR 58K-79KAPI Development | AWS | Agentic AI | Autogen | AzureContinuous learning programs | Hybrid work model | Psychological support | Recognition programs | Training and development programsSenior-level Full TimeMalaga, ES, 29590 R3d ago
-
Senior-level Full TimeSant Just Desvern, B, ES, 089603d ago