Market Data Engineer
Tasks
- Build batch and stream pipelines
- Collaborate with quant research and data science
- Create data lineage and monitoring dashboards
- Design market data platform
- Develop data validation and data contracts
- Handle snapshots compaction and TTL
- Implement schema evolution and time travel
- Ingest and decode exchange feeds
- Manage Apache Iceberg lakehouse
- Normalize market data into canonical model
- Operate Kubernetes capture and pipeline services
- Optimize storage cost
- Reconstruct L2 and L3 order book
- Set CI CD and SLAs and SLOs
- Troubleshoot data quality incidents
Perks/Benefits
- Flexible schedule
- Fully remote
- Health insurance coverage
- Professional development support
- Sports compensation
Skills/Tech-stack
AWS EKS | Airflow | Amazon S3 | Apache Arrow | Apache Iceberg | Apache Spark | ArgoCD | CI/CD | DBT | Docker | GitOps | Grafana | Kubernetes | Linux | Polars | Prometheus | Python | Rust | SQL | Terraform
Education
N/A
Roles
Related jobs
-
.NET | AKS | ASP.Net Core | Application Insights | AzureCultural and sports activities | Flexible compensation plan | Flexible schedule | Health and wellbeing program | Hybrid workMid-level Full TimeZaragoza, ES R12h ago
-
Internship - Data Engineer EUR 16K-19KApache Airflow | Cloud PubSub | DBT | Data Governance | Data QualityFlexible hours | Ongoing training and development | Remote work options | Team building retreatsEntry-level Full Time InternshipMadrid (Remote), Madrid R1d ago
-
Applied AI Engineer & AI Enablement EUR 75K-93KAWS | Classification | Cloud platform | CrewAI | Deep learningEntry-level Full TimeBarcelona - Hybrid, Madrid - Hybrid R1d ago
-
AWS | Apache Spark | Azure | Data Modeling | ETLContinuous learning | Cultural and sports activities | Flexible work hours | Health programs | Hybrid workMid-level Full TimeSevilla, ES R1d ago
-
AWS | Apache Spark | Azure | Data Modeling | DatabricksCultural and sports activities | Feedback culture | Flexible schedule | Health program | Hybrid workMid-level Full TimeZaragoza, ES R1d ago
-
Adversarial Networks | Agile | Computer Vision | Deep learning | Generative Adversarial NetworksContinuous learning | Cultural and sports activities | Flexible compensation plan | Flexible schedule | Health programMid-level Full TimeSevilla, ES R1d ago
-
API Development | CI/CD | Cloud Storage | Cloud infrastructure | ContainerizationConference stipend | Hardware stipend | Professional learning stipend | Remote-first work environment | Technical leadership opportunitiesSenior-level Full TimeSpain R2d ago
-
Ingeniero/a de IA Generativa (LLMs y Agentes) EUR 35K-41KAPI Development | AWS | Apache Spark | Autogen | CI/CDCareer development | Continuous training | Flexible schedule | Remote work | Social benefitsMid-level Full TimeMadrid, Spain R2d ago
-
GenAI Engineer - Staff - EY GDS Spain - Hybrid EUR 58K-79KAPI Development | AWS | Agentic AI | Autogen | AzureContinuous learning programs | Hybrid work model | Psychological support | Recognition programs | Training and development programsSenior-level Full TimeMalaga, ES, 29590 R2d ago
-
Junior AI Engineer - Agentic Workflows EUR 20K-20KAgentic Workflows | Asyncio | Azure | Cloud Architecture | Concurrent programmingCollective life retirement plan | Employee discounts | Employee referral bonus | Flexible working model | Health insuranceEntry-level Full TimeBarcelona, ES R2d ago
-
Freelance Data Science Engineer (Python & SQL) USD 68K-68KFeature Engineering | LLMs | Langchain | MLOps | Machine LearningNon permanent engagement | Part-time availability | Project based workMid-level FreelanceSpain - Remote R2d ago
-
Senior Software Engineer - REDAPL Graph Engine EUR 97K-125KApache Iceberg | Backend Engineering | Calcite | Data Ingestion | Data ProcessingCollaborative team environment | Competitive global benefits | Continuous professional development | Hybrid workplace | Influence on product directionSenior-level Full TimeFrance, Remote; Germany, Remote; Spain, Remote R2d ago
-
Asynchronous Communication | Code review | Deep learning | Distributed Training | GPU OptimizationConference access | Flexible working hours | Fully remote | Professional development support | Time offSenior-level Full TimeSpain R2d ago
-
ARIMA | AWS | Azure | Data Preprocessing | Feature EngineeringEnd to end ML lifecycle collaboration | Flexible engagement structure | Fully remote | Healthcare impact projectsMid-level Full TimeSpain R2d ago
-
AWS | Agentic Systems | CRM | Cloud platform | Command LineDirect collaboration with executive leadership | Fully remote work | High ownership and autonomy | Learning and career growth opportunitiesEntry-level Full TimeSpain R3d ago
-
Databricks Engineer Barcelona EUR 28K-35KDatabricks | Oracle Database | PythonFlexible compensation | Flexible working hours | Hybrid remote work | Inclusive work environment | Permanent contractEntry-level Full TimeBarcelona, CT, Spain R3d ago
-
Senior MLOps Engineer EUR 54K-79KAccess Management | Amazon Web Services | ArgoCD | Artifact provenance | AzureFlexible working hours | Health insurance | Hybrid work model | Life insurance | Nursery checksSenior-level Full TimeDigital Hub Madrid, Spain R3d ago
-
AWS | Docker | Golang | JavaScript | NoSQLClear growth path | Employment contract 1099 | Fully remote work environment | Work with global teamMid-level Full TimeBelgrade R4d ago
-
AWS | Agile | Azure | Batch Processing | Confluence100% remote | Access to latest technologies | Mentorship | Work-life balanceMid-level Full TimeEspaña Remoto, España R4d ago
-
Analytics Engineer I - AI & Data Enablement EUR 54K-67KAccess Control | BigQuery | DBT | Data Governance | Data ModelingDiscounts on transportation food and kindergarten expenses | Enhanced parental leave | External Learning Budget | Flexible time off | Monthly meal creditsMid-level Full TimeBarcelona, Spain R5d ago
-
Data Engineer EUR 70K-90KApache Airflow | CI/CD | Cloud platform | DBT | DLTContinuous learning | Hybrid work model | Mentorship | Open source culture | Work-life balanceSenior-level Full TimeMadrid R5d ago
-
Azure Data engineer con inglés alto. EUR 30K-35KAzure Data | Azure Data Factory | Data Factory | Databricks | Microsoft AzureEnglish communication | Remote workEntry-level Full TimeMadrid, MD, Spain R6d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Pipelines | Data WarehousingAnnual vacation | Corporate discounts | Fully remote | Health reimbursement | Internal reward and recognition programsSenior-level Full TimeSpain R6d ago
-
Tech Lead DataOps EUR 46K-60KAgile | Alerting | Apache Airflow | Automation | CI/CDAgile environment | Career growth | Fully remote | Multicultural teamSenior-level Full TimeMálaga, AN, Spain R6d ago
-
Data Governance Platform Engineer EUR 54K-80KABAC | Access monitoring | Agile | Audit Logging | Azure CloudFlexible working hours | Free parking | Health insurance | Hybrid work model | Life insuranceMid-level Full TimeDigital Hub Madrid, Spain R6d ago