Market Data Engineer
Tasks
- Build batch and stream pipelines
- Collaborate with quant research and data science
- Create data lineage and monitoring dashboards
- Design market data platform
- Develop data validation and data contracts
- Handle snapshots compaction and TTL
- Implement schema evolution and time travel
- Ingest and decode exchange feeds
- Manage Apache Iceberg lakehouse
- Normalize market data into canonical model
- Operate Kubernetes capture and pipeline services
- Optimize storage cost
- Reconstruct L2 and L3 order book
- Set CI CD and SLAs and SLOs
- Troubleshoot data quality incidents
Perks/Benefits
- Flexible schedule
- Fully remote
- Health insurance coverage
- Professional development support
- Sports compensation
Skills/Tech-stack
AWS EKS | Airflow | Amazon S3 | Apache Arrow | Apache Iceberg | Apache Spark | ArgoCD | CI/CD | DBT | Docker | GitOps | Grafana | Kubernetes | Linux | Polars | Prometheus | Python | Rust | SQL | Terraform
Education
N/A
Roles
Related jobs
-
Snowflake Senior Data Engineer EUR 36K-45KCI/CD | DBT | Data Governance | Data Lineage | Data ModelingConference access | Flexible work schedule | Friday off | Hybrid work | Intensive Working HoursSenior-level Full TimeSantiago de Compostela, Spain R7h ago
-
AI Engineer EUR 80K-105KAgent Orchestration | Asynchronous programming | Embeddings | LLM | MCPComprehensive health benefits | Equity participation program | Family leave | Language training | Leadership programsMid-level Full TimeValencia, Spain (Hybrid) R1d ago
-
Alerting | Apache Airflow | ClickHouse | DBT | Data MonitoringGenerous paid time off | Home office or coworking budget | Learning and development budget | Parental leave | Regular international team offsitesSenior-level Full TimeMadrid, Spain R1d ago
-
ML Engineer (Applied AI) EUR 50K-72KAWS Bedrock | AWS EC2 | AWS Lambda | AWS SageMaker | Anomaly DetectionHardware provided | Maternity & paternity leave | Paid Holidays | Paid sick leave | Paid vacationMid-level Full TimeSpain - Remote R1d ago
-
AI Agents | AI infrastructure | Agent workflows | CI/CD | EvaluationCompany-provided equipment | Equity participation | Flexible benefits card | Fully remote work | Health insuranceMid-level Full TimeSpain R2d ago
-
Expert Data Engineer (m/f/d) EUR 36K-45KApache Spark | Data Modeling | Databricks | ETL | PySparkChildcare support | Coursera access | English classes | Flexible hours | German classesSenior-level Full TimeReus, CT, Spain R3d ago
-
Software / Machine Learning Engineer EUR 42K-57KAWS | Computer Vision | Data analytics | Deep learning | Generative AIGym discounts | Hybrid work | Learning resources | Mental health support | MentorshipMid-level Full TimeMadrid R4d ago
-
Analista MLOps / Ingenier@ MLOps EUR 35K-40KAPIs | AWS | Airflow | Azure | Azure FunctionsCareer development | Continuous training | Flexible schedule | Remote work | Social benefitsMid-level Full TimeMadrid, Spain R4d ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Distributed first work environment | Fully remote | High-impact roleSenior-level Full TimeSpain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeMálaga, AN, Spain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional development programsMid-level Full TimeZaragoza, AR, Spain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internal mobility | Internship opportunities | Mentorship | Professional developmentMid-level Full TimeSeville, AN, Spain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeValència, VC, Spain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeMadrid, MD, Spain R4d ago
-
Data Engineer EUR 24K-34KAzure | Azure Data | Azure Data Factory | Data Factory | Data GovernanceExtra day off for birthday | Family discounts | Flexible schedule | Hybrid work | Professional growth opportunitiesMid-level Full TimeManresa, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship | Professional development programs | Relocation programMid-level Full TimeZaragoza, AR, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship | Professional development opportunities | Relocation programMid-level Full TimeValència, VC, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeMálaga, AN, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internal mobility | Internship opportunities | Mentorship | Professional development opportunitiesMid-level Full TimeSeville, AN, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeBarcelona, CT, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship programs | Professional developmentMid-level Full TimeMadrid, MD, Spain R4d ago
-
Data Engineer (with Microsoft Stack) EUR 36K-45KAzure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure FunctionsConference access | Home office support | Official certifications access | Remote work flexibility | Training budgetSenior-level Full TimeValència, Spain R5d ago
-
AI Agents | AI Observability | AWS | Azure | CI/CDExposure to emerging AI technologies | Fully remote work environment | Leadership opportunities | Professional development opportunities | Work-life balanceSenior-level Full TimeSpain R7d ago
-
Data Analyst Support Engineer EUR 55K-68KData Governance | Data Preparation | Data Visualization | Data cleaning | PowerBIEmployee stock options | Free canteen | Health insurance | Hybrid work | KindergartenSenior-level Full TimeGetafe, Spain R7d ago
-
Machine Learning Engineer EUR 60K-76KAWS | Azure | Experiment tracking | GCP | Hugging FaceGenerous time off | Healthcare | Occasional travel | Parental leave | Remote workMid-level Full TimeRemote - Spain R7d ago