Market Data Engineer
Tasks
- Build batch and stream pipelines
- Collaborate with quant research and data science
- Create data lineage and monitoring dashboards
- Design market data platform
- Develop data validation and data contracts
- Handle snapshots compaction and TTL
- Implement schema evolution and time travel
- Ingest and decode exchange feeds
- Manage Apache Iceberg lakehouse
- Normalize market data into canonical model
- Operate Kubernetes capture and pipeline services
- Optimize storage cost
- Reconstruct L2 and L3 order book
- Set CI CD and SLAs and SLOs
- Troubleshoot data quality incidents
Perks/Benefits
- Flexible schedule
- Fully remote
- Health insurance coverage
- Professional development support
- Sports compensation
Skills/Tech-stack
AWS EKS | Airflow | Amazon S3 | Apache Arrow | Apache Iceberg | Apache Spark | ArgoCD | CI/CD | DBT | Docker | GitOps | Grafana | Kubernetes | Linux | Polars | Prometheus | Python | Rust | SQL | Terraform
Education
N/A
Roles
Related jobs
-
AI Engineer EUR 80K-105KAgent Orchestration | Asynchronous programming | Embeddings | LLM | MCPComprehensive health benefits | Equity participation program | Family leave | Language training | Leadership programsMid-level Full TimeValencia, Spain (Hybrid) R20h ago
-
AI Agents | AI infrastructure | Agent workflows | CI/CD | EvaluationCompany-provided equipment | Equity participation | Flexible benefits card | Fully remote work | Health insuranceMid-level Full TimeSpain R2d ago
-
Expert Data Engineer (m/f/d) EUR 36K-45KApache Spark | Data Modeling | Databricks | ETL | PySparkChildcare support | Coursera access | English classes | Flexible hours | German classesSenior-level Full TimeReus, CT, Spain R3d ago
-
Software / Machine Learning Engineer EUR 42K-57KAWS | Computer Vision | Data analytics | Deep learning | Generative AIGym discounts | Hybrid work | Learning resources | Mental health support | MentorshipMid-level Full TimeMadrid R3d ago
-
Analista MLOps / Ingenier@ MLOps EUR 35K-40KAPIs | AWS | Airflow | Azure | Azure FunctionsCareer development | Continuous training | Flexible schedule | Remote work | Social benefitsMid-level Full TimeMadrid, Spain R3d ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Distributed first work environment | Fully remote | High-impact roleSenior-level Full TimeSpain R3d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeMálaga, AN, Spain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional development programsMid-level Full TimeZaragoza, AR, Spain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internal mobility | Internship opportunities | Mentorship | Professional developmentMid-level Full TimeSeville, AN, Spain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeValència, VC, Spain R4d ago
-
Data Engineer (Azure Databricks) EUR 42K-54KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeMadrid, MD, Spain R4d ago
-
Data Engineer EUR 24K-34KAzure | Azure Data | Azure Data Factory | Data Factory | Data GovernanceExtra day off for birthday | Family discounts | Flexible schedule | Hybrid work | Professional growth opportunitiesMid-level Full TimeManresa, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship | Professional development programs | Relocation programMid-level Full TimeZaragoza, AR, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship | Professional development opportunities | Relocation programMid-level Full TimeValència, VC, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeMálaga, AN, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internal mobility | Internship opportunities | Mentorship | Professional development opportunitiesMid-level Full TimeSeville, AN, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeBarcelona, CT, Spain R4d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship programs | Professional developmentMid-level Full TimeMadrid, MD, Spain R4d ago
-
Data Engineer (with Microsoft Stack) EUR 36K-45KAzure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure FunctionsConference access | Home office support | Official certifications access | Remote work flexibility | Training budgetSenior-level Full TimeValència, Spain R5d ago
-
AI Agents | AI Observability | AWS | Azure | CI/CDExposure to emerging AI technologies | Fully remote work environment | Leadership opportunities | Professional development opportunities | Work-life balanceSenior-level Full TimeSpain R6d ago
-
Data Analyst Support Engineer EUR 55K-68KData Governance | Data Preparation | Data Visualization | Data cleaning | PowerBIEmployee stock options | Free canteen | Health insurance | Hybrid work | KindergartenSenior-level Full TimeGetafe, Spain R7d ago
-
C1 English | MATLAB | NumPy | Pandas | PythonFreelance project-based workSenior-level FreelanceSpain - Remote R7d ago
-
Machine Learning Engineer EUR 60K-76KAWS | Azure | Experiment tracking | GCP | Hugging FaceGenerous time off | Healthcare | Occasional travel | Parental leave | Remote workMid-level Full TimeRemote - Spain R7d ago
-
Mid-Level Spark Developer EUR 65K-65KANSI SQL | Amazon EMR | Apache Hive | Apache Spark | Azure Databricks100 percent remoteMid-level Full TimeMálaga, AN, Spain R8d ago
-
Azure Data Engineer EUR 40K-60KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Key VaultContinuous learning | Flexible compensation plan | Hybrid remote work | Meal voucher | Medical insuranceSenior-level Full TimeMadrid, ES R8d ago