Market Data Engineer
Tasks
- Build batch and stream pipelines
- Collaborate with quant research and data science
- Create data lineage and monitoring dashboards
- Design market data platform
- Develop data validation and data contracts
- Handle snapshots compaction and TTL
- Implement schema evolution and time travel
- Ingest and decode exchange feeds
- Manage Apache Iceberg lakehouse
- Normalize market data into canonical model
- Operate Kubernetes capture and pipeline services
- Optimize storage cost
- Reconstruct L2 and L3 order book
- Set CI CD and SLAs and SLOs
- Troubleshoot data quality incidents
Perks/Benefits
- Flexible schedule
- Fully remote
- Health insurance coverage
- Professional development support
- Sports compensation
Skills/Tech-stack
AWS EKS | Airflow | Amazon S3 | Apache Arrow | Apache Iceberg | Apache Spark | ArgoCD | CI/CD | DBT | Docker | GitOps | Grafana | Kubernetes | Linux | Polars | Prometheus | Python | Rust | SQL | Terraform
Education
N/A
Roles
Related jobs
-
ARINC 653 | C# | C++ | CI/CD | CMakeAgile startup environment | Career development opportunities | Community bonding events | Complimentary coffee and beverages | Flexible working hoursSenior-level Full TimeGetafe, Spain R1d ago
-
Auto Scaling | Blue-Green Deployment | Blue/green | CI/CD | CUDAFlexible work environment | Fully remote | High ownership and influence | Remote-first cultureSenior-level Full TimeSpain R1d ago
-
Staff AI Engineer - 2nd Horizon | Spain | Remote EUR 94K-117KAWS | Agentic Workflows | Azure | Cloud Native | Context engineering100% remote work | Annual leave policy | In-person onboardingSenior-level Full TimeSpain (Remote) R1d ago
-
Data Engineer EUR 31K-42KAccess Management | Apache Airflow | CI/CD | Cloud Functions | Cloud StorageFlexible hours | Remote work options | Team building and retreats | Training and developmentEntry-level Full TimeMadrid (Hybrid) R1d ago
-
Analytics Engineer EUR 40K-50KBusiness Logic | DBT | Data Modeling | Data Quality | Data ValidationAnnual development budget | Company events and celebrations | Country vacation package | Fitness allowance | Hybrid workingMid-level Full TimeBarcelona, Catalunya [Cataluña], Spain R1d ago
-
Senior AI-First Data Engineer EUR 75K-125KApache Airflow | Business Intelligence | CRM | Customer Data | Customer data platformsRemote-friendlySenior-level Full TimeArmenia - Remote; Europe; Georgia - … R2d ago
-
AI Agents | API Design | Agent SDK | Agent systems | Automated testingExposure to emerging AI technologies | Flexible contractor schedule | Global Time Zone Flexibility | Professional networking | Professional recognitionSenior-level Contract FreelanceSpain R2d ago
-
Senior Data Engineer Madrid EUR 36K-45KAWS | AWS Glue | Azure | Azure DevOps | BigQueryComprehensive health program | Cultural and sports activities | Flexible work hours | Hybrid remote work | Medical support on siteSenior-level Full TimeMadrid, ES R4d ago
-
BigQuery | Cloud Functions | Cloud Storage | DBT | Data ModelingContinuous training and development | Flexible working hours | Remote work | Team-building activitiesEntry-level Full Time InternshipMadrid, Madrid (Hybrid) R4d ago
-
AI Engineer EUR 54K-89KApache Spark | Azure | Azure Cognitive | Azure Cognitive Services | CI/CDFlexible working hours | Free parking | Health insurance | Hybrid work | Life insuranceEntry-level Full TimeMadrid-Alcobendas Vida, Spain R5d ago
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R7d ago
-
Data Platform Architect EUR 50K-55KAirbyte | Apache Airflow | Batch Processing | BigQuery | CI/CDBirthday day off | Flexible compensation | Full-time role | Health discounts | International work environmentSenior-level Full TimeEspaña, Spain R8d ago
-
Senior Backend Engineer (MLOps) EUR 69K-79KAWS | Alerting | Apache Kafka | Apache Spark | CI/CDMedical insurance | Travel opportunitiesSenior-level Full TimeMadrid, Madrid, Spain (Hybrid) R8d ago
-
Data Flows | Data Modeling | ETL | LLM | Microsoft FabricChildcare support | Meal vouchers | Medical insurance | Paid vacation | Professional Certification SupportMid-level Full TimeMadrid, MD, Spain R8d ago
-
Data Engineer (Híbrido) EUR 32K-40KApache Airflow | Apache Spark | CI/CD | Cloud Object Storage | EnglishEmployee benefits club | Hybrid work in Madrid with three days in office | Unlimited technology trainingMid-level Full TimeMadrid, Madrid R9d ago
-
Analytics Engineer - OpenData EMEA (Remote) EUR 45K-95KCode review | DBT | Data Frames | Data Modeling | Data ObservabilityCharitable contributions | Family health insurance | Fitness reimbursement | Private pension contributions | Restricted stock unitsMid-level Full TimeSpain - Barcelona R9d ago
-
Analista MLOps EUR 35K-40KAPI Development | AWS | Airflow | Amazon S3 | Apache SparkCareer development | Continuous training | Flexible hours | Indefinite contract | Remote workMid-level Full TimeMadrid, Spain R10d ago
-
Senior AI Engineer (Remote) EUR 56K-79KAPIs | AWS | Agent workflows | Azure | Continuous ImprovementHybrid work | Relocation support | Remote work | Stock options | Travel flexibilitySenior-level Full TimeBarcelona R11d ago
-
Senior Machine Learning Engineer EUR 36K-45KAIOps | AWS | Amazon SageMaker | Apache Airflow | AzureConference access | Indefinite contract | Remote work flexibility | Telework support | Training budgetSenior-level Full TimeValència, Spain R12d ago
-
GenAI Engineering Internship EUR 21K-21KAWS Bedrock | Anthropic | Data Migration | Data Processing | DockerMentoring | On-site workEntry-level InternshipMadrid R15d ago
-
Analista Mlops (Híbrido Madrid/Málaga) EUR 33K-40KAPI Development | Apache Spark | CI/CD | Fortify | GitEmployee benefits club | Good working environment | Hybrid work | Unlimited technical trainingSenior-level Full TimeMadrid, Madrid R16d ago
-
AWS | Agile | Avro | Azure | Big DataContinuous learning | Health resources | Hybrid work model | Psychological support | Recognition programsSenior-level Full TimeMalaga, ES, 29590 R17d ago
-
AI & NLP Research Solutions Engineer EUR 69K-94KHugging Face | Language Models | Language Processing | Large Language Models | Machine LearningDevelopment programs | Flexible PTO | Mentorship | Remote work | Work-life balanceMid-level Full TimeRemote , Spain R17d ago
-
AZURE DATA ENGINNER (Inglés alto) EUR 35K-43KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure LogicEnglish B2 or C1 certification required | Live in Spain | Remote workMid-level Full TimeMadrid, MD, Spain R17d ago
-
Data Engineering Lead EUR 60K-80KAWS | Artificial Intelligence | Azure | Cloud Computing | Data GovernanceAnnual bonus | Health insurance | Knowledge sharing | Learning and development | PensionSenior-level Full TimeRemote, Spain R18d ago