Senior Data Engineer
Tasks
- Build automated data pipelines with Apache Airflow
- Collaborate with quantitative researchers for dataset onboarding
- Design data platform for quantitative research and backtesting
- Develop Python applications for market data acquisition and processing
- Drive engineering best practices for software quality automation scalability and operations
- Ensure data quality validation reconciliation and observability
- Operate scalable data pipelines with AWS Batch
- Process large scale datasets for compute intensive research workloads
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Batch | AWS CloudFormation | AWS IAM | AWS S3 | AWS SDK | Amazon CloudWatch | Amazon EC2 | Apache Airflow | Apache Arrow | Apache Parquet | Apache Spark | Dask | Docker | Kubernetes | Linux | Python | Ray | SQL | Terraform
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
C++ | Java | JavaScript | Machine Learning | PythonCareer growth | Coaching and mentoring | Training opportunities | Workshops and development programsEntry-level Full TimeAmsterdam, Netherlands1d ago
-
Junior Data Engineer EUR 47K-60KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformCareer growth | Learning opportunities | Training sessionsEntry-level Full TimeAmsterdam, NH, Netherlands2d ago
-
Analytics Engineer, Marketing DSA EUR 53K-72KAirflow | Anomaly Detection | BigQuery | Cloud platform | DBTAnnual learning budget | Commute benefit | Discounted gym membership | Dog-friendly office | Employee assistance programSenior-level Full TimeAmsterdam, Netherlands2d ago
-
AWS | Azure | Backend Development | C++ | Cloud ComputingConference attendance | Flexible working hours | Fully remote | Health, dental, vision insurance | Home-office equipmentSenior-level Full TimeNetherlands R2d ago
-
(Junior)Embedded Software Engineer EUR 50K-72KAgile | Algorithms | C++ | Code review | Data StructuresCompany restaurant | Hybrid work policy | Learning budget | Pension scheme | Shuttle busEntry-level Full TimeMaassluis, ZH, Netherlands2d ago
-
(Junior) Embedded Software Engineer EUR 50K-72KAgile | Algorithms | C++ | CI/CD | Data StructuresEmployee events | Healthy meals at cafeteria | Hybrid work | Learning budget | Paid time offEntry-level Full TimeMaassluis, ZH, Netherlands2d ago
-
Data Engineer EUR 75K-115KAPI Development | AWS | Agile | Artificial Intelligence | AzureCertification reimbursement | Learning and development program | Paid vacation days | Pension plan | Profit shareMid-level Full TimeEindhoven, NB, Netherlands R2d ago
-
AWS | Access Control | Access Management | Apache Airflow | CI/CDCareer growth opportunities | Equity participation | Flexible work arrangements | Fully remote work | High ownership and autonomyMid-level Full TimeNetherlands R2d ago
-
IT Software Quality Engineering (m/w/d) EUR 40K-48KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Training opportunitiesMid-level Full TimeRotterdam, ZH, Netherlands3d ago
-
API Integration | Automation | ComfyUI | ControlNet | Dataset PreparationConferences and workshops | Fitness and wellness allowance | Fully remote | Home office equipment allowance | Learning SupportSenior-level Full TimeNetherlands R3d ago
-
Data Engineering Principal EUR 60K-77KApache Airflow | Apache Spark | Automated testing | Azure | Azure Data FactorySenior-level Full TimeAmsterdam, Noord-Holland, Netherlands3d ago
-
Apache Spark | CI/CD | ClickHouse | Data Contracts | Data LineageSenior-level Full TimeAmsterdam3d ago
-
Full-Stack Engineer (Python) EUR 62K-75KAPI Development | Asynchronous programming | Data Modeling | Data Validation | Database MigrationSenior-level Full TimeUtrecht, UT, Netherlands3d ago
-
API Framework | AWS | Apache Spark | Azure | Cloud ComputingFlexible working hours | Health insurance | Paid leave | Paid transport | Pension schemeMid-level Full TimeAmsterdam, Gustav Mahlerplein 90, Netherlands3d ago
-
Agentic AI | Amazon Web Services | Cloud platform | Data Visualization | Deep learningAnnual bonus | Collective health insurance scheme | Discount on shares | Flexible working hours | Paid transportEntry-level Full TimeAmsterdam, Gustav Mahlerplein 90, Netherlands3d ago
-
Computer Vision | Convolutional Neural Networks | Data Science | Image Processing | Machine LearningOn site work in Netherlands | Relocation support | Technical presentation opportunitiesEntry-level Full Time InternshipVeldhoven, Building 06, Netherlands3d ago
-
GenAI Engineer - Assetization Team EUR 226K-301KApplication Security | Asynchronous programming | Azure | CI/CD | Data cleaning27 vacation days | Diversity Days | Home-office allowance | Inclusive work environment | Internet allowanceSenior-level Full TimeThe Hague - Haagse Poort - …3d ago
-
Full-Stack Engineer (Python) EUR 62K-75KAPI Development | Async Programming | Data Modeling | Database Schema | Database Schema DesignSenior-level Full TimeAmsterdam, NH, Netherlands4d ago
-
Apache Spark | Azure Data | Azure Data Lake | Azure Machine Learning | Azure SynapseSenior-level Full TimeAmsterdam, Netherlands4d ago
-
AI Engineer EUR 40K-60KAPI Development | AWS | Agent systems | Anthropic | AutogenBi weekly massages | Catered lunch | Company events | Company gym | Conference opportunitiesMid-level Full TimeAmsterdam4d ago
-
Staff Site Reliability Engineer (AI Platform) EUR 80K-91KAWS | Amazon Bedrock | Azure OpenAI | CI/CD | CachingAnnual offsites and team-building events | Company funded sport activities | Flexible time off | Free meals and snacks | Health insuranceSenior-level Full TimeAmsterdam, Netherlands R4d ago
-
Machine Learning Engineer II - AI EUR 52K-75KAgent Orchestration | Agentic Systems | Context Management | Context engineering | Deep learningMid-level Full TimeAmsterdam4d ago
-
Senior Applied Scientist - ADAS ImageX EUR 67K-91K3D Reconstruction | AWS | Azure Batch | Cloud processing | Computer VisionDevDays Participation | Enhanced parental leave | Flexible work schedule | Hackathon participation | Home office setup budgetSenior-level Full TimeAmsterdam, The Netherlands4d ago
-
AWS | Artificial Intelligence | Csharp | Cursor | GPT APIsContinuous learning and professional growth | Flexible work locations across Europe | Inclusive culture | International team collaboration | Remote-friendly work environmentSenior-level Full TimeNetherlands4d ago
-
Data-intensive | Data-intensive workloads | Datadog | Debugging | Distributed SystemsCollaborative environment | Flexible work across Europe | Fully remote work environment | High ownership role | Influence over platform architecture and technical directionSenior-level Full TimeNetherlands R4d ago