Big Data Pipeline Engineer (Python & ETL) for NATO with security clearance
Tasks
- Build and maintain ETL and ELT pipelines
- Design data models and ontologies
- Ensure data availability, integrity, and searchability
- Establish and maintain data structures
- Implement data governance and metadata management
- Ingest and integrate data from multiple sources
- Perform data quality checks and remediation
- Transform data between formats and media
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Kafka | Apache Spark | Data Governance | Data Modeling | Data Quality | Data Validation | Data pipeline | Data pipeline automation | Data platform | Data platform integration | ELT | ETL | Metadata Management | Ontology Engineering | Pipeline Automation | Platform integration | Python | Semantic interoperability
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Data Engineer EUR 36K-54KAPI | BigQuery | Cloud Run | Cloud Storage | Data Analysis27 vacation days | Home office option | Lunch provided | Professional trainings | Remote work optionMid-level Full TimeZwolle, Overijssel, Nederland1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive compensation | Remote friendly distributed setting | Supportive teamMid-level Full TimeAmsterdam, Netherlands2d ago
-
Amazon Web Services | Azure Databricks | Azure Machine Learning | Azure Machine Learning Studio | BigQuerySenior-level Full TimeAmsterdam, Netherlands3d ago
-
Machine Learning Engineer (II and Senior) EUR 60K-90KAirflow | Apache Spark | Argo Workflows | Docker | GrafanaFull-time position | Relocation supportSenior-level Full TimeAmsterdam3d ago
-
Dagster | Data Exploration | Data Processing | Deep learning | FionaFlexible working across eligible locations | Fully remote work | Impactful climate technology projects | Inclusive culture | International team collaborationSenior-level Full TimeNetherlands R3d ago
-
Machine Learning Engineer II - AI EUR 52K-75KAgent Orchestration | Agentic Systems | Benchmarking | Context Management | Context engineeringDocumentation and reproducibility culture | In-person collaboration | MentorshipMid-level Full TimeAmsterdam3d ago
-
Senior Machine Learning Engineer - AI EUR 78K-100KAgent Orchestration | Agent/tool use | Context Management | Context engineering | Ensemble MethodsSenior-level Full TimeAmsterdam3d ago
-
Logistics Data Engineer EUR 42K-56KData Analysis | Data Engineering | Data Governance | Data Modeling | Data QualityFlexible working hours | Open collaborative workplace culture | Opportunity to manage own projects | Professional growth and developmentMid-level Part TimeNL-Sevenum, Netherlands (Maarten de Vriesstraat)3d ago
-
AWS | AWS CloudFormation | Access Control | Access Management | AzureSenior-level Full TimeAmsterdam, Netherlands R3d ago
-
AI Engineer EUR 80K-140KAgent systems | Agentic Workflows | Customer Journey | Customer journey automation | Data PipelinesCompany events | Growth opportunities | Gym access | Healthy Meals | High autonomySenior-level Full TimeRotterdam, Zuid-Holland, Netherlands4d ago
-
Apache Spark | Bash | BigQuery | CI/CD | Cloud RunCollaborative work environment | Continuous learning | Employee benefits | Professional development | Support for cloud certificationsSenior-level Full TimeAmsterdam, Netherlands4d ago
-
Dashboarding | Data Analysis | JavaScript | Language Processing | Machine LearningBenefits budget | Hybrid work | Part-time schedule | Professional networking | YoungSiemens mentorshipEntry-level Part TimeDen Haag - Zuid-Holland - Netherlands4d ago
-
Senior Data Engineer II, Trust & Safety EUR 85K-115KAgile | Amazon Kinesis | Apache Flink | Apache Spark | Apache StormDog-friendly office | Employee assistance program | Gym membership subsidy | Home office support | Lunch allowanceSenior-level Full TimeAmsterdam, Netherlands R4d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lake | AWS Lake FormationContract opportunity | Fully remote flexibility | Technical autonomySenior-level Contract Full TimeNetherlands R4d ago
-
Mid-level Full TimeBest, North Brabant, Netherlands4d ago
-
AI Agents | APIs | Artificial Intelligence | Benchmarks | CI/CDCareer growth opportunities | Collaborative culture | Continuous learning support | Flexible work environment | Inclusive workplaceSenior-level Full TimeNetherlands4d ago
-
AKS | Alerting | Application Insights | Azure Monitor | CI/CDCareer development | Collaborative international teams | Continuous learning | Flexible working environment | Impactful AI infrastructure projectsSenior-level Full TimeNetherlands4d ago
-
CI/CD | Computer Vision | Control Systems | Deep learning | Distributed TrainingAutonomy and ownership | Career growth opportunities | Continuous learning support | Flexible work environment | Innovative cultureSenior-level Full TimeNetherlands4d ago
-
Senior-level Full TimeAmsterdam4d ago
-
Data Governance Engineer EUR 41K-68KActiviti | Collibra | Flowable | Groovy | LinuxClient-facing experience | Comprehensive benefits plan | Professional growthMid-level Full TimeRotterdam, Zuid-Holland, Netherlands4d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Contract opportunity | Direct influence on data strategy | Fully remote | High ownership | International collaborationSenior-level Contract Full TimeNetherlands R4d ago
-
AI Foundry | AKS | Azure AI | Azure AI Foundry | Azure DevOpsCareer growth | Collaborative engineering culture | Continuous learning opportunities | International work environment | Ownership opportunitiesSenior-level Full TimeNetherlands R4d ago
-
Software Engineer Data Platform EUR 55K-91KAmazon S3 | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsEnd-of-year bonus | Hybrid work | Internet allowance | Learning opportunities | Pension planEntry-level Full TimeAmsterdam - Oval Tower, Netherlands4d ago
-
AI Engineer, Enablement (Amsterdam) EUR 80K-120KAWS | Agent Development | Agent evaluation | Azure | Cloud Computing401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceMid-level Full TimeAmsterdam4d ago
-
Senior ML Engineer (AI Research/ Portability) GBP 190K-230KAPI Design | Agent systems | Authentication | CI/CD | Code reviewCareer growth | Collaborative culture | Flexibility | International environment | Learning opportunitiesSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R4d ago