Big Data Pipeline Engineer (Python & ETL) for NATO with security clearance
Tasks
- Build and maintain ETL and ELT pipelines
- Design data models and ontologies
- Ensure data availability, integrity, and searchability
- Establish and maintain data structures
- Implement data governance and metadata management
- Ingest and integrate data from multiple sources
- Perform data quality checks and remediation
- Transform data between formats and media
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Kafka | Apache Spark | Data Governance | Data Modeling | Data Quality | Data Validation | Data pipeline | Data pipeline automation | Data platform | Data platform integration | ELT | ETL | Metadata Management | Ontology Engineering | Pipeline Automation | Platform integration | Python | Semantic interoperability
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Apache Airflow | Business Intelligence | Cloud Data | Cloud data platform | DBTCollaborative culture | Continuous learning | Distributed Global Team | Flexible work locations | Professional growthSenior-level Full TimeNetherlands15h ago
-
Senior Data Engineer (Federated Data & Interoperability) for NATO with security clearance A EUR 95K-95KApache Kafka | Apache Spark | Automation | Data Governance | Data ModellingSenior-level Full TimeThe Hague, Netherlands21h ago
-
Apache Kafka | Apache Spark | Automation | Data Governance | Data ModelingMid-level Full TimeThe Hague, Netherlands21h ago
-
API Development | Agile | Artificial Intelligence | CI/CD | Cloud ComputingSenior-level Full TimeAmsterdam, Netherlands1d ago
-
APIs | Applied AI | Data Engineering | Data Modeling | Data integrationCursus and training access | Hybrid work | Learning platform access | Paid parental leave | Time offSenior-level Full TimeAmsterdam, Noord-Holland, Netherlands1d ago
-
AI Agents | API Design | Agent SDK | Agent systems | Automated testingContinuous learning opportunities | Global collaboration | Networking opportunities | Part time contractor flexibility | Professional recognitionSenior-level Contract FreelanceNetherlands R1d ago
-
AWS | Asynchronous programming | Data Processing | FastAPI | Feature EngineeringAsynchronous work environment | Career development | Company provided hardware and equipment | Internal growth opportunities | International collaborationMid-level Full TimeNetherlands1d ago
-
Applied AI Engineer (Netherlands) EUR 48K-68KAutomation | Compliance | Cost Optimization | Evaluations | GuardrailsFast interview process | Remote workMid-level Full TimeNetherlands1d ago
-
API Integration | Agents | CRM | Cost Optimization | Data PrivacyRelocation not required | Remote workMid-level Full TimeNetherlands1d ago
-
Embedded Developer EUR 36K-60K3D CAD | AWS | C# | C++ | Cloud30 vacation days | Flexible hours | Hybrid work setup | Laptops of choice | Team growth opportunitiesSenior-level Full TimeDelft, Zuid-Holland, Netherlands2d ago
-
Remote AI Engineer - Knowledge (m/f/d) EUR 85K-95KAPI | AWS | Access Control | DBT | DagsterBetterHelp Access | Birthday day off | Bonus vacation time | Co-working support | Extra days offMid-level Full TimeRemote Germany R2d ago
-
Remote AI Engineer - Agents (m/f/d) EUR 85K-95KAPI Integration | AWS | Alerting | Asynchronous programming | AuthenticationAnnual personal and professional development | BetterHelp Access | Birthday day off | Co-working support | Flexible working hoursMid-level Full TimeRemote Germany R2d ago
-
AWS | BigQuery | DBT | Data Modeling | Data TransformationAnnual leave | Company offsites | Home office setup | Inclusive culture | Pension contributionSenior-level Full TimeNetherlands2d ago
-
Cloud Data Engineer - Lead Consultant EUR 68K-86KCloud platform | Data Engineering | Google Cloud | Google Cloud Platform | PythonContinuous training and development | Hybrid work | Remote work 4 weeks per year | Team-building activitiesSenior-level Full TimeAmsterdam, NH, Netherlands R2d ago
-
Data Engineer EUR 89K-99KApache Kafka | Apache Spark | Data Governance | Data Modeling | Data PipelinesOnsite work | Some travelMid-level Full TimeThe Hague, Netherlands2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial team | Friendly work environment | Remote/distributed workMid-level Full TimeEindhoven, Netherlands2d ago
-
Data Engineer EUR 89K-91KApache Kafka | Apache Spark | Automation | Data Governance | Data ModellingOn-site work environment | Some travel to other NATO sitesMid-level Full TimeThe Hague, Netherlands.3d ago
-
Senior Data Engineer EUR 99K-99KApache Kafka | Apache Spark | Data Engineering | Data Governance | Data ModelingOn-site work | Some travel to other NATO sitesSenior-level Full TimeThe Hague, Netherlands3d ago
-
Senior-level Full TimeAmsterdam3d ago
-
AWS | Azure | CI/CD | DBT | Data VaultCollaborative environment | Continuous improvement culture | Professional growth | Technical leadershipSenior-level Full TimeAmsterdam, Netherlands3d ago
-
DBT | Data Modeling | Data Quality | Data Transformation | Data VaultSenior-level Full TimeAmsterdam, Netherlands3d ago
-
AWS | Airflow | Azure Data | Azure Data Lake | Azure DevOpsSenior-level Full TimeAmsterdam, Netherlands3d ago
-
AWS | Airflow | Azure Data | Azure Data Lake | Azure DevOpsSenior-level Full TimeAmsterdam, Netherlands3d ago
-
AI Services | Azure | Azure AI | Azure AI Services | Azure DevOpsAzure AI certification support | Career growth opportunities | Continuous learningMid-level Full TimeAmsterdam, Netherlands3d ago
-
Senior-level Full TimeAmsterdam, Netherlands3d ago