Data Engineer
The Hague, South Holland, Netherlands
Uni Systems
At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team in The Hague, Netherlands!
What will you be doing in this role:
- Designs and implements data pipelines and data stores to acquire and prepare data.
- Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
- Carries out routine data quality checks and remediation.
- Designs, codes, verifies, tests, documents, amends and refactorsmoderately complex programs/scripts.
- Applies agreed standards and tools to achieve a well-engineered result.
- Identifies issues related to software development activities.
- Proposes practical solutions to resolve issues.
- Collaborates in reviews of work with others as appropriate.
- Defines the software modules needed for an integration build andproduces a build definition for each generation of the software.
- Assesses the integrity of data from multiple sources.
- Provides advice on the transformation of data from one format/medium to another.
- Enables the availability, integrity and search ability of information through the application of formal data and metadata structures andprotection measures.
- Applies standard data modelling and design techniques based upon a detailed understanding of requirements.
- Establishes, modifies and maintains data structures and associated components.
- Communicates the details of data structures and associated components to others using the data structures and associated components.
Requirements
What do you need to succeed in this position?
- Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management.
- At least two years' experience planning and maintaining data lakes and pipeline processes, both batch-wise and (near) realtime;
- Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using data integration technologies.
- Experience in using of data engineering tools to support data science, data analytics and data visualisation
- Experience with state-of-the-art data engineering, analytics, data integration and pipeline tools/programming language.
- Solid understanding of data security best practices, including dataencryption, access controls, authentication/authorization mechanisms, and compliance requirements.
- Experience with monitoring and logging tools to ensure the reliability and performance of data pipelines and AI systems.
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes.
- Knowledge of best practice of software development. E.g CI/CD pipelines, unit/functional testing, following styling guides.
- Good knowledge of English
At Uni Systems, we are providing equal employment opportunities and banning any form of discrimination on grounds of gender, religion, race, color, nationality, disability, social class, political beliefs, age, marital status, sexual orientation or any other characteristics. Take a look at our Diversity, Equality & Inclusion Policy for more information.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture CI/CD Data Analytics Data pipelines Data quality Docker Engineering Kubernetes Pipelines Security Testing
Perks/benefits: Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.