Data Engineer
Valletta, Valletta, Malta
Uni Systems
At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team.
What will you be doing in this role?
- Design, develop, document, and maintain ETL/ELT processes, data integration, cleaning, transformation, dissemination and automation processes.
- Create robust solutions to collect, integrate, and process structured, semi-structured, and unstructured data (e.g. JSON, Parquet, Delta).
- Design, develop, document and maintain data architecture, data modelling and metadata.
- Develop and support data warehouse/lakehouse architectures and data processing ensuring data quality, lineage, auditing, metadata, logging, linkage across datasets and impact assessments.
- Work collaboratively with data providers to address data gaps and optimize source-system structures.
- Develop and maintain business intelligence models, interactive dashboards, reports and analytics using tools such as Databricks, Jupyter Notebooks, and Power BI.
- Design, develop, document, improve and maintain the Data Warehouse/Lakehouse ecosystem (e.g. the DataDevOps lifecycle, architecture).
- Support the gathering and analysis of business requirements, translating them into scalable data collection and integration processes.
- Contribute to the definition and documentation of data governance policies, procedures, standards, and metadata models.
- Participate in meetings with project and data teams to align on strategic priorities, ensuring seamless integration and optimal data management practices.
Requirements
What will you be bringing to the team?
- Have a minimum a High School diploma.
- At least 6 years of professional experience.
- Proficiency in data development and processing using Python, SQL, Power M, and DAX.
- Experience working with structured, semi-structured, and unstructured data types and file formats (e.g., JSON, Parquet, Delta).
- Ability to gather and translate business requirements into scalable data collection, integration, and analysis processes.
- Hands-on experience with Microsoft On-Premise and Azure Data Platform tools, including: Azure Data Factory, Azure Functions, Azure Logic Apps, SQL Server, Azure Data Lake Storage (ADLS), Azure Databricks, Microsoft Fabric/Power BI, Azure DevOps, Azure AI Services, PowerShell).
- Familiarity with CI/CD workflows, particularly using Azure DevOps.
- Strong knowledge of the Databricks ecosystem, Apache Spark, and Python data libraries.
- Solid understanding of data modeling principles and techniques.
- Experience with Data Lakes and Lakehouse architectures, including governance and lifecycle management.
- Knowledge of data integration and data warehouse/lakehouse modeling techniques, such as: Slowly Changing Dimensions (SCD), Functional engineering, Data Vault, Data streaming.
- Understanding of data governance and data management standards, including metadata, data quality, policies, and compliance.
- Familiarity with Web APIs and the OpenAPI specification.
- Proficiency in English language at a minimum B2 level.
At Uni Systems, we are providing equal employment opportunities and banning any form of discrimination on grounds of gender, religion, race, color, nationality, disability, social class, political beliefs, age, marital status, sexual orientation or any other characteristics. Take a look at our Diversity, Equality & Inclusion Policy for more information.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Architecture Azure Business Intelligence CI/CD Databricks Data governance Data management Data quality Data warehouse DevOps ELT Engineering ETL JSON Jupyter Parquet Power BI Python Spark SQL Streaming Unstructured data
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.