Junior Data Engineer
United Kingdom
Department for Business and Trade
Export support for UK businesses – great.gov.uk
About us The Department for Business and Trade (DBT) has a clear mission - to grow the economy. Our role is to help businesses invest, grow and export to create jobs and opportunities right across the country. We do this in three ways. Firstly, we help to build a strong, competitive business environment, where consumers are protected and companies rewarded for treating their employees properly. Secondly, we open international markets and ensure resilient supply chains. This can be through Free Trade Agreements, trade facilitation and multilateral agreements. Finally, we work in partnership with businesses every day, providing advance, finance and deal-making support to those looking to start up, invest, export and grow. The Digital, Data and Technology (DDaT) directorate develops and operates tools and services to support us in this mission. About the role As a Junior Data Engineer you will help us design, implement, test and operate our data products, pipelines and services. We will help you to develop in the Data Engineering profession towards more senior roles. You will have opportunities to contribute to a range of solution to satisfy our data user needs. The team will rely on your ability to query and transform data using both SQL (Postgres) and Python (Pandas, Apache Airflow). You will help building efficient data pipelines and creating services that expose the data through APIs. The role follows the DDaT framework: https://www.gov.uk/guidance/data-engineer About you You will be
- a flexible problem solver with interest in data and digital technology
- a team player able to collaborate on solutions with other professions
- eager to learn more and share what they know with others
- Implement, troubleshoot, and test data products and services using standard techniques and tools.
- Help building data solutions which are scalable, resilient, and future proof.
- Understand typical problems in databases, data processes, data products and services. You understand and can apply typical solutions to those problems.
- Implement, troubleshoot, and test pipelines, Web APIs, services, or scripts.
- Work in an Agile and cross-functional team
- Agile methodologies. You know about agile methodologies and the ways you can apply the principles in practice. You can take an open-minded approach; you know why iteration is important. You know how agile processes can be used to validate ideas with users.
- Data development process. You can design, build and test data products based on feeds from multiple systems using a range of different data exchange, storage and access technologies. You can create testable, repeatable and reusable products.
- Data technology. You can apply data models using database technology. You understand and apply appropriate data design principles to achieve performant and secure databases. You are aware of general trends in data technology.
- Technical understanding (data engineering). You understand core technical concepts like data normalisation, modelling, performance of data intensive solutions. You understand basic software development concepts.
- Communication skills (data). You know about the need to translate technical concepts into non-technical language and understand what communication is required for internal and external stakeholders.
- Data modelling. You understand the concepts and principles of data modelling and can produce, maintain and update relevant data models for specific business needs. You know how to reverse-engineer data models from a live system.
- Problem resolution (data). You know about the types of problems in databases, data processes, data products and services.
- Programming and build (data engineering). You can design, code, test, correct and document simple programs or scripts using Python and SQL. You can use source control to manage your code.
- Testing. You can execute test scripts under supervision. You understand the role of testing and how it works.
- Working Together
- Developing Self and Others
- departmental or company records (personnel files, staff reports, sick leave reports and security records)
- UK criminal records covering both spent and unspent criminal records
- your credit and financial history with a credit reference agency
- security services record
- location details
- learning and development tailored to your role
- a flexible, hybrid working environment with options like condensed hours
- a culture encouraging inclusion and diversity
- a Civil Service pension with an average employer contribution of 27%
- annual leave starting at 25 days rising to 30 days with service
- three paid volunteering days a year
- an employee benefits programme including cycle to work
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
0
0
Category:
Engineering Jobs
Tags: Agile Airflow APIs Data pipelines dbt Engineering Finance Pandas Pipelines PostgreSQL Python Security SQL Testing
Perks/benefits: Career development Equity / stock options Flex hours Startup environment
Region:
Europe
Country:
United Kingdom
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Principal Data Scientist jobsStaff Data Scientist jobsPrincipal Data Engineer jobsData Manager jobsContent writer - Freelance AI Tutor jobsWriter - Freelance AI Tutor jobsJunior Data Analyst jobsData Scientist II jobsData Science Manager jobsResearch Scientist jobsBusiness Data Analyst jobsSr. Data Scientist jobsSenior Machine Learning Researcher jobsSr Data Engineer jobsLead Data Analyst jobsSoftware Engineer, Machine Learning jobsBI Analyst jobsData Science Intern jobsJunior Data Engineer jobsSenior AI Engineer jobsAzure Data Engineer jobsCopywriter - Freelance AI Tutor jobsData Analyst II jobsData Engineer III jobsJunior Data Scientist jobs
Linux jobsEconomics jobsSnowflake jobsHadoop jobsOpen Source jobsPhysics jobsRDBMS jobsComputer Vision jobsJavaScript jobsBanking jobsMLOps jobsData Warehousing jobsScala jobsKafka jobsNoSQL jobsAirflow jobsGoogle Cloud jobsSAS jobsData warehouse jobsOracle jobsClassification jobsPostgreSQL jobsKPIs jobsR&D jobsGitHub jobs
Streaming jobsScikit-learn jobsData Mining jobsScrum jobsTerraform jobsLooker jobsCX jobsPandas jobsPySpark jobsJira jobsDistributed Systems jobsIndustrial jobsRobotics jobsReact jobsRedshift jobsJenkins jobsMySQL jobsMicroservices jobsBigQuery jobsdbt jobsMatlab jobsUnstructured data jobsE-commerce jobsData strategy jobsGPT jobs