Data Engineer - 6 month Contract

Data Engineer (6 month contract) UK Remote

£450-£500 per day Inside IR35

bigspark, a UK based consultancy delivering next level data platforms and solutions with a focus on exciting technologies including Apache Spark, Apache Kafka and working on projects within Machine Learning, Data Engineering, Streaming and Data Science is looking for a Data Engineer to join our team on a contract basis in a remote, work from home capacity.

We provide the backbone for modern analytics to our clients through expertise in DevOps, distributed computing, machine learning and adoption of proven open source projects. We specialise in backend development, infrastructure automation and performance engineering for data workloads at scale.

Your Skills and Experience

Design, develop, and maintain large-scale data pipelines using Azure Databricks, Data Lake, Data Factory, and other Azure services.

Develop ETL processes to ingest, transform, and clean structured and unstructured data for use in analytics and reporting.

Implement real-time data streaming and batch processing solutions using Azure Databricks and integrate with Azure Event Hub or Azure Stream Analytics as needed.

Collaborate with cross-functional teams to integrate data from multiple sources, ensuring data quality and consistency.