Data Engineer
Tasks
- Administer Databricks on Azure
- Apply security access controls and governance
- Build data ingestion integrations
- Collaborate with data analysts and mentor them
- Create SQL queries views and materialized views
- Design ETL and ELT pipelines
- Design data models schemas and storage
- Develop PySpark and Spark processing jobs
- Implement monitoring and alerting
- Maintain pipeline monitoring and troubleshooting
- Manage data documentation archiving retention and deletion
- Monitor and optimize pipeline performance
- Perform data cleansing transformation and validation
- Produce pipeline dataset and integration documentation
- Support data platform updates and tooling upgrades
Perks/Benefits
- Cycle to work
- Dental care
- Employee discounts
- Free broadband
- Health cash fund
- Healthcare and medical insurance
- Hybrid working
- Paid leave
- Pension
- Tech scheme
Skills/Tech-stack
Access Control | Alerting | Automation | Azure | Azure Infrastructure | Data Governance | Data Ingestion | Data Modelling | Data Quality | Database Administration | Databricks | ELT | ETL | Monitoring | PostgreSQL | PySpark | Python | REST API | SQL | Security Access | Security/Access Control | Spark
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Software Engineer - Developer Experience GBP 54K-81KAWS | Agentic AI | Build Automation | CI/CD | DockerCompany equity | Flexible working | Life insurance | Mental health support | Paid volunteering leaveMid-level Full TimeManchester14h ago
-
AI Engineer - Nexus Black GBP 78K-109KBackend Development | CI/CD | Cloud services | Embeddings | EvaluationHybrid workSenior-level Full TimeLondon, England, United Kingdom15h ago
-
Access Control | Apache Spark | Azure ML | Azure OpenAI | DAX23 days holiday plus bank holidays | Company pension | Cycle to work scheme | Electric vehicle scheme | Employee assistance programmeSenior-level Full TimeManchester, England, United Kingdom15h ago
-
Senior-level Full TimeLondon16h ago
-
kdb+ Contractor (Capital Markets) GBP 70K-87KAWS | Capital Markets | Cloud platform | Electronic Trading | Google CloudContract opportunity | Permanent opportunitySenior-level ContractLondon, England, United Kingdom17h ago
-
Senior-level ContractBelfast, Northern Ireland, United Kingdom18h ago
-
[London] Applied AI Architect (Public Sector) GBP 165K-190KAPIs | Cloud Architecture | Cloud Computing | Data Science | Enterprise IntegrationHybrid work policy | Travel to customer sites | Visa sponsorshipSenior-level Full TimeLondon, UK19h ago
-
Amazon S3 | Data Ingestion | Data Modeling | Data Pipelines | Data TransformationSenior-level Full TimeLondon19h ago
-
Senior Associate, IT, AI Engineer (Mid Level) GBP 70K-90KAWS | AWS Strands | Agent Frameworks | Agent Service | Azure AIHybrid working | Learning and development | Supportive team environmentMid-level Full TimeLondon, England, United Kingdom20h ago
-
Senior Data Engineer (Databricks) GBP 72K-80KAWS | AWS DMS | Amazon S3 | CI/CD | ComplianceHybrid workingSenior-level Full TimeLondon, England, United Kingdom20h ago
-
Principal Software Engineer - Data Infrastructure GBP 70K-110KApache Iceberg | Apache Kafka | Architecture | Batch Processing | Big DataSenior-level Full TimeRemote - United Kingdom R20h ago
-
Lead Data Scientist GBP 75K-75KAzure DevOps | CI/CD | Data Lakes | Data Warehousing | Distributed ComputingAnnual leave | Career breaks | Income protection | Life assurance | PensionSenior-level Full TimeEdinburgh, Scotland, United Kingdom22h ago
-
Data Engineer GBP 30K-30KAI tools | AWS | AWS CDK | AWS Cloud | AWS cloud infrastructureBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Free onsite gymEntry-level Full TimeManchester / Hybrid, England, United Kingdom R22h ago
-
Data Engineer GBP 70K-87KApache Airflow | Azure | C# | CI/CD | DBTCharity support | Coaching | Dental insurance | Development programs | Dog-friendly officesMid-level Full TimeLondon1d ago
-
Senior Data Engineer GBP 70K-70KAzure | Databricks | Databricks Lakeflow | Databricks Lakeflow Connect | ELTCycle to work scheme | Dental care | Employee discount platform | Free broadband | Health cash fundSenior-level Full TimeDroitwich Spa, GB R1d ago
-
Software Engineer, Embedded UI - C++ GBP 70K-88KC++ | CI/CD | Concurrency | Continuous integration | Debugging401k retirement options | Health benefits | Hybrid work option | Paid time off | Remote work flexibilitySenior-level Full TimeCambridge, United Kingdom1d ago
-
AWS | Ansible | Azure | Blue-Green Deployment | Blue/greenEquity | Flexible working | Home office stipend | Paid vacation | Remote workSenior-level Full TimeLondon, England, United Kingdom - Remote R1d ago
-
Senior Data Engineer GBP 70K-80KAWS | Amazon Redshift | DBT | Data Governance | Data LakeHybrid work modelSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data Engineer GBP 40K-49KApache Spark | Cloud infrastructure | Data Architecture | Data Lineage | Data ModelingFlexible first working arrangement | Growth opportunities | Hybrid work | Total rewards for health and wellbeingMid-level Full TimeUK - Leicester - Spinneyside, United …1d ago
-
Senior Data Engineer GBP 43K-52KAWS | Azure | Data Architecture | Data Modeling | Data QualityCareer development | Flexible work | MentorshipSenior-level Full TimeUK - Leicester - Spinneyside, United …1d ago
-
Applied AI Engineer GBP 100K-125KASR | Adversarial Testing | Azure | Barge In | ElevenLabsHybrid work | In-person work | Remote workMid-level Full TimeRemote (UK), United Kingdom R1d ago
-
Data Engineer GBP 64K-74KAccess Control | Alerting | Batch Processing | Data Contracts | Data GovernanceSenior-level Full TimeLeeds, United Kingdom1d ago
-
Dashboarding | Data Modeling | Data Pipelines | Data Quality | Data WarehousingSenior-level Full TimeLondon, England, GBR1d ago
-
Auto-regressive models | Custom Kernels | Data Engineering | DeepSpeed | Distributed TrainingSenior-level Full TimeLondon, UK1d ago
-
Staff Machine Learning Engineer, Simulation GBP 155K-163KData Analysis | Data Science | Deep learning | Evaluation metrics | Experiment designAnnual bonus program | Company benefits program | Equity incentive plan | Hybrid work environmentSenior-level Full TimeLondon, UK1d ago