Senior Data Engineer
Tasks
- Administer Databricks on Azure
- Build SQL views and materialized views
- Build data ingestion integrations
- Collaborate on system data connectivity and extraction
- Design ETL and ELT pipelines
- Implement security measures and access controls
- Manage pipelines end to end
- Optimize pipeline performance and compute usage
- Perform data cleansing transformation and validation
- Support data governance and data management
Perks/Benefits
- Cycle to work scheme
- Dental care
- Employee discount platform
- Free broadband
- Health cash fund
- Healthcare and medical insurance
- Hybrid working
- Paid leave
- Pension contribution
- Tech scheme
Skills/Tech-stack
Azure | Databricks | Databricks Lakeflow | Databricks Lakeflow Connect | ELT | ETL | Lakeflow Connect | Postgres | PySpark | Python | REST API | SQL | Spark
Education
Associate Degree | Bachelor of Arts | Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
Principal Software Engineer - Data Infrastructure GBP 70K-110KApache Iceberg | Apache Kafka | Architecture | Batch Processing | Big DataSenior-level Full TimeRemote - United Kingdom R21h ago
-
Data Engineer GBP 30K-30KAI tools | AWS | AWS CDK | AWS Cloud | AWS cloud infrastructureBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Free onsite gymEntry-level Full TimeManchester / Hybrid, England, United Kingdom R23h ago
-
AWS | Ansible | Azure | Blue-Green Deployment | Blue/greenEquity | Flexible working | Home office stipend | Paid vacation | Remote workSenior-level Full TimeLondon, England, United Kingdom - Remote R1d ago
-
Applied AI Engineer GBP 100K-125KASR | Adversarial Testing | Azure | Barge In | ElevenLabsHybrid work | In-person work | Remote workMid-level Full TimeRemote (UK), United Kingdom R1d ago
-
Data & Analytics Engineer GBP 70K-89KAgile | Azure DevOps | CI/CD | Csharp | Data GovernanceBackground checks | Hybrid workSenior-level Full TimeYork, United Kingdom, Hybrid R1d ago
-
Data Engineer GCP (Remote) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Data ModelingRemote workEntry-level Full TimeStoke-on-Trent, England, United Kingdom R1d ago
-
Senior Data Engineer GBP 75K-80KAWS | Access Control | Amazon Bedrock | Amazon Redshift | Amazon SageMakerSenior-level Full TimeUK-Remote, UK, United Kingdom R2d ago
-
Machine Learning Engineer - Apprentice GBP 29K-33KAI Evaluation | Experimentation | Language Models | Large Language Models | Machine LearningAnnual leave | Flexi-time | Generous pension scheme | Paid training | Remote workEntry-level Apprenticeship Full TimeLiverpool, United Kingdom R2d ago
-
Software Engineer - Data Platform (Hybrid, GBR) GBP 90K-110KAmazon DynamoDB | Apache Flink | Apache Hadoop | Apache Hive | Apache IcebergCompetitive vacation | Employee networks | Paid adoption leave | Paid parental leave | Professional development opportunitiesSenior-level Full TimeLondon (Haggerston), United Kingdom R2d ago
-
Member of Technical Staff (Robotics Research Lead) GBP 145K-157K3D Perception | C++ | Computer Vision | Decision Making | Generative ModelsCollaboration with research teams | Relocation supportSenior-level Full TimeUK, Remote R4d ago
-
Senior Machine Learning Engineer GBP 78K-109KA/B | A/B Testing | B testing | Clustering | DockerDental insurance allowance | Flexible working | Four day working week | Gym membership allowance | HolidaySenior-level Full TimeLondon, England, United Kingdom R5d ago
-
Senior Analytics Engineer GBP 62K-73KBudgeting | Data Governance | Data Modeling | Data Pipelines | DatabricksFlexible hybrid working | Home office setup budget | Monthly Healthcare Allowance | Parental leave | Relocation options after 1 yearSenior-level Full TimeCzechia; Spain; United Kingdom R6d ago
-
AI Solutions Engineer GBP 60K-80KBusiness case | Business case development | Case Development | Conversational AI | Data StorytellingCycle to work | Life insurance | LinkedIn Learning | Paid holiday | Pension schemeMid-level Full TimeLondon R6d ago
-
ArcSight | Cybersecurity | Dashboards | EDR | ETLRemote work | Travel opportunitiesMid-level Full TimeLondon R6d ago
-
Senior Machine Learning Engineer GBP 78K-109KA/B | A/B Testing | B testing | Docker | FeastDental insurance allowance | Flexible working | Gym membership allowance | Learning and development budget | Life assuranceSenior-level Full TimeLondon, England, United Kingdom R6d ago
-
Technology - ML Ops Engineer GBP 60K-75KAKS | Access Control | Alerting | Auditability | AzureAnnual leave | Buy and sell holiday | CPD support | Core hours flexible schedule | Cycle to work schemeMid-level Full TimeLeeds, England, United Kingdom R7d ago
-
Tech Lead, LLM & Generative AI (Full Remote - UK) GBP 90K-140KDPO | Data labeling | Evaluation Frameworks | Fine Tuning | HuggingfaceAI tools access | Annual in-person meetup | Co-working space budget | Equipment allowance | Fully remoteSenior-level Full TimeUnited Kingdom R8d ago
-
Automation | C++ | Collateral Management | Econometrics | Funding risk30 days holiday | Coaching | Flexible working | Hybrid working | Life assuranceMid-level Full TimeLondon, 21 Moorfields, United Kingdom R8d ago
-
Data Engineer GBP 45K-45K3NF | Apache Airflow | Azure Data | Azure Data Factory | CI/CDCompany pension | Cycle purchase scheme | Discount schemes | Flexible holiday program | Flexible workingMid-level Full TimeGBR-Llandudno TYC, United Kingdom R8d ago
-
Senior Data Engineer, Anti-Fraud Technology GBP 90K-106KAWS | Apache Flink | Apache Kafka | Apache Kafka Streams | CloudFormationHybrid workSenior-level Full TimeLondon, GBR, United Kingdom R8d ago
-
Bilby | CAMB | Class | DOLFINx | FenicsPart-time project workSenior-level FreelanceUnited Kingdom - Remote R8d ago
-
Combinatorics | Graph theory | MATLAB | NumPy | Number theoryPart-time flexible hours | Project based workSenior-level FreelanceUnited Kingdom - Remote R8d ago
-
Senior ML Engineer - Kimchi (LLM Inference Optimization GBP 110K-141KActivations quantization | Amazon Web Services | ArgoCD | CUDA | CUDA-adjacent toolingEquipment budget | Equity options | Extra days off | Hackathon | Learning budgetSenior-level Full TimeUnited Kingdom R9d ago
-
Freelance Machine Learning Engineer USD 110KLangchain | MLOps | NumPy | Pandas | Prompt engineeringPart-time opportunities | Project based workMid-level FreelanceUnited Kingdom - Remote R10d ago
-
Langchain | MLOps | NumPy | Pandas | Prompt engineeringFlexible part-time hours | Freelance project-based work | Paid per projectMid-level FreelanceUnited Kingdom - Remote R10d ago