Databricks Lead Engineer (Contract)
London, England, United Kingdom
GBP 70K-90K (estimate) Senior-level Contract
Tasks
- Build systems on Linux
- Design multiple downstream delivery models
- Develop metadata and catalogue migration
- Implement Unity Catalog governance
- Implement backup strategy with one day RTO
- Implement continuous integration and unit testing
- Implement metadata compaction versioning
- Migrate processed data to Delta Lake
- Model and partition order book data
- Re engineer Delta Tables
Perks/Benefits
Skills/Tech-stack
AWS | Amazon S3 | Apache Iceberg | Continuous integration | Databricks | Delta Lake | Delta Tables | Delta UniForm | Lake Formation | Linux | Python | Source Control | Unit Testing | Unity Catalog
Education
N/A
Related jobs
-
Senior-level Full TimeLeicester, Leicestershire, United Kingdom8h ago
-
Machine Learning Engineer GBP 50K-65KAzure ML | Azure ML pipelines | CatBoost | Data Analysis | Data CleansingMid-level Full TimeUK025 - Erskine,United Kingdom(UK025)21h ago
-
Senior Data Quality Engineer GBP 72K-80KAirflow | Apache Beam | Apache Kafka | BDD | BehaveFlexible working | Hybrid working | Job share | Parental leave | Pension contributionSenior-level Full TimeBristol Harbourside, United Kingdom21h ago
-
AWS | Apache Spark | Autogen | CrewAI | DatabricksCycle to work scheme | Discount vouchers | Gym membership | Private healthcareEntry-level Apprenticeship Full TimeUK113 - Newcastle UK (UK113), United …21h ago
-
Amazon Web Services | Autogen | CrewAI | Databricks | ETLCycle to work scheme | Discount vouchers | Gym membership | Mentoring | Private healthcareEntry-level Apprenticeship Full TimeUK113 - Newcastle UK (UK113), United …21h ago
-
Analytics Engineer GBP 50K-75KAzure | CI/CD | Cloud Data | Cloud Data Warehouse | DBTEnhanced parental leave | Flexible benefits budget | Hybrid working | Income protection | Life insuranceEntry-level Full TimeLondon1d ago
-
Data Engineer GBP 60K-60KAzure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Continuous DeliveryAnnual leave | Buy additional leave | Discounts and cashback | Health care cash plan | Life assuranceMid-level Full TimeUnited Kingdom, United Kingdom, United Kingdom1d ago
-
Machine Learning Engineer (Recommenders) GBP 65K-80KBatch Processing | CI/CD | Containerization | Deep learning | Distributed ComputingEmployee communities | Employee discount | Flexible benefits allowance | Online learning resources | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom1d ago
-
GCP Data Engineer GBP 100K-125KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud StorageHybrid workingExecutive-level Full TimeEdinburgh, Scotland, United Kingdom1d ago
-
BI Analyst GBP 65K-85KAnomaly Detection | Azure AI | Data Modeling | Data Warehousing | ELTEmployee stock purchase options | Health insurance | Learning programs | Paid time off | Product DiscountsMid-level Full TimeLeeds, United Kingdom1d ago
-
AWS | Access Control | Agent systems | Agentic AI | Artificial IntelligenceHybrid work model | Mentoring and development | Work from office 3 days per weekSenior-level Full TimeLondon, NA, United Kingdom1d ago
-
Data Engineer III – Databricks & Python GBP 70K-86KAWS Lambda | AWS S3 | AWS Step Functions | Agile | Amazon ECSSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Senior Embedded Linux Software Engineer GBP 45K-60KBuildroot | C plus plus | C# | CI/CD | Cross-compilationDisability income protection | Employee assistance program | Life insurance | Pension plan | Private healthcareSenior-level Full TimeFarnborough, Hampshire, United Kingdom1d ago
-
Embedded Linux Software Team Lead GBP 46K-70KC plus plus | C# | CI/CD | GDB | GitDisability income protection | Employee assistance program | Life insurance | Pension plan | Private healthcareSenior-level Full TimeFarnborough, Hampshire, United Kingdom1d ago
-
Lead Software Engineer-Python & Databricks GBP 90K-123KAWS | Agile | Application Resiliency | CI/CD | Continuous DeliverySenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Senior-level Full TimeAbingdon, United Kingdom1d ago
-
Deep Learning Engineer for Game Technology GBP 67K-107K3D Geometry | 3D Mesh | Computer Architecture | Computer Vision | Data pipelineCycle garage | Dental scheme | Free soft drinks | On-site bar | On-site gymSenior-level Full TimeUnited Kingdom, London1d ago
-
Senior Machine Learning Engineer GBP 55K-55KAWS | Azure Machine Learning | Clustering | Databricks | Decision TreesHybrid workingSenior-level Full TimeManchester, Greater Manchester, United Kingdom1d ago
-
Software Specialist (TL) - AI/ML - Monetisation GBP 35K-40KAds | Auction theory | Behavior Modeling | Bidding | BudgetingSenior-level Full TimeRemote, UK | London, UK R1d ago
-
Staff Software Engineer, ML Performance and Accelerators GBP 225K-325KBenchmarking | C++ | Co-design | Compiler | Compute SystemsSenior-level Full TimeLondon, UK1d ago
-
Director, AI & Automation – Shared Services GBP 130K-150KAWS | AWS Bedrock | Access Management | Airflow | Anthropic ClaudeExecutive-level Full TimeEngland, SE1 9RA, GB1d ago
-
Lead Growth Analyst - Marketing Analytics GBP 85K-110KAI Agents | DBT | Data Modeling | Data Quality | Data WarehousingSenior-level Full TimeLondon, United Kingdom1d ago
-
DevOps Engineer GBP 72K-90KAPIM | ARM | AWS | Application Gateway | Application Load BalancerAnnual leave | Birthday leave | Charity match funding | Company funded private medical cover | EAP assistanceMid-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer GBP 70K-80KAWS IAM | AWS Redshift | Access Control | Amazon Bedrock | Amazon SageMakerSenior-level Full TimeUK-Remote, UK, United Kingdom R1d ago
-
Freelance Machine Learning Engineer USD 110KComputational Algorithms | NumPy | Numerical Methods | Pandas | PythonFreelance engagement | Part-time schedule | Portfolio growth | Remote workMid-level FreelanceUnited Kingdom - Remote R1d ago