Senior Data Engineer
Manchester, England, United Kingdom
GBP 70K-74K (estimate) Senior-level Full Time
Tasks
- Apply security and governance using Unity Catalog and Entra RBAC and secrets
- Build and operate data ingestion from APIs and SFTP and browser automation
- Collaborate with cross functional squad to deliver data platform capabilities
- Deliver changes using version control automated testing CI CD and Infrastructure as Code
- Design Databricks native solutions using Spark and SQL
- Develop maintainable Python libraries frameworks and data pipelines
- Engineer production reliability using observability alerting retries and failure recovery
- Mentor data engineers and evaluate new Databricks capabilities
- Own client data onboarding including backfills validation and monitoring
Perks/Benefits
Skills/Tech-stack
ADLS | APIs | Active Directory | Apache Spark | Asset bundles | Automated testing | Azure | Azure Active Directory | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | CI/CD | Data Lake Storage | Databricks | Databricks (asset) | Databricks Asset Bundles | ELT | ETL | FTPS | Infrastructure as Code | Lakeflow | Observability | Python | RBAC | SFTP | SQL | Secrets management | Unity Catalog | “as-code”
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Mid-level Full TimeUxbridge, United Kingdom5h ago
-
Software Developer, Data Platform GBP 55K-65KApache Flink | Apache Kafka | BigQuery | Cloud Spanner | Cloud platformHybrid work from home policyMid-level Full TimeManchester, England, United Kingdom R7h ago
-
Software Engineer III - AI/ML Platform Reliability GBP 90K-119KAmazon Web Services | Automated testing | Azure | CI/CD | Cloud NativeSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom7h ago
-
Data Engineering Specialist GBP 70K-94KAb Initio | Amazon Kinesis | Apache Kafka | Apache NiFi | Apache SparkDental insurance | Discounted telecom products | Flexible hybrid working | Gym memberships | Holiday purchase schemeSenior-level Full TimeBelfast, GB, BT1 3BT R7h ago
-
Alerting | Benchmarking | Cloud infrastructure | Data Pipelines | Distributed SystemsMid-level Full TimeUnited Kingdom R11h ago
-
LLM Application Engineer GBP 100K-140KAPI Integration | Context engineering | Distributed Systems | Evaluation | ExperimentationMid-level Full TimeUnited Kingdom R11h ago
-
Mid-level Full TimeNorthampton, Barclays Campus, Pavilion Drive, United …16h ago
-
Senior Applied AI & ML Engineer - Evinova GBP 75K-103KAPIs | AWS | AWS Bedrock | Agent systems | Asynchronous programmingSenior-level Full TimeUK - London, United Kingdom16h ago
-
AI Engineer — Prototyping & Emerging Tech GBP 52K-75KAPI Development | AWS | Azure | Cloud deployment | Cloud platformCompany sharesave scheme | Hybrid working | Learning fund | Pension Contribution Scheme | Private healthcareMid-level Full TimeLondon, UK, United Kingdom16h ago
-
Forward Deployed Engineer, Data & AI GBP 55K-60KCortex Code | Data Pipelines | Databricks | ETL | GeminiMid-level Full TimeLondon17h ago
-
Senior Embedded Software Engineer GBP 59K-62KC# | C++ | CMake | Debugging | Embedded SystemsCareer growth | Flexible benefits | Health and wellbeing benefits | Inclusive work environment | Safety focusSenior-level Contract Full TimeHemel Hempstead, England, United Kingdom1d ago
-
Quantitative Developer GBP 150K-200KAutomation | C++ | Cloud Computing | Containers | Data ValidationEthical standards focus | Office based five days a weekMid-level Full TimeLondon1d ago
-
Senior AI Engineer (AI Platform) GBP 70K-85KAI Foundry | API Management | APIM | Agent Orchestration | AgentOpsDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Mid-level Full TimeLondon1d ago
-
Senior-level Full TimeLondon1d ago
-
Robotics Engineer GBP 45K-55KA Star | Algorithm Optimization | C++ | Computer Vision | DWAAnnual leave | Employee assistance program | Enhanced company pension | Every other Friday off | Eye care schemeMid-level Full TimeGB-Ipswich1d ago
-
Forward Deployed Engineer GBP 80K-98KAWS | Azure | Cloud Architecture | Docker | GCPCoaching | Enhanced parental leave | Family-friendly flexibility | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago
-
Data Engineer GBP 45K-70KAWS | Apache Airflow | Apache Spark | CI/CD | Cloud ComputingInsurance | Paid time offMid-level Full TimeEdinburgh / Hybrid R1d ago
-
Data Analysis | Data Quality | Data Visualization | Graph Neural Networks | JavaMid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer GBP 37K-45KAPI Integration | AWS | AWS Glue | Amazon EMR | Amazon RedshiftAnnual leave | Company pension scheme | Cycle to work | Hybrid working | Performance bonusMid-level Full TimeBristol, England, United Kingdom R1d ago
-
Senior Embedded C++ Engineer GBP 57K-66KAutomated testing | C Plus Plus 11 | C Plus Plus 14 | C Plus Plus 17 | C plus plusCycle & Tech Scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Embedded Software Engineer GBP 55K-65KC++ | CI/CD | Communications | Configuration Management | DebuggingCareer development | Cycle and tech scheme | Employee assistance programme | Flexible working | Learning opportunitiesSenior-level Full TimeCrawley, England, United Kingdom1d ago
-
Staff Applied Scientist GBP 150K-190KCloud Computing | Complex Planning | Data Analysis | Dataset analysis | Deep learningEMI share option scheme | Hybrid work | Mentoring and coaching | Share optionsSenior-level Full TimeLondon1d ago
-
Senior Data Engineer GBP 75K-115KAPI Development | AWS CloudWatch | AWS Glue | AWS Lambda | Amazon AthenaEmployee assistance programme | Extensive leave policy | Flexible working options | Health insurance | Life insuranceSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior-level Full TimeGlasgow Campus, United Kingdom1d ago