Senior Data Engineer
Tasks
- Administer Azure databases including performance tuning backup and recovery
- Apply data masking and encryption at rest and in transit
- Assemble large complex datasets
- Backfill as technical lead for business intelligence data management
- Build ETL and ELT data pipelines
- Build enterprise data warehouse and reporting pipelines
- Design and build data models for structured and unstructured data
- Design data lake and delta lake ingestion and storage
- Develop analytics technologies for business insights
- Implement data processing pipelines
- Manage BI and data management team until replacement
- Manage cloud data hub infrastructure for data management systems
- Monitor access audit logs and enforce security
- Validate data quality using testing methodologies
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Event | Azure Event Hubs | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | Backup and Recovery | C++ | Cause analysis | Data Factory | Data Lake Storage | Data Management | Data Modeling | Data Pipelines | Data Quality | Data Warehousing | Data masking | Database performance | Database performance tuning | Databricks Delta | Databricks Delta Lake | Delta Lake | ELT | ETL | Encryption | Event Hubs | Hadoop | Java | Kafka | Master Data | Master Data Management | Message queuing | Metadata Management | NoSQL | Performance Tuning | Power BI | Python | Reference Data | Reference Data Management | Root Cause Analysis | Root cause | SQL | Scala | Storm | Stream Analytics | Stream processing | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
AI Engineer GBP 45K-50KAI Search | Azure AI | Azure AI Search | Azure OpenAI | DatabricksAbility to purchase additional annual leave | Annual leave | Discretionary bonus scheme | Employee assistance program | Employee share purchase planMid-level Full TimeLondon, United Kingdom10h ago
-
Agentic AI Engineer, AI Automation GBP 70K-89KAI Search | AWS | Agents SDK | Autogen | AzureAdditional paid time off | Employee resource groups | Flexible working hours | Hybrid work model | Modern Health App accessMid-level Full TimeLondon12h ago
-
Senior Controls & Robotics Engineer GBP 50K-65KAPM | Electrical schematics | EthernetIP | Fieldbus | HMISenior-level Full TimeNewport, Wales, GB, NP19 4XJ19h ago
-
Mid-level Full TimeCanary Wharf, 1 Churchill Place, United …19h ago
-
Defence Analytics Engineer GBP 40K-71KArtificial Intelligence | C Sharp | Data analytics | Machine Learning | PythonBonus scheme | Coursera access | Financial advice | Flexi days | Flexible benefitsNone Full TimeGB - London - Whitehall, United …19h ago
-
Defence Analytics Engineer GBP 40K-71KAerodynamics | C# | C++ | Computer Modeling | Guidance and controlBonus scheme | Dental coverage | Employee networks | Extra flexi days | Financial adviceEntry-level Full TimeGB - London - Whitehall, United …19h ago
-
Data Engineer - Value & Analytics GBP 31K-34KAWS | Analytics GA4 | Azure | Cloud Computing | DashboardsHybrid workMid-level Full TimeUnited Kingdom R20h ago
-
Data Engineering Lead - Value & Analytics GBP 38K-46KAWS | Azure | Cloud Architecture | Cybersecurity | Data GovernanceHybrid workSenior-level Full TimeUnited Kingdom R20h ago
-
Software Engineer - Data Infrastructure GBP 45K-52KAWS | Amazon SQS | Batch Processing | BigQuery | Data IngestionMid-level Full TimeLondon22h ago
-
API Management | Apache Spark | Azure API | Azure API Management | Azure DataSenior-level Contract Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Mid-level Full TimeTrimble Offices, Morley1d ago
-
AI Engineer GBP 70K-96KAccess Control | Azure | Azure AI | CI/CD | ClaudeCareer follow-up | Certification support | Continuous learning opportunities | Flexible schedule | Remote working policyMid-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer - Infra GBP 68K-85KApache Airflow | Apache Kafka | Apache Spark | ClickHouse | GrafanaSenior-level Full TimeLondon, England, GB1d ago
-
Mid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer (Crypto) 12mth FTC-1 GBP 53K-73KAWS EventBridge | AWS Glue | AWS Lambda | AWS Redshift | AWS Step FunctionsEmployee assistance program | Flexible benefits | Hybrid work | Income protection | Life assuranceMid-level Full TimeLondon, United Kingdom R1d ago
-
Entry-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Data Engineer GBP 39K-39KAmazon Redshift | Amazon Web Services | Apache Spark | CI/CD | Cloud platformEducation grant for private schooling | Flexible working arrangements | Free shuttle bus to work | Generous time off | Hybrid workingMid-level Full TimeHinxton, United Kingdom1d ago
-
Senior Data Platform Engineer GBP 65K-80KAutomation | Azure | Azure CLI | Azure IaaS | Azure PaaS401k | Company discounts | Employee assistance program | Health care benefits day 1 | Paid time offSenior-level Full TimeQVC - Knowsley, United Kingdom1d ago
-
DevOps Engineer GBP 80K-109KAWS | Ansible | CloudFormation | Containers | Continuous DeploymentBlameless postmortems | On-call rotationSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Data Engineer GBP 70K-80KAWS | Agile | CCPA | CI/CD | Cloud platformCharity involvement | Discretionary bonus schemes | Health and well-being support | Learning hub access | Sustainability initiativesSenior-level Full TimeLuton, GB, LU2 9TN1d ago
-
SAP Data & Analytics Architect Senior Manager GBP 60K-80KAI and Machine Learning | AI enablement | APIs | Agile | Analytics CloudSenior-level Full TimeLondon1d ago
-
Senior Data Engineer -Quantexa GBP 70K-74KApache Spark | Azure DevOps | CI/CD | Contextual Data Modeling | Contextual dataFlexible hours | Office work on demand | Part-time options | Work from homeSenior-level Full TimeLondon1d ago
-
AI Data Engineer GBP 50K-60KBigQuery | Cloud Storage | Cloud platform | Docker | ETLFlexible benefits | Life assurance | Medical cover | Parental leave | Season ticket loansMid-level Full TimeLondon, England, United Kingdom1d ago
-
Mid-level Full TimeKnutsford, Radbroke Hall, United Kingdom1d ago
-
Lead Platform Engineer GBP 75K-85KAI Safety | AWS Step Functions | Amazon EKS | Amazon SageMaker | Apache AirflowSenior-level Full TimeGlasgow Campus, United Kingdom1d ago