Senior Data Engineer
Tasks
- Build bronze silver and gold datasets
- Conduct code reviews and mentor engineers
- Design build and operate Spark pipelines
- Implement automated data quality checks
- Implement governed repeatable ingestion patterns
- Support and stabilize Azure Synapse workloads
- Tune Spark workloads for performance and cost
Perks/Benefits
- Annual bonus
- Electric vehicle scheme
- Family-friendly leave
- Paid time off
- Paid volunteering days
- Pension scheme
- Retail offers
- Share purchase plan
- Training and development
Skills/Tech-stack
Apache Spark | Azure Synapse | Backfilling | Cloud Cost Optimization | Cost Optimization | Data Modeling | Data Quality | Data Validation | Databricks | Failure recovery | Incremental loading | Informatica IDMC | Joins | Partitioning | Performance Tuning | PySpark | SQL | Schema evolution | Shuffles | Storage Optimization
Education
N/A
Roles
Related jobs
-
Apache Spark | Audit trails | Azure Data | Azure Data Factory | Azure DevOpsAnnual leave | Employer pension matching | Private medical insuranceSenior-level Full TimeAlderley Edge, GB5h ago
-
Lead Analytics Engineer GBP 70K-80KAWS | Analytics engineering | Business Intelligence | DBT | Data Modeling3 office days per week in London | Hybrid remote workSenior-level Full TimeLondon22h ago
-
Data Engineer GBP 80K-105KAWS | Apache Airflow | CI/CD | ClickHouse | DBTBirthday off | Cloud-based setup | Flexible-hybrid work | Global get-togethers | Internal trainingMid-level Full TimeLondon22h ago
-
Data Engineering Consultant GBP 60K-77KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data FactoryFlexible working hours | Inclusive workplace | Work-life balanceSenior-level Full TimeLondon, United Kingdom, United Kingdom23h ago
-
Analytics Engineer, Data Operations GBP 60K-75KAWS Glue | Amazon Athena | Amazon S3 | Apache Airflow | AzkabanFlexible schedule | Free parking | Hybrid work | Secure bike shed | SnacksSenior-level Full TimeManchester, United Kingdom23h ago
-
Analytics Lead, Full Stack GBP 113K-161KA/B | A/B Testing | B testing | Dashboards | Data ModelingDental coverage | Employee stock purchase plan | Flexible spending accounts | Health coverage | Paid time offSenior-level Full TimeRemote UK R23h ago
-
Data Engineer GBP 55K-65KAccess Control | Agile | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeWorsley1d ago
-
Senior Data Engineer Greece GBP 91K-110KAWS | Apache Spark | CI/CD | Code review | DBTDevelopment | Flexible working hours | Generous leave | Gym | HealthcareSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer Greece - Mid Level GBP 45K-65KAWS | Apache Spark | CI/CD | DBT | Data GovernanceDevelopment | Flexible working hours | Generous leave | Healthcare | Impactful projectsMid-level Full TimeLondon, United Kingdom1d ago
-
Lead ML Engineer / Scientist GBP 87K-115KA/B | A/B Testing | AWS S3 | Amazon EMR | Amazon SageMakerSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Scientist - Computer Vision Specialist GBP 70K-85KAirflow | Cloud Computing | Computer Vision | Docker | GitSenior-level Full TimeSale, England, United Kingdom1d ago
-
Data Engineer GBP 37K-45KAPIs | AWS | AWS Glue | AWS Lambda | Amazon DynamoDBAnnual leave | Cycle to work | Give as you earn | Hybrid working | Pension schemeMid-level Full TimeBelfast, United Kingdom1d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R1d ago
-
Senior Data Engineer GBP 70K-80KAgile | Automated testing | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimeSalford Quays1d ago
-
Senior Data Engineer GBP 60K-70KAWS | Agile | Azure | CI/CD | DatabricksAnnual leave | Books | Cycle to work scheme | Discounted gym membership | Employee clubsSenior-level Full TimeEdinburgh1d ago
-
Data Engineer GBP 52K-70KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureCareer impact on growing company | Competitive benefits package | Opportunity to work on cutting-edge technology | Remote work option | Team collaborationMid-level Full TimeLondon R1d ago
-
Lead Data Platform Engineer - DataOps GBP 84K-109KAWS | AWS Glue | Access Control | Amazon EMR | Apache AirflowCareer progression | Cycle to work scheme | Enhanced parental leave | Flexible benefits | Generous holiday entitlementSenior-level Full TimeLocation: Nottingham, England1d ago
-
AI Native SW Engineering GBP 190K-230KAutogen | CI/CD | Chunking | Context engineering | Cost OptimizationSenior-level Full TimeLondon, 20 Farringdon Road, United Kingdom1d ago
-
Senior Data Platform Engineer GBP 66K-80KAWS | Access Management | Batch Processing | Cloud Computing | ContainersSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Analytics Engineer GBP 50K-60KData Modeling | Data Warehousing | Databricks | Generative AI | Machine LearningHybrid work environmentMid-level Full TimeLeicester, Leicestershire, United Kingdom1d ago
-
Research Data Engineer GBP 96K-103KAmazon S3 | Apache Airflow | Apache Spark | Cloud Storage | DagsterMid-level Full TimeLondon2d ago
-
Senior Data Engineer GBP 75K-115KAPI Development | AWS | AWS Glue | AWS Lambda | Amazon AthenaEmployee assistance program | Extensive leave policy | Flexible working | Health insurance | Life insuranceSenior-level Full TimeLondon, England, United Kingdom2d ago
-
AI/ML Computational Scientist Manager GBP 57K-65KAlerting | Big Data | C++ | Cloud Computing | Data PipelinesMid-level Full TimeLondon, 30 Fenchurch Street, United Kingdom2d ago
-
Data Platform Engineer GBP 50K-50KAccess Control | Azure | Data Contracts | Data Governance | Data LineageHybrid working | Permanent contract | Professional learning opportunitiesMid-level Full TimeManchester, United Kingdom2d ago
-
Senior-level Full TimeLondon, 30 Fenchurch Street, United Kingdom2d ago