Senior Data Engineer
Tasks
- Build data solutions on cloud platforms
- Build data warehouses data lakes lakehouses
- Collaborate with data scientists analysts product teams
- Design ETL/ELT pipelines
- Develop data models dimensional normalized star schema snowflake schema
- Develop orchestration workflows and scheduling
- Ensure data quality integrity consistency
- Implement data ingestion transformation storage
- Implement error handling logging alerting
- Implement validation testing monitoring frameworks
- Mentor junior data engineers
- Monitor troubleshoot data pipelines
- Optimize data structures for performance scalability
- Support data security compliance governance
Perks/Benefits
Skills/Tech-stack
AWS | AWS CloudFormation | AWS Glue | Amazon EMR | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache Hadoop | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Resource | Azure Resource Manager | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Dataflow | Data Factory | Data Lakes | Data Warehousing | Databricks | Dimensional Modeling | ELT | ETL | GCP | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Pubsub | Infrastructure as Code | Java | Kafka | Lakehouse | Normalized modeling | Python | Resource manager | SQL | Scala | Snowflake Schema | Star Schema | Synapse Analytics | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career growth | Competitive salary | Friendly work environment | Impactful productMid-level Full TimeEdinburgh, United Kingdom7h ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous work culture | Remote-friendly cultureMid-level Full TimeBirmingham, United Kingdom7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeNottingham, United Kingdom7h ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous work culture | Flexible work environment | Remote work opportunityMid-level Full TimeGlasgow, United Kingdom7h ago
-
Senior Machine Learning Engineer - AdTech GBP 75K-91KAerospike | Bayesian analysis | Decision Trees | Distributed Computing | ExperimentationCommuter benefits | Health and wellness benefits | Hybrid work schedule | Life and disability insurance | Paid time offSenior-level Full TimeCambridge, United Kingdom11h ago
-
Senior Machine Learning Engineer - AdTech GBP 75K-91KAerospike | Apache Spark | Bayesian analysis | Data Analysis | Decision TreesDisability insurance | Financial wellness support | Flexible remote work | Healthcare benefits | Life insuranceSenior-level Full TimeManchester, United Kingdom11h ago
-
Senior Data Engineer GBP 75K-90KAWS Glue | Airflow | BigQuery | Cloud services | DBTFlexible time off | Hybrid work | Medical insurance | Paid birthday off | Pension schemeSenior-level Full TimeKing's Cross, London, United Kingdom11h ago
-
Resident Solutions Architect (Full Stack Engineer) GBP 78K-100KAWS | Apache Spark | Azure | CI/CD | Cloud ComputingOccasional travel to London office | Occasional travel to client sites | Remote workSenior-level Full TimeLondon, United Kingdom16h ago
-
Senior Specialist Solutions Engineer (AI/ML) GBP 80K-100KAWS | Apache Spark | Apache Spark MLlib | Artificial Intelligence | AzureMentorship | Technical training | Travel up to 30 percentSenior-level Full TimeLondon, United Kingdom19h ago
-
A/B | A/B Testing | AWS | B testing | Batch inferenceEquity | Group life assurance | Hybrid working | Income protection | Paid sabbaticalSenior-level Full TimeLondon19h ago
-
Senior AI Engineer - Knowledge Graphs GBP 78K-109KAWS | Clustering | Community Detection | Entity Disambiguation | Entity ResolutionEnhanced parental leave | Flexible working | Group life assurance | Hybrid working | Income protectionSenior-level Full TimeLondon20h ago
-
Lead Analytics Engineer (6 Month FTC) GBP 60K-70KCI/CD | DBT | Data Governance | Data Modelling | Data QualityDiscounted private healthcare | Discretionary bonus scheme | Employee assistance programme | Enhanced family leave | Free onsite gymSenior-level Contract Full Time TemporaryManchester / Hybrid, England, United Kingdom R20h ago
-
Embedded Software Engineer GBP 30K-34KAutomated testing | Bare Metal | Bluetooth | C plus plus | C#Annual leave | Community and charity initiatives | Company pension | Cycle to work scheme | Performance bonusMid-level Full TimeMelbourn, United Kingdom22h ago
-
Senior Data Engineer GBP 60K-70KAirflow | Amazon Redshift | Apache Kafka | CI/CD | DBTCareer development | Collaborative team environment | Health insurance | Modern office spaceSenior-level Full TimeLondon, UK22h ago
-
AWS | Airflow | CI/CD | Distributed Systems | DockerContinuous improvement culture | Hybrid work environment | Mentorship and knowledge-sharing | On-call rotation support | Professional development opportunitiesSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Lead Data Engineer GBP 72K-109KAWS | Cloud infrastructure | Data Governance | Data Processing | Data StreamingSenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
MLOps Engineering Specialist GBP 55K-58KAWS | AWS CDK | AWS CloudFormation | AWS Glue | AlertingDiscounted mobile and broadband | Gym membership discounts | Holiday purchase scheme | Online GP service | Paid Maternity LeaveMid-level Full TimeLondon, GB, E1 8EP R1d ago
-
Lead Machine Learning Engineer GBP 90K-115KAWS | Azure | Cloud Computing | Cloud platform | ContainerizationCoaching | Dental insurance | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeLondon1d ago
-
Senior Machine Learning Engineer GBP 70K-86KAWS | AWS Step Functions | Airflow | Argo | AzureFinancial wellness support | Flexible remote work | Health benefits | Hybrid work | Mental health supportSenior-level Full TimeCambridge, United Kingdom1d ago
-
Data Engineer GBP 37K-42KAPI Integration | Azure Data | Azure Data Warehouse | Azure SQL | Business IntelligenceAnnual leave | Flex Time | Pension scheme | Remote workSenior-level Full TimeNorwich, United Kingdom R1d ago
-
Data Engineer GBP 53K-71KAmazon Redshift | Apache Hadoop | Apache Spark | Azure Data | Azure Data FactoryBonus scheme eligibility | Company pension up to 15 percent employer contribution | Coursera access | Dental coverage | Employee networksMid-level Full TimeGB - Edinburgh, United Kingdom1d ago
-
Data Engineering Lead - 12 Month FTC GBP 84K-102KAzure Data | Azure Data Factory | Cloud Data | Cloud Data Engineering | DBTSenior-level Contract Full Time TemporaryGB London, United Kingdom1d ago
-
Data Reliability Engineer II GBP 45K-53KAccess Control | Apache Kafka | BigQuery | CI/CD | Cloud ComposerCycle to work | EV Car Benefit Scheme | Education assistance | Family leave | Group pension planMid-level Full TimeBelfast - Millennium House, United Kingdom1d ago
-
Junior/Graduate Data Engineer GBP 30K-38KADLS Gen2 | Azure DevOps | Azure Synapse | Data Modeling | Data QualityAnnual leave | Benefit portal access | Cycle to work scheme | Healthcare cash plan | Hybrid remote workingEntry-level Full TimeFlexible Location, -, United Kingdom1d ago
-
Senior-level Full TimeLondon, Greater London, England, United Kingdom1d ago