Lead Data Engineer
Remote/Home Based, UK
R
GBP 70K-80K (estimate) Senior-level Full Time
Tasks
- Apply infrastructure as code
- Build and deploy batch and real time streaming solutions
- Build cloud native data platforms using AWS
- Design secure scalable data pipelines
- Develop data ingestion transformation and integration
- Drive engineering best practices with code reviews automated testing and CI CD
- Ensure data quality governance lineage and security
- Implement event-driven architectures
- Lead architecture workshops and discovery sessions
- Make technical design decisions
- Mentor and support engineers
- Modernize and migrate client data platforms
- Perform data modelling performance tuning and root cause analysis
Perks/Benefits
- 25 days holiday
- Annual training allowance
- Employee assistance plan
- Life assurance
- Medical insurance
- Pension scheme
- Virtual GP
- Wellbeing allowance
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | Agile | Amazon Athena | Amazon EC2 | Amazon RDS | Amazon S3 | Apache Flink | Apache Kafka | Apache Pulsar | Automated testing | CI/CD | Data Governance | Data Lineage | Data Quality | Event Driven | Event-driven architecture | Git | Infrastructure as Code | NoSQL Databases | Python | Relational databases | SQL | Spark Streaming | Test-Driven | Test-Driven Development | “as-code”
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R3d ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R5h ago
-
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | BigQueryCollaborative environment | Continuous learning | Fully remote work | Professional growth opportunitiesMid-level Full TimeBrazil R6h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R6h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R7h ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CDDental insurance | Employee assistance program | Flexible work hours | Gympass | Life insuranceMid-level Full TimeSão Paulo, BR R17h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R19h ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Airflow | Amazon SageMaker | Apache Beam | Argo Workflows | Attention MechanismSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
AWS | Apache Kafka | Capacity Planning | Consistency | Distributed SystemsGlobal customer impact | Hybrid work location | Modern technology stackSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Mid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Azure | Azure Data | Azure Data Explorer | Azure Event | Azure Event HubsMid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Data Engineer, Platform EUR 42K-55KAmazon Web Services | Apache Spark | Databricks | Git | KubernetesAdditional paid leave | Career growth | Employee stock options | Paid volunteering opportunities | Performance bonusMid-level Full TimeRemote R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
AI Research Engineer USD 205K-344KCryptography | Distributed Systems | Federated Learning | Fine Tuning | GoEntry-level Full TimeAnywhere R1d ago
-
Deployment Strategist - North America USD 150K-245KAI Agent | AI Agent Frameworks | API Integration | Agent Frameworks | Agent OrchestrationAnnual company offsite | Annual travel stipend | Co-working stipend | Professional development stipendMid-level Full TimeUnited States R1d ago
-
Experienced Data Engineer - Streaming Platform EUR 55K-95KAWS Kinesis | Amazon Web Services | Apache Beam | Apache Flink | Apache KafkaChild day care support | Gym membership | Lunch vouchers | Premium healthcare coverage | Relocation supportMid-level Full TimeParis R1d ago
-
Data Engineer GBP 50K-70KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Cloud platformBenefits package | Flexible work schedule | Remote work one day per weekMid-level Full TimeLondon R1d ago
-
AI Lead (Brazil) BRL 144K-146KAI Platform | Analytics | Data Analysis | Language Processing | Machine LearningCareer growth opportunities | Remote-first companySenior-level Full TimeRemote/Brazil R1d ago
-
Senior Data Engineer EUR 60K-84KCI/CD | ClickHouse | Docker | Kafka | KubernetesCareer development | Flexible working hours | Learning time | Remote-first | Social benefitsSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Engineering Tech Lead CAD 143K-170KAI/ML | CCaaS | CRM | CTI | EmbeddingsCareer growth | Fast-paced startup environment | Fully remote | Weekly sprint cadenceSenior-level Full TimeToronto, Ontario R1d ago
-
Senior Data Solutions Lead USD 175K-200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkDHS Public Trust suitability determination | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Senior Data Engineer USD 114K-154KAgile | Alteryx | Autosys | Azure Data | Azure Data Factory401k | Career growth | Dental insurance | Education reimbursement | Flexible spending accountSenior-level Full TimeRemote R1d ago
-
AIOps | APIs | AWS | Anomaly Detection | AzureFlexible working hours | Fully remote | Remote collaborationMid-level Full TimeIndia R2d ago