Lead Software Engineer - Python, Databricks, AWS
GBP 72K-100K (estimate) Senior-level Full Time
Tasks
- Automate remediation of recurring issues
- Build data models for reporting
- Collaborate with business stakeholders on data strategies
- Design data pipelines
- Develop ETL/ELT workflows
- Develop in CI CD SDLC with Agile
- Document data flows and transformation rules
- Ensure data quality, security, and lineage
- Implement monitoring and alerting
- Manage production support and SRE for data pipelines
- Mentor engineers and ensure delivery standards
- Migrate legacy systems to cloud data warehouses
- Perform code reviews and debugging
- Transform and process large-scale data
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Step Functions | Agile | Airflow | Apache Spark | Avro | CI/CD | CSV | Data Lineage | Data Modeling | Data Quality | Data Security | Databricks | Delta Lake | ECS | ELT | ETL | JSON | Jenkins | Lambda | Parquet | PySpark | Python | S3 | SNS | SQL | SQS | SonarQube | Spinnaker | Step Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Lead Software Engineer | Software Engineer
Related jobs
-
Forward Deployed Engineer - Defence GBP 65K-90KAngular | Artificial Intelligence | Full Stack | Full-Stack Development | GitEqual opportunity | Technical training | Travel as neededMid-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
Lead Data Scientist GBP 72K-82KAnomaly Detection | Bayesian Methods | C# | Cross-validation | Data VisualizationHybrid working | Life assurance | Pension contribution | Private medical insurance | Professional certifications supportedSenior-level Full TimeLeeds, England, United Kingdom1d ago
-
Lead Data Scientist GBP 72K-82KAnomaly Detection | Apache Spark | Bayesian analysis | Bias Mitigation | C#Employee resource groups | Flexible working | Hybrid working | Life assurance | Pension contributionSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Lead Data Scientist GBP 72K-82KAnomaly Detection | Bayesian Inference | C# | Cross-validation | Decision Trees25 days holiday | Employee resource groups | Flexible working | Hybrid working | Life assuranceSenior-level Full TimeBirmingham, England, United Kingdom1d ago
-
Consulting Systems Engineer, Data Management (EMEA) GBP 75K-101KAWS | Ansible | Apache Kafka | Azure | Cloud hybridCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeRemote, United Kingdom R1d ago
-
Software Engineer II - Applied AI GBP 57K-70KAI Applications | AWS | Amazon SageMaker | Azure | Cloud NativeMid-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Market Data Engineer GBP 58K-108KAeron | Apache Arrow | Bloomberg | ClickHouse | FASTCareer development and internal mobility | Discretionary bonus | Group life insurance | Gym discounts | Holiday allowanceMid-level Full TimeLondon, United Kingdom1d ago
-
Junior Analytics Engineer GBP 30K-35KArtificial Intelligence | DBT | Data Modeling | Data pipeline | ELTCycle to work scheme | Electric vehicle salary sacrifice | Employee referral program | Flexible working | Office meals and snacksEntry-level Full TimeLondon R1d ago
-
Alteryx | Business Requirements | Data Analysis | Data Reconciliation | Data TransformationFlexible resources | Paid leave | Paid volunteer time | Wellbeing programsExecutive-level Full TimeManchester, Greater Manchester, United Kingdom1d ago
-
Digital Chemist - Lab Automation & Data Science GBP 28K-28KData Analysis | Data Processing | Data Visualization | Hardware Integration | Laboratory automationBonus scheme | Life insurance | Paid time off | Pension plan | Private medical insuranceMid-level Full TimeBracknell, BERKSHIRE, United Kingdom1d ago
-
Head of Data Platform GBP 70K-75KAnalytics engineering | Cloud Computing | Cost Optimization | DBT | Data GovernanceExecutive-level Full TimeLondon, England, United Kingdom1d ago
-
Analytics Engineer GBP 75K-90KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data ModellingEnglish language at office | In person 3 days per week | Relocation supportMid-level Full TimeLondon R1d ago
-
API Integration | Agent systems | Cloud Architecture | Cost Optimization | Data PipelinesSenior-level Full TimeLondon, UK1d ago
-
Research Engineer, Quantum Computing, DeepMind GBP 45K-60KAgentic AI | Algorithms | Data Structures | Language Models | Language ProcessingMid-level Full TimeLondon, UK1d ago
-
API Design | Agile | Airflow | Application Resiliency | Automated testingCareer growth | Diversity inclusion respect | MobilitySenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Machine Learning Engineer GBP 55K-55KAzure ML | Clustering | Data Monitoring | Decision Trees | DevOpsCoaching and mentoring opportunities | Hybrid workingMid-level Full TimeManchester, Greater Manchester, United Kingdom1d ago
-
CI/CD | Containerization | Data Pipelines | Data parallelism | Deep learningEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalised learningSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Growth Analytics Engineer GBP 57K-70KAmazon Redshift | Analytics engineering | Cohort Analysis | DBT | Data ModelingMid-level Full TimeLondon, United Kingdom1d ago
-
Staff Applied Scientist GBP 150K-190KBlack | Cloud Computing | Complex Planning | Data Analysis | Deep learningFlexible work schedule | Hybrid work model | Stock options | Team daysSenior-level Full TimeLondon1d ago
-
Senior-level Full TimeHomeworker - UK, United Kingdom1d ago
-
Senior-level Full TimeHomeworker - UK, United Kingdom1d ago
-
Lead Data Analyst GBP 70K-90KDashboard Development | Data Analysis | Data Interpretation | Data Modeling | Data VisualizationSenior-level Full TimeHomeworker - UK, United Kingdom1d ago
-
AWS | Azure | Computer Vision | Docker | GCPContributory pension scheme | Cycle to work | Dental coverage | Enhanced family leave | Enhanced sick paySenior-level Full TimeGloucester, South Gloucestershire, United Kingdom1d ago
-
Data Scientist & Machine Learning Researcher GBP 44K-55KAWS | AWS CLI | Agile | Command Line | Computer VisionContributory pension scheme | Cycle to work | Dental coverage | Enhanced family leave | Enhanced sick payMid-level Full TimeGloucester, South Gloucestershire, United Kingdom1d ago
-
Software Engineer (Machine Learning) GBP 68K-80KAndroid | Automation | FPGA | Linux | Machine LearningHybrid workingEntry-level Full TimeLocation Cambridge, United Kingdom1d ago