Senior Lead Software Engineer - Databricks & Python
GLASGOW, LANARKSHIRE, United Kingdom
GBP 72K-82K (estimate) Senior-level Full Time
Tasks
- Add observability and performance engineering
- Build and deploy high-availability services
- Build logging metrics tracing alerting
- Champion SDLC with test automation
- Design and deliver secure microservices
- Develop and optimize big-data pipelines
- Implement CI/CD and security by default
- Implement Python and PySpark processing
- Implement data quality checks and monitoring
- Lead production code development
- Own build and run operations
- Provide technical leadership and SME support
- Troubleshoot in Kubernetes environments
- Use AI coding assistants for development
- Write tests and perform code reviews
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Lambda | AWS S3 | AWS Step Functions | Agile | Airflow | Alerting | Amazon ECS | Amazon SNS | Amazon SQS | Apache Spark | Automated testing | Backoff | CI/CD | Caching | Circuit Breakers | Concurrency | Data Quality | Data orchestration | Databricks | Error Budgets | Event Driven | Event-driven architecture | Java | Jenkins | Kubernetes | Logging | Messaging | Metrics | Microservices | NoSQL | NoSQL Databases | Observability | Performance Tuning | PySpark | Python | REST APIs | React | Relational databases | Retries | SDLC | SLO | SQL | Schema Design | Security | SonarQube | Spinnaker | Spring Boot | Step Functions | Test automation | Thread management | Tracing
Education
N/A
Related jobs
-
Data Engineer Support Officer GBP 50K-50KConfluence | Database performance | Database performance tuning | ETL | ITILHybrid workingMid-level Full TimeGB-ENG-LAN-Preston4h ago
-
Apache Airflow | Apache Spark | App Service | Azure | Azure AppMid-level Full TimeLondon, United Kingdom16h ago
-
Apache Lucene | Conversational AI | Elasticsearch | Java | Language ModelsFamily benefits | Flexible working arrangements | Generous time off | Hybrid working patterns | On-site nurseryEntry-level Full TimeHinxton, United Kingdom16h ago
-
Staff Applied Scientist GBP 225K-325KBlack | Cloud Computing | Complex Planning | Data Analysis | Deep learningHybrid work schedule | Mentoring and coachingSenior-level Full TimeLondon1d ago
-
Experienced Quantitative Researcher - Cambridge GBP 65K-85KC++ | Data Structures | Data Structures and Algorithms | Linux | PythonInternational team outing | Medical insurance | Paid vacationSenior-level Full TimeCambridge, England, United Kingdom1d ago
-
Senior Analytics Engineer GBP 45K-55KCI/CD | DBT | Dataform | GitLab | Google BigQueryEmployee referral bonus | Hybrid work | Profit share bonus | Share incentive plan | Uncapped leaveSenior-level Full TimeBath, England, United Kingdom1d ago
-
Data Technology Engineer (UK) GBP 65K-88KAPI Management | Apache Airflow | CI/CD | Database Management System | DockerMid-level ContractLondon, United Kingdom of Great Britain …2d ago
-
Staff Forward Deployed Engineer, GenAI, Google Cloud GBP 90K-130KAPI Integration | Agent Development | Agent Development Kit | Agent systems | Cloud platformSenior-level Full TimeLondon, UK2d ago
-
Forward Deployed Engineer, GenAI, DACH, Google Cloud GBP 100K-120KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeLondon, UK2d ago
-
AI Safety | APIs | Agent systems | Cloud platform | CrewAISenior-level Full TimeLondon, UK2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Diverse and inclusive workplace | Remote-friendly work environmentMid-level Full TimeLondon, United Kingdom2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial team | Friendly work environment | Hands-off management | Opportunities for impactMid-level Full TimeBristol, United Kingdom2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Flexible management | Remote-friendlyMid-level Full TimeLeeds, United Kingdom2d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFlexible hours | Freelance project-based work | Part-time engagementMid-level FreelanceUnited Kingdom - Remote R2d ago
-
Staff Engineer — Data Platform GBP 80K-110KAWS | Apache Airflow | Apache Flink | Apache Kafka | DBTFlexible days off | Health plan | Home office bonus | Language courses | Personal growth coursesSenior-level Full TimeLondon R2d ago
-
Lead Data Platform Engineer (eDV) GBP 64K-80KAgile | Amazon S3 | Amazon Web Services | Apache Spark | Automated testing25 days holiday plus bank holidays | Annual training allowance | Company paid medical insurance | Employee assistance plan | Life assuranceSenior-level Full TimeHybrid, UK R3d ago
-
Lead Data Engineer (eDV) GBP 64K-70KAgile | Amazon Web Services | Ansible | Athena | Data Modeling25 days holiday plus bank holidays | Annual training allowance | Company paid medical insurance | Employee assistance plan | Enhanced DV Security ClearanceSenior-level Full TimeHybrid, UK R3d ago
-
Automation | By Design | CI/CD | Cloud infrastructure | Data ComplianceAnnual professional subscription reimbursement | Defined contribution pension | Employee assistance programme | Enhanced parental leave | Eye TestsSenior-level Full TimeLondon, England, United Kingdom3d ago
-
Senior Kubernetes Engineer – Data Platform GBP 70K-95KAmazon S3 | Apache Hadoop | Apache Iceberg | Apache Spark | Custom Resource DefinitionsSenior-level ContractLondon, United Kingdom of Great Britain …3d ago
-
Senior Analytics Engineer GBP 50K-57KArchitecture | DBT | Data Documentation | Data Lineage | Data ModelingDiscounts via Cobens Extras | Dog-friendly office | Financial coaching | Flexible work schedule | Free snacksSenior-level Full TimeLondon, England, United Kingdom R3d ago
-
Data Engineer GBP 51K-51KAgile | Data Modelling | Data Pipelines | Data virtualization | ETLFlexible working arrangements | Hybrid workingSenior-level Full TimeGB-ENG-LAN-Warton3d ago
-
A M L | A/B | A/B Testing | AWS | AirflowCreativity and Wellness benefits | Employee equity plan | Flexible PTO | Free German courses | Gym membershipSenior-level Full TimeBerlin, London3d ago
-
Data Platform Engineer - Fixed Term Contract GBP 70K-90KBatch Processing | CI/CD | Cloud Native | Cloud-native infrastructure | Data ContractsSenior-level Contract TemporaryGermany (Remote) ; Ireland (Remote); Netherlands … R3d ago
-
Senior Manager GBP 55K-70KAdvanced Analytics | Machine Learning | Python | Quantitative Analysis | Reporting toolsSenior-level Full TimeLondon, England, United Kingdom3d ago
-
Benchmarking | C++ | Co-design | Compilers | Distributed SystemsSenior-level Full TimeLondon, UK3d ago