Senior Software Engineer, Data Engineering
Tasks
- Apply medallion architecture patterns
- Build and operate Databricks pipelines
- Create technical design documents
- Define governed reusable data models
- Design production ETL pipelines
- Develop production data quality validations
- Implement Delta Live Tables
- Implement failure detection and alerting
- Integrate AI tooling in data workflows
- Integrate pipeline observability monitoring
- Maintain data lineage
- Manage infrastructure with Terraform
- Mentor engineers through code reviews
- Perform code reviews and technical mentorship
- Set up Unity Catalog data contracts and access controls
- Set up retry logic and operational hygiene
Perks/Benefits
- Catered lunches
- Employee giving match
- Generous vacation policy
- In office collaboration flexibility
- Industry-leading parental leave policies
- Learning and development budget
- Mobile phone stipend
- R and R days
- Wellness reimbursement
Skills/Tech-stack
AWS | Alerting | Apache Spark | CI/CD | Data Lineage | Data Modeling | Data Quality | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ETL | GitLab | Infrastructure as Code | LLM | Language Models | Language Processing | Large Language Models | Medallion Architecture | Monitoring | Natural Language | Natural Language Processing | Observability | PySpark | Python | SQL | Spark SQL | Terraform | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
APIs | Access Control | Agentic AI | Context engineering | Data GovernanceSenior-level Full TimeUK - Remote R14h ago
-
Senior Applied AI & ML Engineer - Evinova GBP 100K-103KAWS Bedrock | Agent systems | Agentic design | Agentic design patterns | Anthropic ClaudeFlexible working | Health insurance | Inclusive workplace | Professional developmentSenior-level Full TimeUK - London, United Kingdom17h ago
-
Senior Applied AI & ML Engineer - Evinova GBP 100K-103KAWS Bedrock | Classical machine learning | Cloud Computing | Context engineering | Data IngestionFlexible working hours | Health and wellbeing benefits | Hybrid work arrangement | Professional development support | Reasonable accommodationsSenior-level Full TimeUK - London, United Kingdom17h ago
-
API Integration | Access Controls | Agent Orchestration | Agentic Workflows | Anthropic APIRemote work | Travel opportunitiesSenior-level Full TimeUK - Remote R20h ago
-
AI Engineer-Anthropic-University/Graduate Level - UK GBP 130K-180KAPI | Cloud Computing | Data Privacy | Docker | EmbeddingsMid-level Full TimeUK - Remote R20h ago
-
PyTorch Engineer GBP 128K-200KC++ | Git | Linear Algebra | Numerical analysis | PyTorchCycle to work scheme | Dental cover | Flexible working | Free food | Generous leaveMid-level Full TimeBristol, UK1d ago
-
Data Engineer GBP 38K-45KAPIs | AWS | AWS Glue | AWS Lambda | Amazon DynamoDBAnnual leave | Company pension | Hybrid work | Learning budget | Performance bonusMid-level Full TimeManchester, United Kingdom R1d ago
-
Lead Machine Learning Engineer GBP 90K-126KAWS | Azure | Docker | Go | Google CloudCoaching | Dental coverage | Enhanced parental leave | Family-friendly flexibility | Flexible workingSenior-level Full TimeUK - London1d ago
-
AI Systems & ML Engineering Industry Expert GBP 92K-120KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible scheduling | Fully remote | Low time commitmentSenior-level Part TimeLondon, Greater London, GB R1d ago
-
Staff Machine Learning Engineer - Ops GBP 150K-163KCI/CD | GitHub Actions | Grafana | ML Pipeline | MLOpsHybrid work policySenior-level Full TimeLondon R1d ago
-
Data Engineer GBP 75K-90KAPI Integration | AWS | AWS Glue | AWS Lambda | AgileCourse training | Hybrid working | Learning budget | Mentoring | Private healthcareSenior-level Full TimeBelfast, United Kingdom R1d ago
-
Sr. Solutions Engineer GBP 80K-110KAWS | Apache Flink | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeLondon, United Kingdom1d ago
-
Machine Learning Engineer (Closed Loop) GBP 155K-163KDiffusion Models | Generative Modeling | Latent-video models | Machine Learning | Multi SensorHybrid work | Inclusive work environment | Publication opportunities | Work from homeMid-level Full TimeLondon R1d ago
-
Machine Learning Engineer (Synthetic Data) GBP 155K-163K3D Geometry | Autoregressive Video | Behaviour Cloning | Calibration | Camera GeometryHybrid work policyMid-level Full TimeLondon R1d ago
-
Algorithms | Analytics Pipelines | C++ | Code review | Data StructuresSenior-level Full TimeLondon, UK1d ago
-
Research Engineer, AGI Safety and Alignment, DeepMind GBP 150K-220KAdversarial Training | Artificial Intelligence | Evaluation | Fine Tuning | Human FeedbackMid-level Full TimeLondon, UK1d ago
-
Software Engineer (LLM Engineering), London GBP 77K-109KAgentic coding | Cloud infrastructure | Context Management | Cost Management | Fine TuningHybrid work modelSenior-level Full TimeLondon1d ago
-
AWS Cloud Infrastructure Engineer GBP 75K-95KAWS CloudFormation | AWS CloudTrail | AWS Config | AWS IAM | AWS KMSSenior-level Full TimeLeeds, Hybrid R1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon QuickSightEmployer pension contribution | Flexible benefits | Life assurance | LinkedIn Learning access | Paid holidaySenior-level Full TimeHybrid, London, England, United Kingdom R1d ago
-
Lead Data Platform Engineer -6 Month Secondment GBP 85K-102KAPI Integration | AWS Glue | AWS Lake | AWS Lake Formation | AWS LambdaAnnual leave | Bank holidays | Healthcare | Pension | SharesaveSenior-level Full TimeNottingham, United Kingdom R1d ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 90K-110KAnomaly Detection | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group personal pension scheme with employer matchMid-level Full TimeRemote - United Kingdom R1d ago
-
Senior Field Specialist - Data Platform GBP 65K-89KAnsible Automation | Apache Airflow | Apache Impala | Apache Ozone | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeUK-Remote, United Kingdom R1d ago
-
GenAI Full-Stack Engineer GBP 60K-72KAPI Design | Cloud Native | Containers | DevSecOps | Distributed SystemsEmployee assistance program | Hybrid work | Life insurance | Paid parental leave | Pension planMid-level Full TimeLocation(s): London, England, United Kingdom1d ago
-
Senior Enterprise Technology Engineer GBP 70K-80KAI SDLC | AWS | Agile | Amazon Web Services | Amazon Web Services IAMFlexible working options | Hybrid office/remote work | No Travel | Paid parental leave | Retirement benefitsSenior-level Full TimeGB: London - 25 North Colonnade, …1d ago
-
AWS AI Engineer GBP 84K-109KAWS | Agile | Compliance | Data Governance | Data PipelinesHybrid working | Learning and development opportunities | Mental health support | Wellbeing appsSenior-level Full TimeManchester, GB R1d ago