Data Engineer -London Insurance Market
Tasks
- Apply AI assisted software engineering
- Build batch data pipelines
- Build real-time data pipelines
- Design cloud-based data platforms
- Develop scalable Python and PySpark pipelines
- Ensure data quality reconciliation lineage and auditability
- Implement engineering governance code reviews CI CD and deployment standards
- Integrate data from insurance systems and market feeds
- Mentor engineers and advise stakeholders
Perks/Benefits
Skills/Tech-stack
Amazon Web Services | Automated testing | Azure | Batch Data Integration | Batch data | CI/CD | Claude | Cloud platform | Data Lineage | Data Modeling | Data Quality | Data integration | Databricks | Git | Google Cloud | Google Cloud Platform | Medallion Architecture | OpenAI | PySpark | Python | Real Time | Real-Time Data Integration | Real-time Data | Snowflake | Time data integration | Web Services
Education
N/A
Roles
Related jobs
-
Artificial Intelligence | CI/CD | Continuous Deployment | Continuous integration | Continuous integration Continuous deploymentSenior-level Full TimeLondon, UK21h ago
-
Applied AI Engineer GBP 100K-160KAI Agent | Backend Development | Cloud services | Docker | JavaScriptExperimentation time | International team culture | Learning-focused environment | Remote work flexibilityMid-level Full TimeLondon, United Kingdom21h ago
-
Applied AI & Data Scientist GBP 50K-61KAgent-based | Agent-based systems | Data Engineering | Data Pipelines | Deep learningAnnual leave | Family-friendly initiatives | Flexible work options | Hybrid working | Pension schemeMid-level Full TimeEdinburgh - Central Area, Midlothian, United …21h ago
-
Lifecycle Data Analyst GBP 50K-60KA/B | A/B Testing | B testing | Data Quality | Data VisualizationMid-level Full TimeUnited Kingdom, London21h ago
-
AWS | Ansible | Automation | Backups | CDCCareer growth | Mentorship and coaching | On-call rotations | RSU benefitsSenior-level Full TimeLondon, United Kingdom22h ago
-
AWS | Ansible | As-a-Service | Authentication | AutomationMid-level Full TimeLondon, United Kingdom22h ago
-
Data Science & AI Specialist GBP 30K-30KAWS Bedrock | Apache Druid | Apache Pulsar | Artificial Intelligence | CI/CDCarers leave up to 2 weeks | Discounted mobile and broadband | Equalized maternity paternity and adoption leave | Holiday purchase scheme | Hybrid workingMid-level Full TimeLondon, GB, E1 8EP R23h ago
-
Revenue Operations Data Engineering Partner GBP 60K-80KAutomation | B2B SaaS | B2B SaaS Revenue Mechanics | CRM Integrations | CRM hygieneSenior-level Full TimeLondon, United Kingdom23h ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
AI Software Engineer GBP 80K-105KAPI Design | Agentic patterns | Application Context | CI Automation | Dependency InjectionSenior-level Full TimeUnited Kingdom-Cambridge-Milton Road-Cambridge Science Park1d ago
-
Tableau & Data Specialist – FX Data & Analytics, AVP/VP GBP 107K-126KAPIs | Access Control | Airflow | Automated testing | CI/CDAdditional benefits | Hybrid work | Support for employees and families | Work from homeExecutive-level Full Time33 CANADA SQUARE CANARY WHARF LONDON, …1d ago
-
Data Engineer, Analytics Engineering GBP 70K-78KAWS | Apache Iceberg | Automated Deployment | Canonical Data | Canonical Data ModelHybrid workSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Associate Director, AI & Advanced Analytics GBP 44K-50KAgent-based | Agent-based tools | Artificial Intelligence | Automation | Code AutomationMid-level Full TimeEMEA, GB, Berkshire, Maidenhead, CSL Behring, …1d ago
-
Senior AI Engineer GBP 75K-100KAWS | Agentic Systems | Anthropic API | Azure | Cloud platformAnnual leave | Community volunteering | Company pension | Cycle to work | Give as you earnSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer GBP 50K-65KAWS CloudFormation | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache FlinkFlexible work schedule | Gym discounts | Learning resources | Mental health support | MentorshipMid-level Full TimeLondon R1d ago
-
Palantir Data Engineers GBP 55K-67KAPI Integration | AWS Glue | AWS Lambda | AWS S3 | Cause analysisCritical illness cover | Cycle scheme | Discounts and promotions | Income protection insurance | Life assuranceMid-level Full TimeLondon, England, United Kingdom1d ago
-
Junior Data Engineer GBP 40K-50KApache Airflow | DBT | Data Modeling | GitHub Actions | Jenkins2-for-1 share purchase plans | Dental insurance | EV scheme | Extra festive time off | Family-friendly benefitsEntry-level Full TimeLondon R1d ago
-
ETL Engineer (Analytics Engineering focus) GBP 39K-46KAPI Integration | Advertising Data | Dashboards | Data Modeling | Data QualityCareer progression | Dedicated training time | Inclusive culture | Industry partnerships | Training and developmentMid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer GBP 50K-70KAgile | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataDEI initiatives support | Employee discount | Flex benefits allowance | Industry events participation | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom1d ago
-
IT Data Engineer GBP 50K-58KData Lake | Data Warehouse | DevOps | Epicor ERP | Power BICompany events | Company pension | Employee discount | Free or subsidised travel | Free parkingMid-level Full TimeKeele, Staffordshire, United Kingdom1d ago
-
Analytics Engineer GBP 55K-75KCI/CD | DBT | Data Catalog | Data Modeling | Data QualityBank holidays | Company Mental Health Support | Gym membership | Health insurance | Hybrid workMid-level Full TimeLondon R1d ago
-
APIs | AWS | Annotation systems | Automation | AzureAnnual leave | Company lunches | Learning and development budget | Monthly socials | Team offsitesMid-level Full TimeLondon1d ago
-
AI Engineer, Google Cloud Consulting GBP 65K-85KApache Beam | Apache Flume | Apache Hadoop | Apache Hive | Apache PigTravel up to 30 percentMid-level Full TimeLondon, UK1d ago
-
Adobe Analytics | Adobe Launch | Campaign tracking | Consent Management | Cookie ComplianceHybrid work options | Learning and development | Professional development programs | Remote work optionsSenior-level Full TimeLondon1d ago