Data Engineer - Index Data Processing
Tasks
- Aggregate data from internal and third party sources
- Build and maintain PostgreSQL queries and datastores
- Collaborate with researchers and clients to convert needs into features
- Develop Python HTTP APIs and pipelines
- Implement automated testing for feature development
- Maintain data quality integrity and performance
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | AWS Lambda | AWS Step Functions | Automated testing | Data Quality | Data pipeline | HTTP API | PostgreSQL | Python | Query Optimization | React | SQL | Step Functions
Education
N/A
Roles
Related jobs
-
Platform Engineer – Data Science & AI Platform GBP 75K-90KACL | Access Management | AgentOps | Apache Spark | Azure DataEmployee discount | Employee sample sales | Fixed annual payment | Paid annual leave | Personalised learningSenior-level Full TimeLondon, England, United Kingdom14h ago
-
Senior Analytics Engineer (6 month contract) GBP 50K-70KAI tools | DBT | Data Modeling | Data Quality | Data ReliabilityCycle to work | Electric vehicle salary sacrifice schemes | Employee referral bonus | Flexible working | Office meals and snacksSenior-level ContractLondon R18h ago
-
Senior Data Engineer - Data Science Platform GBP 60K-70KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom19h ago
-
Scientific Data Engineer - Product Safety GBP 72K-75KAWS | Apache Spark | CI/CD | Data Lakehouse | Data ModelingAnnual holiday | Bank holidays | Bonus scheme | Life insurance | Pension schemeSenior-level Full TimeBracknell, BERKSHIRE, United Kingdom22h ago
-
Data Engineer - System Design Stability GBP 40K-50KConfiguration Management | Data Engineering | Data Modeling | Data Visualization | DatabricksEmployee referral scheme | Flexible working | Paid annual leave | Pension scheme | Professional fees reimbursedEntry-level Full TimeBristol, England, United Kingdom22h ago
-
Automated Data Evaluation | Data Filtering | Data Processing | Data evaluation | Deep learningSenior-level Full TimeLondon, UK1d ago
-
Trainee Developer - Azure | Databricks | SQL GBP 30K-34KAzure Data | Azure Data Factory | Azure Data Lake | Cost Optimization | Data FactoryHands-on training | Mentorship | Work on live projectsEntry-level Full TimeLeicester, Leicestershire, United Kingdom R1d ago
-
Data Science Professional GBP 43K-65KAnomaly Detection | Apache Spark | Big Data | Classification | Cloud ComputingAdditional annual leave | Broadband and mobile discounts | Carer leave | Cycle to work | Family leaveMid-level Full TimeLondon, GB, E1 8EP1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Lead Data Analytics Engineer GBP 75K-102KAWS | Artificial Intelligence | CI/CD | DBT | Data ObservabilitySenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Applied Scientist GBP 92K-130KBlack | Cloud Computing | Complex Planning | Deep learning | GitSenior-level Full TimeLondon1d ago
-
Principal Software Engineer / Principal AI Engineer GBP 100K-173KAPI Integration | AWS | Agile | Artificial Intelligence | AzureComprehensive pension plan | Employee assistance program | Employee discounts | Flexible working hours | Generous vacation entitlementSenior-level Full TimeUK - London (London Wall), United …1d ago
-
Senior Software Engineer / Senior AI Engineer GBP 92K-140KAWS | Agent memory | Agentic Workflows | Azure | CI/CDComprehensive pension plan | Employee assistance program | Employee discounts | Family care leave | Flexible working hoursSenior-level Full TimeUK - London (London Wall), United …1d ago
-
Data Analyst/Engineer GBP 46K-54KAgile | Ansible | Autosys | GenAI | JavaArts and culture discounts | Back Up Adult Care | Back-Up childcare | Charity donation matching | Critical illness coverMid-level Full TimeChester, United Kingdom1d ago
-
Automated reporting | C++ | Data Pipelines | Interest Rate | Interest rate curvesSenior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
Quantitative Engineer- Derivates GBP 70K-94KAWS | Automated testing | CI/CD | Cvxpy | EC2Healthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Performance Engineer GBP 144K-216KAutomation | Benchmarking | C++ | CUDA | Computer ArchitectureSenior-level Full TimeRemote - UK R1d ago
-
AI Engineer GBP 30K-30KAI Agents | AI Foundry | AI Search | Artificial Intelligence | Automation33 days annual leave | Charity support opportunities | Financial wellbeing provisions | Flexible benefits platform | Free mortgage servicesEntry-level Full TimeUnited Kingdom R1d ago
-
Bioinformatician GBP 39K-44KCI/CD | Fair Principles | Git | Graph Databases | Language ModelsFamily support benefits | Flexible working arrangements | Hybrid working arrangements | Paid time off | Private medical insuranceMid-level Full TimeHinxton, United Kingdom1d ago
-
Senior Staff Data Engineer GBP 100K-103KCI/CD | Cloud Data | Cloud Data Platforms | Data Cataloging | Data EngineeringHybrid work | Mentoring | Onboarding and mentoringSenior-level Full TimeLondon, UK, United Kingdom, Aberdeen City R1d ago
-
Senior Staff MLOps Engineer GBP 80K-110KCI/CD | Containerization | Distributed Training | Docker | Experiment trackingHybrid workSenior-level Full TimeLondon, UK, United Kingdom, Aberdeen City R1d ago
-
Lead ML Ops Developer GBP 70K-79KAWS CDK | AWS CloudFormation | AWS Glue | AWS IAM | AWS KMSFlexible working | Hybrid work option | Professional growth | Remote work optionSenior-level Full TimeEdinburgh, Leeds, Manchester, London1d ago
-
Actuators | Bash | Calibration | Confluence | Data acquisitionCompany shutdown days | Flexible Company Leave | Free meals | Paid time off | Pension schemeMid-level Full TimeUK, London1d ago
-
Staff Implementations Data Engineer GBP 100K-120KAWS | Azure | Cloud platform | Data Governance | Data IngestionSenior-level Full TimeLondon, England1d ago
-
Analytics | C++ | Data Visualization | Functional Programming | IRRBBDiversity and inclusion initiatives | Mindfulness programs | Personal finance offerings | Training and development | Wellness programsExecutive-level Full TimeLondon, Greater London, England, United Kingdom1d ago