Data Engineering - Data, Lakehouse and AI Data Platform Engineer - Analyst/Associate - London
London, Greater London, England, United Kingdom
GBP 55K-72K (estimate) Mid-level Full Time
Tasks
- Apply data modeling for entities relationships and historical change
- Create reusable tooling for delivery consistency operations
- Design build support batch data pipelines
- Design build support streaming data pipelines
- Develop raw refined curated datasets for analytics reporting and AI
- Implement testing monitoring and issue resolution standards
- Optimize SQL queries and data processing logic
- Partner with engineers platform teams and data consumers to deliver outcomes
- Reconcile data between pipelines and datasets
- Refactor data flows to improve reliability performance maintainability
- Troubleshoot data pipeline failures and data quality issues
- Validate data completeness accuracy and consistency
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Spark | Avro | CI/CD | Data Modeling | Data Quality | Data Reconciliation | Databricks | Hadoop | JSON | Java | Kafka | Kubernetes | Parquet | Python | SQL | Snowflake | Version control
Education
N/A
Related jobs
-
Data Engineer GBP 64K-80KDBT | Data Vault | Data Warehousing | Dataform | Dimensional ModelingDental insurance allowance | Flexible working arrangements | Growth promotion cycles | Gym membership allowance | Inclusion & Belonging groupsSenior-level Full TimeLondon, England, United Kingdom R5h ago
-
API | Active Batch | Analysis Services | Apache Spark | Azure Active BatchSenior-level Contract Full TimeLeicester, Leicestershire, United Kingdom9h ago
-
Lead Data Engineer GBP 45K-60KAPIs | Analytics | Ansible | Azure | Cloud platformHybrid work environment | Learning and developmentSenior-level Full TimeUK - Hook, United Kingdom17h ago
-
Staff Analytics Engineer GBP 59K-60KComponent analysis | Data Analysis | Decision Trees | Kernel Regression | MATLABRelocation assistanceSenior-level Full TimeEdinburgh, United Kingdom17h ago
-
AI/ML/Data Science Engineer GBP 50K-60KAPIs | Anomaly Detection | Cloud Platforms | Computer Vision | ContainerizationAnnual leave | Bank Holiday Leave | Dental care | Discounts | Enhanced maternity/paternity leaveMid-level Full TimeBiggin Hill, United Kingdom17h ago
-
C# | MATLAB | NumPy | Pandas | PythonNon permanent employment | Part-time hours | Project based workSenior-level Full TimeUnited Kingdom - Remote R17h ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFreelance assignments | Part-time availability | Project based workMid-level FreelanceUnited Kingdom - Remote R17h ago
-
Freelance Machine Learning Engineer USD 110KLLM | Langchain | NumPy | Pandas | Prompt engineeringEnglish C1 writing expectation | Part time project based engagementMid-level FreelanceUnited Kingdom - Remote R17h ago
-
Machine Learning Engineer III GBP 72K-85KAWS | AWS SageMaker | Agentic AI | Amazon Bedrock | Bayesian MethodsAccess to learning platform | Adoption Assistance | Flexible benefits | Health and welfare insurance | Inclusion groupsSenior-level Full TimeLondon, United Kingdom17h ago
-
Machine Learning Engineer II GBP 72K-85KAWS | AWS Bedrock | AWS SageMaker | Agentic AI | Deep learningAdoption Assistance | Flexible benefits | Health insurance | Internal job opportunities | Leadership coursesSenior-level Full TimeLondon, United Kingdom17h ago
-
Apache Superset | Cloud Computing | Data Modeling | Data Quality | Data WarehousingSupportive team environment | UK security clearance eligibilityEntry-level Full TimeBristol - Central17h ago
-
Staff Analytics Engineer GBP 59K-60KAlgorithms | Analytics | Component analysis | Data Analysis | Decision TreesRelocation assistanceSenior-level Full TimeEdinburgh, United Kingdom17h ago
-
API Development | Airflow | Backtesting | FastAPI | Financial ModelingAnnual leave | Employee assistance program | Employee discounts | Hybrid work model | Learning and development resourcesMid-level Full Time25 CANADA SQUARE CANARY WHARF, WEST …17h ago
-
AI Engineer GBP 50K-65K.NET | A/B | A/B Testing | Async Python | AzureAnnual leave | Contributory pension | Flexible benefits | Flexible working hours | Group income protectionMid-level Full TimeUnited Kingdom R1d ago
-
Software Engineer GBP 45K-65KCI/CD | Cloud platform | Docker | Git | Google CloudDental insurance | Free coffee and snacks | Gym membership | Optical cover | Paid time offMid-level Full TimeLondon, UK1d ago
-
Engineering - Data Engineer - Vice President - London GBP 121K-146KApache Iceberg | Apache Spark | Avro | CI/CD | ContainerizationExecutive-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
Automation | CI/CD | Cloud infrastructure | Data Architecture | Data GovernanceBlended working | Defined contribution pension | Employee assistance programme | Eye Tests | Flexible workingSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Cloud Computing | Dashboard Development | Data Modeling | Data Pipelines | Data ProcessingHybrid work | Private healthcareMid-level Full TimeSouthampton, United Kingdom1d ago
-
Contract Data Engineer GBP 50K-50KBoomi | Boomi Data Hub | Data Cleansing | Data Governance | Data HubFlexible working | Healthcare cash plan | Pension | Remote workMid-level Full TimeLondon, United Kingdom R1d ago
-
Business Intelligence | Dashboards | Data Integrity | Data Modeling | Data PipelinesEntry-level Full Time TemporaryLondon R1d ago
-
Senior Platform and AI Engineer GBP 80K-110KAzure OpenAI | Azure Pipelines | Branch protection | Budget Management | CI/CDFlexible working | Work-life balanceSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior AI/ML Engineer GBP 62K-80KAKS | AWS | Airflow | Azure | Azure Machine LearningAnnual holiday allowance | Colleague discount | Cycle to work scheme | Employee assistance programme | Employee discountsSenior-level Full TimeLondon, London, United Kingdom1d ago
-
AI Governance | Agile | Artificial Intelligence | Cloud | GoExecutive-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
Lead Data Engineer GBP 80K-95KAWS | Agile | Apache Spark | Azure | CI/CDAnnual leave | Cycle to work scheme | Discounted gym membership | Employee clubs and events | Employee feedback and performance reviewsSenior-level Full TimeEdinburgh1d ago
-
Algorithmic Trader GBP 60K-75KAlgorithmic trading | Blockchain | Cryptocurrency | Data Analysis | DeFiFestive celebrations | Flexible working hours | Foosball | Gaming events | PensionMid-level Full TimeLondon R1d ago