Tech Consultant - Data Engineer
Tasks
- Build data ingestion and integration processes
- Design ETL and ELT pipelines
- Develop data models data warehouses and data lakes
- Develop reusable data frameworks and automation
- Implement data governance and data quality practices
- Maintain technical documentation
- Optimize data pipeline performance and scalability
- Perform root cause analysis
- Support CI/CD deployment
- Troubleshoot production data issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CD | Cloud platform | Data Factory | Data Governance | Data Lakes | Data Modeling | Data Quality | Data Warehousing | Databricks | Docker | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Hadoop | Kafka | Kubernetes | Python | SQL | Snowflake | Version control
Education
N/A
Related jobs
-
Data Analysis | Data Science | Deep learning | Experiment design | Language ModelsBonus | Company benefits | Equity incentive plan | Hybrid workSenior-level Full TimeLondon, UK21h ago
-
Full Stack AI Engineer GBP 57K-78KAI coding | AI coding tools | API Development | Alembic | Application InsightsGroup insurance | Multisport card | Private medical care | Remote or hybrid work | Wellbeing platformMid-level Full TimeBelfast22h ago
-
Analytics Engineer GBP 45K-60KDBT | Data Modelling | Data Transformation | Data pipeline | DatabricksDiscounts | Financial coaching | Flexible work hours | Free sports and social clubs | GP office visitsMid-level Full TimeLondon, England, United Kingdom R23h ago
-
Senior Machine Learning Engineer GBP 80K-126KAPI serving | Agentic LLM | Automated testing | CI/CD | DockerContributory pension scheme | Enhanced maternity and adoption pay | Private healthcareSenior-level Full TimeLondon, United Kingdom R1d ago
-
Data Engineer GBP 46K-55KAWS Glue | AWS Kinesis | AWS Lambda | AWS Step Functions | Amazon AthenaAnnual leave | Discretionary bonus | Employee assistance programme | Income protection | Life assuranceMid-level Full TimeScotland, United Kingdom1d ago
-
AI Infrastructure Engineer EUR 100K-102KApache Beam | Apache Hadoop | Apache Hive | Apache Spark | C plus plusMid-level Full TimeLondon, UK; Berlin, Germany1d ago
-
API Integration | Agent systems | Cloud platform | CrewAI | Data EngineeringSenior-level Full TimeLondon, UK1d ago
-
Senior Data Engineer GBP 65K-80KAccess Control | Alerting | Data Governance | Data Lineage | Data ManagementAgile workingSenior-level Full TimeSouthampton, Whitley, United Kingdom R1d ago
-
Senior Data Engineer GBP 65K-80KAlerting | Data Governance | Data Modeling | Data Quality | Data sharesAgile workingSenior-level Full TimeSouthampton, Whitley, United Kingdom R1d ago
-
Data Engineer 12 month FTC GBP 30K-35KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure SynapseDiversity and inclusion | Flexible working | Hybrid working | Work from anywhere up to 30 days per yearEntry-level Contract TemporaryLondon, United Kingdom R1d ago
-
Data Engineer GBP 52K-75KAWS | Apache Flink | Apache Spark | Cloud platform | ElasticsearchRemote work flexibility | Team collaborationMid-level Full TimeLondon R1d ago
-
AI Solutions Architect GBP 83K-110KAPIs | Agentic AI | Data Engineering | Language Models | Large Language ModelsEmployee affinity groups | Family leave | Generous parental leave | Mental wellness programs | Non-contributory pensionSenior-level Full TimeUnited Kingdom1d ago
-
Senior-level Full TimeEdinburgh, United Kingdom1d ago
-
Artificial Intelligence Engineer GBP 75K-81KAI Pipelines | Agent platform | AlloyDB | BigQuery | CI/CDPaid relocation N/A | Remote Work N/A | Travel for customer site monthlyMid-level Full TimeUK London, United Kingdom1d ago
-
Mid-level Full TimeLN - 25 Cabot Square, United …1d ago
-
Senior-level Full TimeEdinburgh, United Kingdom1d ago
-
Senior Cloud Data Platform Engineer GBP 72K-80KAI Security | AWS | Azure | Data Architecture | Data LakeSenior-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Senior Quantum Engineer - QSER GBP 55K-66KBenchmarking | Calibration | Cryogenic Systems | Cryogenic measurement | Data AnalysisSenior-level Full TimeReading, England, United Kingdom1d ago
-
Quantum Engineer - QPU Design GBP 47K-60KBlack Box Quantization | Black-box | COMSOL | Circuit simulation | Circuit theoryMid-level Full TimeReading, England, United Kingdom1d ago
-
Data Engineer GBP 45K-50KAPIs | AWS | Adverity | Airflow | Automated Validation9-day fortnight | Professional development | Wellbeing benefitsEntry-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Machine Learning Engineer GBP 80K-126KAPI | CI/CD | Docker | FastAPI | FlaskContributory pension scheme | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcare | Professional development opportunitiesSenior-level Full TimeLondon, GB, E14 5HQ1d ago
-
Agent Frameworks | Code Quality | Deep learning | Deployment | LLM applicationMid-level Full TimeLondon - Baker, United Kingdom R1d ago
-
Staff Applied AI Engineer GBP 90K-145KAgent architecture | Artificial Intelligence | Auditability | Cost Optimization | Data IntegritySenior-level Full TimeLondon, UK1d ago
-
AI Assisted Development | Agile | Application Resiliency | Automation | CI/CDMid-level Full TimeBOURNEMOUTH, DORSET, United Kingdom1d ago
-
Data Engineer GBP 80K-105KAWS | Airflow | CI/CD | ClickHouse | DBTBirthday off | Flexible hybrid working | Global get-togethers | Internal training | Learning budgetEntry-level Full TimeLondon1d ago