Data Engineer (Mid‑Level ), Global
Tasks
- Build Azure Data Factory pipelines
- Build data pipelines
- Create Azure Synapse SQL views and tables
- Create SQL transformations
- Create Spark transformations
- Design data pipelines
- Develop PySpark notebooks
- Maintain data pipelines
- Maintain operational runbooks
- Maintain pipeline documentation
- Monitor pipeline performance
- Optimize spark job performance
- Orchestrate batch pipelines
- Orchestrate incremental pipelines
- Perform data quality checks
- Produce curated datasets
- Run code reviews
- Troubleshoot pipeline failures
- Validate data outputs
Perks/Benefits
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Functions | Azure Synapse | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Modeling | Dimension tables | ELT | ETL | Fact tables | Git | Logic Apps | PySpark | Python | SQL
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
GenAI Platform Lead GBP 84K-120KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcare | Professional developmentSenior-level Full TimeSheffield, United Kingdom R9h ago
-
MLOps Engineer (LLM/GenAI) GBP 27K-27KAWS | Accelerate | Azure | Batching | CUDAContributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations supportEntry-level Full TimeSheffield, United Kingdom R10h ago
-
Data Engineer - Value & Analytics GBP 31K-34KAWS | Agile | Analytics | Azure | Cloud platformHybrid work environmentMid-level Full TimeUnited Kingdom R12h ago
-
Lead Software Engineer - Cloud/Java-Python/AI-ML GBP 84K-115KAWS | Apache Iceberg | Artificial Intelligence | Automated testing | AzureSenior-level Full TimeBOURNEMOUTH, DORSET, United Kingdom15h ago
-
AWS | Application development | Artificial Intelligence | Automated testing | AutomationSenior-level Full TimeLONDON, United Kingdom16h ago
-
Sr. Lead Data Engineer GBP 72K-84KAWS | Anomaly Detection | Automation | BigQuery | Change ManagementSenior-level Full TimeLONDON, LONDON, United Kingdom16h ago
-
AI Engineer - Global Strategy Consultant GBP 100K-125KAPIs | Access Control | Agent Orchestration | Anomaly Detection | AuthenticationMid-level Full TimeLondon, 20 Farringdon Road, United Kingdom1d ago
-
Biosensor Algorithm Engineer GBP 24K-24KAnomaly Detection | Classification | Embedded Systems | Git | Machine LearningMid-level Full TimeUnited Kingdom, Cambridge1d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
AWS | Apache Flink | Apache Iceberg | Apache Spark | CassandraEmployee networks | Paid adoption leave | Paid parental leave | Professional development opportunities | Remote team collaborationSenior-level Full TimeLondon (Haggerston), United Kingdom R1d ago
-
Executive-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Senior Platform Engineer GBP 65K-80KBackup and Recovery | Capacity Management | Command Shell | Database Clustering | Database PatchingOut of hours rotationSenior-level Full TimeDunstable, England (Vocalink), United Kingdom1d ago
-
Lead AI/ML Engineer GBP 90K-126KAPI Development | Agentic Systems | CI/CD | Cloud Native | Deep learningCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago
-
Machine learning Engineer GBP 84K-115KAWS | Azure | Cloud Security | Docker | Google CloudCoaching | Dental coverage | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - London1d ago
-
AMPS | AWS | AWS Athena | AWS Glue | AgileSenior-level Full TimeLONDON, United Kingdom1d ago
-
Software / Machine Learning Engineer GBP 40K-50KAWS | Computer Vision | Deep learning | Generative AI | Hugging FaceFlexible work hours | Gym discounts | Learning resources | Mental health support | MentorshipMid-level Full TimeLondon R1d ago
-
AI Engineer GBP 60K-90KAWS | Azure | CI/CD | Databricks | DockerBike to work | Career progression pathways career development programme | Educational assistance | Employee assistance programme | Employee discountMid-level Full TimeLondon, Birmingham, Manchester, Newcastle upon Tyne, …1d ago
-
AI Solution Engineer GBP 70K-95KAI Evaluation | AI Governance | AI Security | APIs | Agent FrameworksBonus package | Hybrid work | Neat benefits | Work from homeMid-level Full TimeLondon, United Kingdom1d ago
-
Research Engineer, RL Scaling Science GBP 375K-640KBenchmarking | Data Analysis | Debugging | Distributed Computing | Experiment designFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeLondon, UK1d ago
-
Contractor - Senior Data Engineer (3 months +) GBP 60K-80KAWS | AWS DMS | AWS Lambda | Amazon CloudWatch | Amazon KinesisSenior-level ContractLondon, United Kingdom1d ago
-
Batch Machine Learning | CI/CD | Causal Inference | Containerization | Data PipelinesEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalized learningSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Engineer GBP 38K-42KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultAnnual leave | Colleague mortgage | Cycle to work initiative | Discounted gym membership | Diverse and inclusive networksMid-level Full TimeSkipton - The Bailey, United Kingdom2d ago
-
MLOps Engineer GBP 76K-100KAirflow | Automated retraining | Autoscaling | BigQuery | Blue-Green DeploymentDiscounts | Enhanced parental leave | Holiday allowance | Learning and development programme | Life insuranceSenior-level Full TimeUnited Kingdom - Remote R2d ago
-
Mid-level Full TimeXC Birmingham Head Office, United Kingdom2d ago
-
AWS Step Functions | Agile | Amazon S3 | Amazon SQS | Apache AirflowLife assurance | Paid time off | Pension scheme | Training and developmentSenior-level Full TimeLondon - Central; Manchester; Cheltenham2d ago