Data Engineer (Mid‑Level ), Global
Tasks
- Build Azure Data Factory pipelines
- Build data pipelines
- Create Azure Synapse SQL views and tables
- Create SQL transformations
- Create Spark transformations
- Design data pipelines
- Develop PySpark notebooks
- Maintain data pipelines
- Maintain operational runbooks
- Maintain pipeline documentation
- Monitor pipeline performance
- Optimize spark job performance
- Orchestrate batch pipelines
- Orchestrate incremental pipelines
- Perform data quality checks
- Produce curated datasets
- Run code reviews
- Troubleshoot pipeline failures
- Validate data outputs
Perks/Benefits
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Functions | Azure Synapse | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Modeling | Dimension tables | ELT | ETL | Fact tables | Git | Logic Apps | PySpark | Python | SQL
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
Software Engineer, Machine Learning GBP 100K-130KData Structures | Data structures algorithms | Graph theory | Information Retrieval | Language ProcessingSenior-level Full TimeLondon, UK2h ago
-
Software Engineer, Infrastructure GBP 180K-225KAI | Agent Orchestration | Bias Mitigation | C# | C++Senior-level Full TimeZurich, Switzerland | Tel Aviv, Israel …2h ago
-
Senior-level Full TimeLondon, UK2h ago
-
Senior-level Full TimeLondon, UK2h ago
-
Data Filtering | Data Processing | Data debugging | Deep learning | Distributed ComputingSenior-level Full TimeLondon, UK3h ago
-
Data Engineer GBP 723KAWS | AWS CDK | Amazon Redshift | Amazon Web Services | BitbucketBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Health cash planMid-level Full TimeManchester / Hybrid, England, United Kingdom R6h ago
-
Senior Staff Engineer (LLM) GBP 80K-109KAgent systems | Anthropic API | Authentication | Chunking | EmbeddingsSenior-level Full TimeRemote, United Kingdom R8h ago
-
Staff Analytics Engineer GBP 50K-70KAI tools | DBT | Data Modeling | Data Quality | Data TransformationEmployee referral programme | Flexible working | Health coverage | Hybrid/remote options | Office meals and snacksSenior-level Full TimeLondon R21h ago
-
Analytics and Automation Manager GBP 61K-74KArtificial Intelligence | Automation | Controls Testing | Data Governance | Data analyticsAnnual leave | Healthcare | Hybrid work | PensionMid-level Full TimeNottingham, England, United Kingdom21h ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R22h ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami22h ago
-
Director, Analytics GBP 46K-50KCloud platform | Descriptive Statistics | Experiment design | Google Cloud | Google Cloud PlatformDental insurance | Employee mental health days | Medical insurance | Paid time off | Preferential partner discountsExecutive-level Full TimeLondon, United Kingdom23h ago
-
Director, Analytics (Measurement/T&L Program) GBP 46K-50KBrand studies | Cloud platform | Descriptive Statistics | Experiment design | Google AdsDental insurance | Employee mental health days | Medical insurance | Paid time off | Partner discountsExecutive-level Full TimeLondon, United Kingdom23h ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Principal AI Engineer GBP 90K-115KAgentic Workflows | CI/CD | Cloud Computing | Experimentation | GuardrailsConference and training access | Flexible working hours | Global retreats | IT equipment budget | Learning budgetSenior-level Full TimeUnited Kingdom1d ago
-
Analytics Engineer USD 100KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data LineageEnglish as office language | In person work 3 days per week | Relocation supportMid-level Full TimeBarcelona R1d ago
-
Software Engineer, GenAI Platform GBP 29K-35KAPIs | Batch inference | Cost Optimization | Data Pipelines | DebuggingMid-level Full TimeLondon - The River Building HQ1d ago
-
APIs | AWS | Batch inference | Cost Optimization | DPOMid-level Full TimeLondon - The River Building HQ1d ago
-
C++ | Functional Programming | IRRBB | Interest Rate | Interest Rate RiskMid-level Full TimeLondon, Greater London, England, United Kingdom1d ago
-
Principal Data Engineer GBP 52K-55KAnalytics Integration | Automation | Business Intelligence | Data Compliance | Data EngineeringAnnual leave | Career development | Contributory pension scheme | Cycle to work scheme | Employee assistance programmeSenior-level Full TimeUnited Kingdom1d ago
-
Associate Director – Advisory Analytics GBP 78K-95KAccounting standards | Artificial Intelligence | Customer Relationship Management | Customer relationship | Data AnalysisMid-level Full TimeCity, London1d ago
-
Lead Data Engineer GBP 52K-60KAzure Data | Azure Data Factory | Azure DevOps | Data Engineering | Data FactoryCycle to work scheme | Employee assistance programme | Flexible hours | Health and wellbeing support | Hybrid workSenior-level Full TimeUnited Kingdom1d ago
-
Senior Product Analytics Manager - Scalable Growth GBP 75K-115KA/B | A/B Testing | Apache Airflow | B testing | DBTSenior-level Full TimeLondon, United Kingdom1d ago
-
Lead AI Engineer GBP 72K-109KAI Pipelines | Agent systems | Autogen | Automl | BigQueryDeath-in-service benefit | Employee assistance programme | Free parking | Healthcare | Hybrid workingSenior-level Full TimeCrawley, England, United Kingdom1d ago
-
Data Platform Engineer GBP 75K-90KApache Airflow | Apache Iceberg | BigQuery | Cloud Composer | Cloud platformCareer development opportunities | Distributed team | International environment | Remote-first work | Welcoming supportive teamSenior-level Full TimeUnited Kingdom - Remote R1d ago