Data Engineer III – Databricks & Python
GLASGOW, LANARKSHIRE, United Kingdom
GBP 70K-86K (estimate) Senior-level Full Time
Tasks
- Analyze data anomalies
- Design data pipelines
- Develop PySpark jobs
- Implement data quality checks
- Maintain Databricks solutions
- Optimize query performance
- Participate in SDLC
- Process and transform large datasets
- Set up monitoring and alerting
- Support production and reliability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Lambda | AWS S3 | AWS Step Functions | Agile | Amazon ECS | Amazon SNS | Amazon SQS | Apache Airflow | Apache Spark | Avro | CSV | Databricks | Delta Lake | JSON | Jenkins | Parquet | PySpark | Python | SQL | SonarQube | Spinnaker | Step Functions
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Mathematics
Roles
Related jobs
-
Senior-level Full TimeLeicester, Leicestershire, United Kingdom6h ago
-
Data Warehouse Developer, GCP GBP 68K-80KAI Agents | Analytics hub | BigLake | BigQuery | Cloud ComposerHybrid work from homeEntry-level Full TimeManchester, England, United Kingdom9h ago
-
Machine Learning Engineer GBP 50K-65KAzure ML | Azure ML pipelines | CatBoost | Data Analysis | Data CleansingMid-level Full TimeUK025 - Erskine,United Kingdom(UK025)19h ago
-
Senior Data Quality Engineer GBP 72K-80KAirflow | Apache Beam | Apache Kafka | BDD | BehaveFlexible working | Hybrid working | Job share | Parental leave | Pension contributionSenior-level Full TimeBristol Harbourside, United Kingdom19h ago
-
AWS | Apache Spark | Autogen | CrewAI | DatabricksCycle to work scheme | Discount vouchers | Gym membership | Private healthcareEntry-level Apprenticeship Full TimeUK113 - Newcastle UK (UK113), United …19h ago
-
Amazon Web Services | Autogen | CrewAI | Databricks | ETLCycle to work scheme | Discount vouchers | Gym membership | Mentoring | Private healthcareEntry-level Apprenticeship Full TimeUK113 - Newcastle UK (UK113), United …19h ago
-
Analytics Engineer GBP 50K-75KAzure | CI/CD | Cloud Data | Cloud Data Warehouse | DBTEnhanced parental leave | Flexible benefits budget | Hybrid working | Income protection | Life insuranceEntry-level Full TimeLondon1d ago
-
Data Engineer GBP 60K-60KAzure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Continuous DeliveryAnnual leave | Buy additional leave | Discounts and cashback | Health care cash plan | Life assuranceMid-level Full TimeUnited Kingdom, United Kingdom, United Kingdom1d ago
-
Machine Learning Engineer (Recommenders) GBP 65K-80KBatch Processing | CI/CD | Containerization | Deep learning | Distributed ComputingEmployee communities | Employee discount | Flexible benefits allowance | Online learning resources | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom1d ago
-
GCP Data Engineer GBP 100K-125KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud StorageHybrid workingExecutive-level Full TimeEdinburgh, Scotland, United Kingdom1d ago
-
BI Analyst GBP 65K-85KAnomaly Detection | Azure AI | Data Modeling | Data Warehousing | ELTEmployee stock purchase options | Health insurance | Learning programs | Paid time off | Product DiscountsMid-level Full TimeLeeds, United Kingdom1d ago
-
Senior Embedded Linux Software Engineer GBP 45K-60KBuildroot | C plus plus | C# | CI/CD | Cross-compilationDisability income protection | Employee assistance program | Life insurance | Pension plan | Private healthcareSenior-level Full TimeFarnborough, Hampshire, United Kingdom1d ago
-
Embedded Linux Software Team Lead GBP 46K-70KC plus plus | C# | CI/CD | GDB | GitDisability income protection | Employee assistance program | Life insurance | Pension plan | Private healthcareSenior-level Full TimeFarnborough, Hampshire, United Kingdom1d ago
-
Lead Software Engineer-Python & Databricks GBP 90K-123KAWS | Agile | Application Resiliency | CI/CD | Continuous DeliverySenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Senior-level Full TimeAbingdon, United Kingdom1d ago
-
Deep Learning Engineer for Game Technology GBP 67K-107K3D Geometry | 3D Mesh | Computer Architecture | Computer Vision | Data pipelineCycle garage | Dental scheme | Free soft drinks | On-site bar | On-site gymSenior-level Full TimeUnited Kingdom, London1d ago
-
Senior Machine Learning Engineer GBP 55K-55KAWS | Azure Machine Learning | Clustering | Databricks | Decision TreesHybrid workingSenior-level Full TimeManchester, Greater Manchester, United Kingdom1d ago
-
Data Analyst (FTC) GBP 55K-65KA/B | A/B Testing | B testing | BigQuery | CTEsBike to work scheme | Birthday off | Book allowance | Company sick pay | Dental adviceEntry-level Full TimeLondon, United Kingdom1d ago
-
Software Specialist (TL) - AI/ML - Monetisation GBP 35K-40KAds | Auction theory | Behavior Modeling | Bidding | BudgetingSenior-level Full TimeRemote, UK | London, UK R1d ago
-
Staff Software Engineer, ML Performance and Accelerators GBP 225K-325KBenchmarking | C++ | Co-design | Compiler | Compute SystemsSenior-level Full TimeLondon, UK1d ago
-
Director, AI & Automation – Shared Services GBP 130K-150KAWS | AWS Bedrock | Access Management | Airflow | Anthropic ClaudeExecutive-level Full TimeEngland, SE1 9RA, GB1d ago
-
Lead Growth Analyst - Marketing Analytics GBP 85K-110KAI Agents | DBT | Data Modeling | Data Quality | Data WarehousingSenior-level Full TimeLondon, United Kingdom1d ago
-
DevOps Engineer GBP 72K-90KAPIM | ARM | AWS | Application Gateway | Application Load BalancerAnnual leave | Birthday leave | Charity match funding | Company funded private medical cover | EAP assistanceMid-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer GBP 70K-80KAWS IAM | AWS Redshift | Access Control | Amazon Bedrock | Amazon SageMakerSenior-level Full TimeUK-Remote, UK, United Kingdom R1d ago
-
Freelance Machine Learning Engineer USD 110KComputational Algorithms | NumPy | Numerical Methods | Pandas | PythonFreelance engagement | Part-time schedule | Portfolio growth | Remote workMid-level FreelanceUnited Kingdom - Remote R1d ago