Associate Principal Engineer (Big Data)
Tasks
- Build self service data platforms on cloud services
- Design build and manage realtime near realtime and batch data architectures
- Develop data platforms for threat detection incident response and reporting
- Guide automation and DevOps practices for data platform deployments
- Implement ETL and ELT pipelines for realtime and batch processing
- Implement data security and compliance methodologies
- Lead design development and delivery of cyber data platform solutions
- Manage data workflows and orchestration with Airflow
- Produce high quality code and conduct peer reviews
- Provide technical guidance and mentorship across teams
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Kafka | CI/CD | Cloud Computing | Cybersecurity | DBT | Databricks | Docker | ELT | ETL | Flink | GenAI | Kubernetes | Machine Learning | Python | SQL | Version control
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Machine Learning Engineer GBP 70K-85KAWS | Anomaly Detection | Apache Spark | Azure | Data ProcessingMid-level Full TimeGlasgow Campus, United Kingdom12h ago
-
Sr. Applied AI Engineer GBP 90K-115KAWS | Azure | GCP | Generative AI | Machine LearningHome-office equipment | Hybrid work model | Self-development budgetSenior-level Full TimeLondon Office12h ago
-
Applied AI Engineer GBP 80K-95KAPI Integration | Generative AI | Machine Learning | Python | REST APIsHome office setup | Hybrid work model | Mentorship | Self-development budgetMid-level Full TimeLondon Office12h ago
-
Mid-level Full TimeLeeds/Sheffield/Manchester, UK (Hybrid) R14h ago
-
Senior Data Engineer, Unified Platform GBP 73K-95KAirflow | Amazon S3 | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeLondon18h ago
-
Machine Learning Engineer GBP 68K-85KComputer Vision | Convolutional Neural Networks | Deep learning | Diffusion Models | Generative ModelsCycle garage and showers | Dental scheme | Free soft drinks | Hybrid working | On-site barSenior-level Full TimeUnited Kingdom, London18h ago
-
Machine Learning Engineer (Recommenders) GBP 70K-85KCI/CD | Deep learning | Distributed Computing | Docker | GPU ComputingEmployee discount | Flexible benefits allowance | Inclusive workplace | Online learning resources | Paid annual leaveMid-level Full TimeLondon, England, United Kingdom20h ago
-
APIs | Azure | CI/CD | Data Governance | Distributed SystemsBi weekly engineering gatherings | Carbon footprint offset via Ecologi | Company laptop and tools | Company social events | Enhanced family policySenior-level Full TimeMoorgate, SouthEast EC2, United Kingdom R21h ago
-
Apache Airflow | Apache Flink | Azure | CI/CD | ComplianceSenior-level Full TimeLondon, United Kingdom22h ago
-
Data Engineer Support Officer GBP 50K-50KConfluence | Database performance | Database performance tuning | ETL | ITILHybrid workingMid-level Full TimeGB-ENG-LAN-Preston23h ago
-
AWS | AWS Lambda | AWS S3 | AWS Step Functions | AgileSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Apache Airflow | Apache Spark | App Service | Azure | Azure AppMid-level Full TimeLondon, United Kingdom1d ago
-
Apache Lucene | Conversational AI | Elasticsearch | Java | Language ModelsFamily benefits | Flexible working arrangements | Generous time off | Hybrid working patterns | On-site nurseryEntry-level Full TimeHinxton, United Kingdom1d ago
-
Data Engineer GBP 50K-60KAWS | Azure | CI/CD | CloudFormation | Data LakeCharitable leave | Paid time off | Private medical insuranceMid-level Full TimeLondon, 30 Fenchurch Street, United Kingdom1d ago
-
Frontend Engineer (with GenAI experience ) GBP 35K-35KAgile | Android | Angular | CI/CD | CloudCareer Development and Counseling | Employee assistance program | Family friendly work policies | Flexible work policies | Mental wellbeing supportMid-level Full TimeManchester, 2 Circle Square, United Kingdom1d ago
-
AI Data Engineer GBP 72K-88KAI Tooling | Alerting | Automated testing | CI/CD | Cloud ComputingAccess to online courses | Flexible working arrangements | Hybrid working | Training and development opportunitiesSenior-level Full TimeLondon, GB1d ago
-
Data Engineer GBP 72K-80KAzure Databricks | Azure DevOps | Azure Synapse | CI/CD | Data ModelingAdditional holiday days option | Contributory pension | EAP access | Gym discounts | Hybrid workSenior-level Full TimeBasingstoke, England, United Kingdom1d ago
-
Staff Applied Scientist GBP 225K-325KBlack | Cloud Computing | Complex Planning | Data Analysis | Deep learningHybrid work schedule | Mentoring and coachingSenior-level Full TimeLondon2d ago
-
Experienced Quantitative Researcher - Cambridge GBP 65K-85KC++ | Data Structures | Data Structures and Algorithms | Linux | PythonInternational team outing | Medical insurance | Paid vacationSenior-level Full TimeCambridge, England, United Kingdom2d ago
-
Senior Analytics Engineer GBP 45K-55KCI/CD | DBT | Dataform | GitLab | Google BigQueryEmployee referral bonus | Hybrid work | Profit share bonus | Share incentive plan | Uncapped leaveSenior-level Full TimeBath, England, United Kingdom2d ago
-
Data Engineer – Development & Analytics (Bedford, MA) USD 107K-170KAWS | Azure | Dashboarding | Data Pipelines | Data Warehousing401k match | Education reimbursement | HSA | PTO | Stock purchase planMid-level Full TimeBedford, United States2d ago
-
Data Technology Engineer (UK) GBP 65K-88KAPI Management | Apache Airflow | CI/CD | Database Management System | DockerMid-level ContractLondon, United Kingdom of Great Britain …3d ago
-
Staff Forward Deployed Engineer, GenAI, Google Cloud GBP 90K-130KAPI Integration | Agent Development | Agent Development Kit | Agent systems | Cloud platformSenior-level Full TimeLondon, UK3d ago
-
Forward Deployed Engineer, GenAI, DACH, Google Cloud GBP 100K-120KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeLondon, UK3d ago
-
AI Safety | APIs | Agent systems | Cloud platform | CrewAISenior-level Full TimeLondon, UK3d ago