Data Architect
Tasks
- Architect and document data streaming and real time data pipeline solutions
- Build and represent solution designs to architecture review boards
- Define solution patterns for Spring Kafka consumers and data ingestion into HBase
- Design Kafka based streaming applications with topic design consumer patterns and error handling
- Design solutions across Cloudera data lakes operational data stores and event streaming platforms
- Engage stakeholders across enterprise architecture governance and engineering leadership
- Ensure solutions are deliverable scalable secure supportable and aligned to enterprise architecture principles
- Identify technical risks dependencies assumptions non functional requirements and design trade offs
- Own end to end solution architecture for large scale distributed data streaming and data integration
- Provide architecture leadership across data ingestion streaming integration transformation storage and APIs
- Review engineering technical designs for alignment with approved architecture
- Support delivery planning by breaking solutions into iterative delivery increments
Perks/Benefits
Skills/Tech-stack
AWS Kinesis | AWS MSK | Amazon EventBridge | Apache Airflow | Apache Cassandra | Apache Flink | Apache Kafka | Apache NiFi | Apache Spark | Change Data Capture | Data Capture | Event Driven | Event-driven architecture | HBase | Hive | Impala | Java | Kafka Streams | NoSQL | PySpark | Python | REST APIs | Spring Boot | Spring Kafka
Education
N/A
Related jobs
-
AWS | Apache Spark | Cloud platform | Data Engineering | Data WarehousingSenior-level Full TimeLondon, United Kingdom1d ago
-
APIs | Agent systems | Cloud platform | CrewAI | EvaluationAccess to advanced AI models | Customer-facing work | White glove deploymentMid-level Full TimeLondon, UK3d ago
-
AI Architect, Partner Engineering GBP 100K-120KAgent systems | AlloyDB AI | BigQuery | BigQuery Zero Copy | C++Senior-level Full TimeLondon, UK; Zürich, Switzerland3d ago
-
API Design | Agent Orchestration | Agent systems | Autogen | CI/CD25 days holiday | Company pension scheme | Cycle to work scheme | Employee assistance programme | Holiday buy/sell optionSenior-level Full TimeUK Wide (London, Edinburgh, Manchester, Leeds, …4d ago
-
Senior-level Full TimeSouthampton, UK R5d ago
-
Practicing Data Architect GBP 72K-89KAWS | Apache Airflow | Apache Cassandra | Apache Flink | Apache HBaseAccess to online learning courses | Career progression opportunities | Hybrid working | Mental health champions | Training and development opportunitiesSenior-level Full TimeLondon, GB5d ago
-
AI Solution Architect GBP 80K-109KAPIs | AWS | Agentic AI | Agile | Architecture ReviewsAviva Digital GP | Dental insurance | Discounts on Sky products | Free Sky TV or NOW Package | Hybrid working 2 days in office per weekSenior-level Full TimeLivingston Watermark, United Kingdom5d ago
-
AWS | Apache Spark | Artificial Intelligence | Azure | Big DataSenior-level Full TimeLondon, United Kingdom6d ago
-
Director, Generative AI Experience Engineering GBP 61K-80KAI Observability | AWS | Agent systems | Anthropic Claude | AzureCollaboration with global teams | Hybrid work | In-office days requiredExecutive-level Full TimeLondon7d ago
-
Senior-level Full TimeLondon, United Kingdom7d ago
-
Data Architect GBP 60K-80KAzure Data | Azure Data Factory | Data Factory | Data Modeling | Data WarehousingAnnual leave | Bank holidays | Buy and sell holidays | Cycle to work scheme | Electric vehicle leasingSenior-level Full TimeLondon, United Kingdom7d ago
-
AWS Cloud Partner Solutions Architect — EMEA GBP 75K-100KAWS | AWS Marketplace | Amazon Bedrock | Amazon Glue | Apache SparkSenior-level Full TimeLondon, United Kingdom8d ago
-
AWS | Apache Spark | Cloud platform | Data Engineering | Data WarehousingSenior-level Full TimeLondon, United Kingdom8d ago
-
Consulting Systems Engineer, Data Management (EMEA) GBP 75K-101KAWS | Ansible | Apache Kafka | Azure | Cloud hybridCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeRemote, United Kingdom R10d ago
-
Senior Solutions Architect (Retail/CPG) GBP 74K-100KAWS | Apache Spark | Architecture | Artificial Intelligence | AzureCommuting to London office | Travel opportunitiesSenior-level Full TimeLondon, United Kingdom12d ago
-
IT Data Infrastructure Architect - VP GBP 80K-109KAWS | Alation | Amazon Redshift | Ansible | Apache NiFiFlexible working arrangementsSenior-level Full TimeWaterloo Street, United Kingdom12d ago
-
Applied AI Architect, Industries GBP 190K-230KAPI Integration | Cloud Architecture | Data Science | Enterprise Integration | EvaluationSenior-level Full TimeLondon, UK13d ago
-
AI Solutions Architect GBP 58K-108KAgent Orchestration | Chunking | Embeddings | FastAPI | Generative AIAnnual discretionary bonus | Career development | Group life insurance | Gym discounts | Hybrid Car SchemeSenior-level Full TimeLondon, United Kingdom15d ago
-
AI Solutions Architect GBP 58K-108KAPI Development | Agent Orchestration | Agentic Workflows | Async architecture | ChunkingAnnual discretionary bonus | Auto enrolment pension scheme | Career development and internal mobility | Electric and Hybrid Car Scheme | Group life insuranceSenior-level Full TimeLondon, United Kingdom15d ago
-
Data Architect GBP 75K-90KArtificial Intelligence | Azure | Business Intelligence | Data Architecture | Data CleansingBike to work | Career progression mentorship | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeLondon, Birmingham, Manchester, Newcastle upon Tyne, …15d ago
-
Data Architect GBP 86K-102K3NF | ACORD | AI readiness | Azure Data | Azure Data FactoryFlexible workingSenior-level Full TimeGB London, United Kingdom15d ago
-
Principal Enterprise Data Architect GBP 74K-81KAKS | Airflow | Analytics Platforms | Architecture standards | AzureSenior-level Full TimeLondon Bankside, United Kingdom15d ago
-
Airbyte | BigQuery | C++ | CI/CD | Cloud BigtableContinuous training and development | Private healthcare insurance | Team-building activities | Work from home flexibility | Workplace pensionSenior-level Full TimeLondon, England, United Kingdom18d ago
-
Mid/Senior Solution Architect GBP 80K-110KAmazon Web Services | Azure Machine Learning | CI/CD | Cloud platform | DockerDiscounted lunch | Educational budget | Flexible working hours | Hybrid work | Language classesSenior-level Full TimeLondon, United Kingdom18d ago
-
Principal Data and AI Architect GBP 80K-103KAgentic AI | Amazon Web Services | Cloud platform | Data Governance | Data LakesSenior-level Full TimeUnited Kingdom - London18d ago