Staff Data Engineer - Data Mesh

Sydney, NSW - CBP North, 1 Harbour Street, Australia

Commonwealth Bank

CommBank offers personal banking, business solutions, institutional banking, company information, and more

View all jobs at Commonwealth Bank

Apply now Apply later

  • You are passionate about modern data architectures, automation, and driving business value through data democratisation.

  • We are a team of big thinkers who are engineering the future of banking

  • Together we will build tomorrow’s bank today, using world-leading technology and innovation

Do work that matters  

We're building tomorrow’s bank today, which means we need creative and diverse engineers to help us redefine what customers expect from a bank. Envisioning new technologies that are still waiting to be invented and reimagining products that support our customers and help build a brighter future for Australia.

Here, you will be empowered to deliver world-class, competitive banking products and services with unparalleled levels of service and reliability.  

See yourself in our team

You will be joining our IB&M Data Engineering team driving the Solution Architecture with expertise in Data Mesh. Working with our stakeholders in the Data and Platform crew, you will help drive our commitments in our Data Strategy to achieve our vision of becoming the best AI Bank in the world to better serve our customers.

You will collaborate with industry leaders to drive forward our mission of revolutionising the fintech landscape. As part of our team, you will be designing and implementing cloud-native, scalable, and federated data architectures using AWS Services.

We are interested in hearing from people who

  • Pride themselves on their experience and knowledge with building data mesh architectures with AWS services.

  • Have hands-on experience designing and deploying cloud architecture on AWS

  • Are knowledgeable with the Domain Driven Design (DDD) principles applied to data architectures.

  • Are confident creating blueprints and engineering roadmaps for multi-year data transformational programs.

  • Have experience in building domain-agnostic data infrastructure and pipelines.

  • Are knowledgeable in integrating machine learning models into data pipelines for advanced analytics and predictive modelling.

  • Have familiarity with tools like Hadoop, Spark, Kafka, and other distributed processing frameworks for handling large datasets.

  • Bring hands-on experience working with Infrastructure as Code using tools such as Terraform, CloudFormation, CDK for repeatable AWS deployments.

  • Are constantly thinking outside the box and breaking boundaries to solve complex technical problems and core business objectives.

  • Are knowledgeable of financial markets and, or corporate & institutional lending products is advantageous
     

Tech Skills

We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team!

  • AWS Certified Solutions Architect – Professional

  • AWS technologies including Lake Formation, Redshift, S3, Glue and IAM

  • Data warehousing with Snowflake, Redshift and Amazon RDS for OLTP

  • Infrastructure as code using CloudFormation or Terraform

  • Deep understanding of event-driven architectures using Apache Kafka, AWS Kinesis, Firehouse or similar

  • Experience with AWS EKS/ECS and containerisation (Docker, Kubernetes) 

  • Experience with Alation, Glue Data Catalogue & AWS DataZone

  • Experience with Parquet File Format, Iceberg tables

  • Observability tools (i.e. Observe, Splunk or Prometheus/Grafana)

  • Strong knowledge of CI/CD and automation tools like GitHub, GitHub Actions, TeamCity, CI/CD pipeline

Working with us

Whether you’re passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.   

We support our people with the flexibility to balance where work is done with at least half your time each month connecting in our Sydney office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work for you.

Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too.  

If this sounds like you, apply now!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 21/02/2025
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Architecture AWS Banking CI/CD CloudFormation Data pipelines Data strategy Data Warehousing Docker ECS Engineering FinTech GitHub Grafana Hadoop Kafka Kinesis Kubernetes Lake Formation Machine Learning ML models Parquet Pipelines Redshift Snowflake Spark Splunk Terraform

Perks/benefits: Equity / stock options Flex hours

Region: Asia/Pacific
Country: Australia

More jobs like this