Staff Data Engineer

Sydney, NSW - CBP South, 11 Harbour Street, Australia

Commonwealth Bank

CommBank offers personal banking, business solutions, institutional banking, company information, and more

View all jobs at Commonwealth Bank

Apply now Apply later

  • You are passionate about making peoples jobs simpler and more rewarding

  • We are a team of big thinkers who are engineering the future of banking

  • Together we can create industry leading product lifecycles that support capabilities, people and technology

Do work that matters

Technology is the enabling force behind information technology functions for the Group to achieve the highest levels of customer experience, security and reliability, velocity, and innovation. 

In Business Banking (BB) Technology, we provide technology solutions to Business Banking domains across Business Banking and CommSec. We are empowering businesses and people to succeed with tomorrow’s technology, our purpose is to become the leading digital business bank, powered by the next horizon of technology.

See yourself in our team

We are a highly driven DevSecOps engineers who are designing, developing and delivering business critical features on key product that is part of the payment ecosystem. Here, we foster an innovative, dynamic culture and a genuine commitment to drive diversity and inclusion. Within this role, you will work alongside a fantastic team of people, and highly invested managers focused on your career progression.

We’re interested in hearing from people who

  • Have solid hands-on experience in Cloudera Data Platform and large migration programs from on-prem to Cloud

  • Are knowledgeable of Data warehousing solutions like Amazon Redshift, Google BigQuery, or Snowflake

  • Are passionate about building next generation Data platforms and Data pipeline solution across the Bank

  • Have got proven track record of Agile delivery including leading and working on end-to-end delivery of project

  • Are confident in their understanding of Data modelling, schema design, and Data architecture principles

  • Are confident leading, directing, coaching and guiding engineers

  • Pride themselves in driving pragmatic and fit for purpose solutions with high technical quality

  • Have solid hands-on experience with building Spark-based pipelines

  • Are pro-actively looking for ways to provide feedback and contribute towards Engineering and automation uplift to the Product.

  • Are constantly thinking creatively and breaking boundaries to solve complex Data problems

  • Have solid understanding of DevOps practices and tools for CI/CD (e.g., Github, Jenkins, Docker, Kubernetes)

  • Are knowledgeable of Data governance practices, Data privacy regulations, and Security measures

Tech skills:

We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team

  • Hadoop ecosystem (HDFS, MapReduce, YARN)

  • Programming using Advanced SQL

  • Proficiency in Spark for large-scale data processing

  • AWS Cloud services experience and certification

  • Deep understanding and experience (preferred) with Kafka for real-time data streaming

  • Dealing with complex File formats and structures

  • Traditional Data warehouse concepts (Facts/Dims, normalization).

  • Event driven Data architecture

  • Apache Iceberg

  • MSK (Kafka)

  • Redshift

  • Glue ETL

  • S3

Working with us

Whether you’re passionate about customer service, driven by data, or called by creativity, a career with us is for you.

We support our people with the flexibility to balance where work is done with at least half their time connecting in our Sydney office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few.

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. We’re looking for people who truly live our values: Care, Courage and Commitment and we’ll offer you great opportunities to develop your career with us.

If this sounds like you, apply now!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 07/03/2025
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Agile Architecture AWS Banking BigQuery CI/CD CX Data governance Data warehouse Data Warehousing DevOps Docker Engineering ETL GitHub Hadoop HDFS Jenkins Kafka Kubernetes Pipelines Privacy Redshift Security Snowflake Spark SQL Streaming

Perks/benefits: Equity / stock options Flex hours

Region: Asia/Pacific
Country: Australia

More jobs like this