Principal Data Engineer

Principal Data Engineer (Flink / Big Data)

• You are passionate, driven, flexible and collaborative.

• We are a high performing engineering uplifting engineering standards & instrumentations across the groupteam.

• Together we can rewrite the experience for millions of customers.

Do work that matters
 

The Customer Data Management crew plays an integral part in being the custodian of the customer data, and therefore the overall success of CommBank.  We are responsible for delivering improvement and maintaining high standards of security to keep the data safe and secure.

To ensure the Group achieves sustainable competitive advantage through data & analytics, you will need to play a key role in supporting Customer Master Data Management Platform executing to the Group’s data strategy.

See yourself in our team

Our team plays an importing role working across the group to help align all web and mobile engineering. Supporting platforms like NetBank, the CommBank App, CommBiz and CommSec.
As a Principal Data Engineer (Flink / Big Data) you will be responsible to fulfil the function of a Data Engineering SME/Champion. You will be required to build strong working relationships with key business and stakeholders to improve outcomes, drive & uplift engineering standards & instrumentations across the group, identify engineering improvement opportunities to improve risk, compliance, vulnerabilities, and general health outcomes of the data solutions delivered.
 

You will adopt tools and frameworks in place across the enterprise of the bank across data and analytics systems to underpin delivery to the assigned domain

We’re interested in hearing from people who:

• Understand the core business objectives and build end-to-end data centric engineering solutions to address them.

• Have solid hands-on experience in design, architecture or development in Events, Data Pipelines, Analytics and Data Warehousing.

• Lead or participate in the definition, execution, and communication of ETL strategy and detailed design & technical solution

• Pride themselves in development of data staging, architecture, and consuming internal and external application interfaces

• Cooperate with business and operational users, other data management staff and infrastructure teams to ensure adherence to client and company guidelines, restrictions, and requirements as well as industry standards.

• Participate in the full lifecycle of agile projects (ideation through implementation) and DevSecOps

• Designs technical solutions and consumption patterns for business requirements with increasing complexity.

• Can build capabilities that supports “Always On” principal and “zero downtimes”

Tech Skills

• Experience across Apache Flink, Beam, AWS Glue, BI/Big Data/DW/ETL technologies such as Iceberg, Parquet and AVRO and AWS-native data services like EMR, Redshift, etc

• Big data platform experience for ETL development

• Java and Python programming

• Cloud infrastructure experience preferably with Amazon Web Services

• Experience with NoSQL databases. SQL performance tuning, and data modelling

• ETL Tools: GDE, ADC, Express-IT, Control center, Meta programming, Co>Relate is a plus

• Knowledge on event-driven technology like Kafka (must), AWS SQS, SNS, Kinesis

• Knowledge in developing test automation for ETL / ELT, CI/CD pipelines with GitHub Actions

• At least one AWS associate level+ certification desirable

Working with us:

Whether you’re passionate about customer service, driven by software engineering, or called by creativity, a career with CommBank is for you.

We support our people with the flexibility to balance where work is done with at least half your time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work for you.

Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across all of Australia, you’ll be empowered to do your best work and be given the choice on when and where that work happens. We really love working here, and we think you will too.

If this sounds like you, apply now!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.