Principal Data Engineer

Principal Data Engineer

• You are passionate to stay ahead of the latest AWS Cloud, and Data Lake technologies

• We're one of the largest and most advanced Data Engineering teams in the country

• Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers

Do work that matters:

As a Principal Data engineer with expertise in data engineering, software development / programming and a passion for building data-driven solutions, you’re ahead of trends and work at the forefront of AWS Cloud and Data warehouse technologies.

Which is why we’re the perfect fit for you. Here, you’ll be part of a team of engineers going above and beyond to improve the standard of digital banking. Using the latest tech to solve our customers’ most complex data-centric problems.

See yourself in team:

You will be joining our CTO Data Engineering team. We are seeking passionate, cloud savvy, data engineers across diverse levels to help drive our commitments in our Data Strategy and achieve our vision for Commbank.data, a unified, world-class data platform enabling the next generation of AI (Artificial Intelligence) enabled applications.  

You will collaborate with industry leaders to drive forward our mission of revolutionising the fintech landscape. As part of our team, you will be empowered to deliver world-class, competitive banking products and services with unparalleled levels of service and reliability.   

We support our people with the flexibility to balance where work is done with at least half your time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work for you.  

We are interested in hearing from people who: 

• Have built or worked on building out data warehouses or data lakes.

• Are proficient in languages such as Python and SQL.

• In-depth knowledge of DBT. 

• In-depth knowledge of AWS services, especially related to data storage and processing such as S3, RDS, Redshift and Glue. 

• Knowledge of data architectures such as data vault 2.0.

• Are familiar with the full software development lifecycle with a focus on data ingestion process, data transformation pipelines, data integration and visualisation. 

• Understand data profiling, basics of numerical statistics and data quality calculations. 

• Has experience in handling large-scale data processing and analytics. 

• Can provide code quality control through peer programming, code review and automated pipeline release management. 

• Can coach junior engineers, share knowledge to uplift and improve software development practices. 

Technical skills 

This is a senior technical role, requiring a broad range of tools, languages, and frameworks. You will be a good match if you have previous experience in: 

• Building data warehouses or data lakes. 

• Proficient in SQL and DBT.

• Experience with AWS services such as Glue, Lambda, SageMaker, or EMR. 

• Infrastructure as code using CloudFormation or Terraform (desirable) 

• CI/CD tools (i.e. GitHub Actions). 

• Familiarity with streaming technologies such as Apache Kafka, AWS Kinesis, or similar. 

• Familiarity with visualisation tools such as PowerBI, Tableau or QuickSight.

Working with us:

Whether you’re passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you. Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.