Staff Data Engineer
Sydney, NSW - CBP South, 11 Harbour Street, Australia
Commonwealth Bank
CommBank offers personal banking, business solutions, institutional banking, company information, and moreYou are passionate about making peoples jobs simpler and more rewarding
We are a team of big thinkers who are engineering the future of banking
Together we can create industry leading product lifecycles that support capabilities, people and technology
Do work that matters
Technology is the enabling force behind information technology functions for the Group to achieve the highest levels of customer experience, security and reliability, velocity, and innovation.
In Business Banking (BB) Technology, we provide technology solutions to Business Banking domains across Business Banking and CommSec. We are empowering businesses and people to succeed with tomorrow’s technology, our purpose is to become the leading digital business bank, powered by the next horizon of technology.
See yourself in our team
We are a highly driven DevSecOps engineers who are designing, developing and delivering business critical features on key product that is part of the payment ecosystem. Here, we foster an innovative, dynamic culture and a genuine commitment to drive diversity and inclusion. Within this role, you will work alongside a fantastic team of people, and highly invested managers focused on your career progression.
We’re interested in hearing from people who
Have solid hands-on experience in Cloudera Data Platform and large migration programs from on-prem to Cloud
Are knowledgeable of Data warehousing solutions like Amazon Redshift, Google BigQuery, or Snowflake
Are passionate about building next generation Data platforms and Data pipeline solution across the Bank
Have got proven track record of Agile delivery including leading and working on end-to-end delivery of project
Are confident in their understanding of Data modelling, schema design, and Data architecture principles
Are confident leading, directing, coaching and guiding engineers
Pride themselves in driving pragmatic and fit for purpose solutions with high technical quality
Have solid hands-on experience with building Spark-based pipelines
Are pro-actively looking for ways to provide feedback and contribute towards Engineering and automation uplift to the Product.
Are constantly thinking creatively and breaking boundaries to solve complex Data problems
Have solid understanding of DevOps practices and tools for CI/CD (e.g., Github, Jenkins, Docker, Kubernetes)
Are knowledgeable of Data governance practices, Data privacy regulations, and Security measures
Tech skills:
We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team
Hadoop ecosystem (HDFS, MapReduce, YARN)
Programming using Advanced SQL
Proficiency in Spark for large-scale data processing
AWS Cloud services experience and certification
Deep understanding and experience (preferred) with Kafka for real-time data streaming
Dealing with complex File formats and structures
Traditional Data warehouse concepts (Facts/Dims, normalization).
Event driven Data architecture
Apache Iceberg
MSK (Kafka)
Redshift
Glue ETL
S3
Working with us
Whether you’re passionate about customer service, driven by data, or called by creativity, a career with us is for you.
We support our people with the flexibility to balance where work is done with at least half their time connecting in our Sydney office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few.
Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. We’re looking for people who truly live our values: Care, Courage and Commitment and we’ll offer you great opportunities to develop your career with us.
If this sounds like you, apply now!
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 07/03/2025* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture AWS Banking BigQuery CI/CD CX Data governance Data warehouse Data Warehousing DevOps Docker Engineering ETL GitHub Hadoop HDFS Jenkins Kafka Kubernetes Pipelines Privacy Redshift Security Snowflake Spark SQL Streaming
Perks/benefits: Equity / stock options Flex hours
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.