Principal Data Engineer - Accelerated Data Delivery

Eveleigh, NSW - 1 Locomotive Street

Commonwealth Bank

CommBank offers personal banking, business solutions, institutional banking, company information, and more

View all jobs at Commonwealth Bank

Apply now Apply later

  • You are a passionate data engineering professional & keen learner with deep multi-disciplinary background in end-to-end data & analytics delivery value chain activities and modern data engineering technologies/ tooling/ practices​

  • We are a values-driven high performing team​​

  • Together we can deliver an exemplary experience for our stakeholders and the Group​

Do work that matters

"Data Delivery Group Practice" is part of "Data Products & Data Delivery" domain within CDAO. We are a multi-disciplinary team of passionate end-to-end data & analytics delivery professionals that enables data delivery democratisation/ autonomy, uplift data maturity and literacy across the Group. We provide data delivery thought leadership/ guidance and create leading examples of delivering data safely and swiftly for the Group, using latest data & AI strategies, cutting edge solutions, latest technology tooling, simplified delivery patterns & new ways of working.

See yourself in our team

Reporting to Group Practice Lead Data Delivery, you will provide thought leadership and expertise across a range of data specific domains and technologies, leading the technical strategy across technology initiatives and large and complex data engineering platforms and products.​

Responsibilities

Accelerated data delivery:​

  • Understand business problems and devise data & analytics driven solutions​

  • Innovate to continuously identify opportunities to simplify, automate & improve data delivery speed​

  • Lead technically to deliver proof of concepts/ technical spikes and leading examples of accelerated data delivery using new solution patterns/ capabilities​

  • Lead/ execute end-to-end data delivery iteratively through requirements, solutioning, data profiling, data design/ modelling, development, testing, release management and operate in production​

  • Provide technical ownership and direction of data assets as required​

  • Set standards and ensure industry best practices of engineering and Data DevSecOps are followed​

  • Partner with key stakeholders at a Group level to engineer improvements to the scaling and reliability of our services​

  • Provide advisory data engineering practice at enterprise level ​

  • Provide thought leadership and mentoring on data engineering principles and practices, including holding platform-wide educational sessions.​​

Data delivery practice:​

  • Provide data delivery guidance for evolving needs from federation, strategy and transformation​

  • Create/ lead data delivery knowledge management outcomes via playbooks, learning materials & education sessions​

  • Create/ lead data maturity outcomes and data literacy initiatives​

  • Work with other group practices to collectively align towards data, analytics, AI & engineering outcomes ​

We're interested in hearing from people who have

  • Over 5 years of experience at Principal/ Staff data engineer level in large Banks/ organizations

  • Strong expertise in data intensive environments including databases, data lake houses, data warehouses and data platforms

  • Strong understanding of data delivery life cycle & associated concepts including data analysis, data profiling, data design, data modelling, data ingestion, data cleansing, data extraction, data definitions/dictionary, data lineage mapping, data classification, data quality, etc.

  • Extensive experience in Big Data solutions using Cloudera Hadoop eco-systems, Teradata platform using Spark/TCF and various ETL frameworks

  • Experience with AWS Cloud platform and Snowflake 

  • Good understanding of Data management/Data governance processes, and tools like Alation/Collibra

  • Experience in data modelling concepts/ frameworks, design patterns (FSLDM, IBM IFW DW, BIAN) and techniques such as Data Vault, Kimball, 3NF

Skills:

  • Advanced skills in writing SQL scripts (Spark SQL or any RDBMS), scripting in Java or Python

  • Advanced scripting skills in Java or Python

  • Extensive experience in building data pipelines & ETL tools like Ab Initio

  • Extensive experience in designing and developing ETL test scripts for structured and unstructured data

  • Advanced skills testing solutions with large data volumes and complex data transformation rules

If this sounds like you then apply today!

At CommBank/Bankwest, we advocate and facilitate a culture of inclusion and respect, celebrating all cultures, abilities, genders, expressions of gender and sexual orientation Read more about our commitment to inclusion and diversity.

We believe in working for a place that works for you. We have many flexible working options within our team so talk to us about which arrangements would work best for you.

If you're already part of the Commonwealth Bank Group (including Bankwest), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We’re committed to being an accessible employer and want to make finding your dream job as easy as possible. If you experience any accessibility issues or if you require additional support, please contact HR Direct on 1800 989 696.

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 23/10/2024
Apply now Apply later
  • Share this job via
  • 𝕏
  • or

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0
Category: Engineering Jobs

Tags: AWS Big Data Classification Data analysis Data governance Data management Data pipelines Data quality Engineering ETL Hadoop Java Pipelines Python RDBMS Snowflake Spark SQL Teradata Testing Unstructured data

Perks/benefits: Career development Flex hours Team events

Regions: Asia/Pacific Europe

More jobs like this