Senior Data Engineer (Hadoop, Spark, Hive)

Senior Data Engineer (Hadoop, Spark, Hive)

Do work that matters

We are one of Australia’s most advanced big data operations teams, doing work that matters. As an experienced ETL Engineer with proven expertise in production support and a passion for providing data-driven platform solutions, you’re ahead of trends and work at the forefront of Big Data platforms.

Here, you’ll be part of a team of engineers transitioning from existing technology stacks into cloud-based, future-ready technologies and agile, DevSecOps ways of working. Your experience means you’re able to execute state-of-the-art ITIL practices, driving high-quality outcomes to solve core business objectives and minimize risks. Communicating with technical and non-technical stakeholders across the business comes naturally to you.

As someone eager to learn and share knowledge, you’ll thrive in a culture where quality, excellence, and openness are championed. Here, you’ll experience flexibility, great rewards, and the opportunity to drive your own career growth.

See yourself in our team

To us, data is everything. It powers our cutting-edge features and enables us to provide seamless experiences for millions of customers from app to branch. We’re responsible for CommBank’s key analytics capabilities and work to create world-leading capabilities for analytics, information management, and decisioning. We work across the Group Data Warehouse, Hadoop Big Data Platform, Pega Decisioning, SAS, R, Tableau, H2O, Ab Initio, and Data Stage.

This role is ideal for an experienced Senior Engineer with a strong background in building ETL applications and commendable production support experience in deploying and managing large-scale, complex big data applications on a Hadoop platform.

Reporting to the Operations Manager for Data Operations in the Chief Data Office, you will interact with a range of internal teams and stakeholders, including Program Managers, Data Architects, Lead Software Engineers, Data Engineers, Hadoop Administrators, Systems Engineers, Squad Leads, Staff Engineers, and Change Owners.

We're interested in hearing from people who

• Have Risk Mindset –All CommBank employees are expected to proactively identify and understand, openly discuss and act on current and future risks.

• Have problem-solving abilities and a strategic approach to tackling data-related challenges.

• Have the ability to effectively communicate with business stakeholders and technical leadership groups.

Tech skills

We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but having significant experience and exposure with some of these (or equivalents) will set you up for success in this team.

• Experience in building and Supporting Data pipelines using Bigdata Hadoop

• Strong scripting knowledge in Unix, Java or Python

• Good experience with Spark and Hive

• Experience on AWS EMR, GLUE experience is desirable

• Experience with streaming frameworks such as Kafka

Working with us:

Whether you’re passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.

Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across all of our technology hubs in Sydney, Melbourne and Perth. We really love working here, and we think you will too.

We support our people with the flexibility to balance where work is done with at least half their time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work in the role you’re interested in.

If this sounds like the role for you then we would love to hear from you. Apply today!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.