Engineer - Data Platforms
Sydney, NSW, Australia
Westpac
Westpac is Australia's first bank with a range of innovative financial packages to support your personal, business or corporate banking needs.Create your best future and join Westpac as an Engineer.
What’s the role?
The Data Platforms (DP) function comprises of a team of data professionals dedicated to building game-changing data capabilities for Westpac Group and shaping the future of banking. We understand the big picture and focus on and deliver initiatives that will significantly and positively impact the Westpac Group.
In this hands-on role, you will be a strong technical expert, responsible for building real-time and batch data solutions. You will handling multiple programs concurrently and be a go-to SME for the development of engineering solutions.
Responsibilities include:
- Enhancement, maintenance, and support of the technical deliverables including hands-on coding, ensuring the quality of team outputs, representing the team in various forums, and aligning team contributions with the overall strategic roadmap.
- Design and implement scalable, reliable, and secure solutions, and collaborating with cross-functional teams to gather requirements and ensure successful delivery.
- Collaborate with fellow Engineers across the domain to define technical direction for service offerings, and work with Service Owners and key business stakeholders to shape the delivery roadmap and coordinate with support teams to ensure smooth delivery.
What do I need?
- Solid engineering experience developing large-scale applications using Scala and Python, plus handling large datasets using PySpark in numerous production workloads.
- Proven expertise in real-time streaming jobs, time data processing and pipelines in production environments.
- Extensive experience in optimising Spark code using Directed Acyclic Graphs (DAGs) involving several strategies to enhance performance and efficiency.
- Experienced working with HDFS, pig, hive, HBase, Phoenix etc.
- Proven experience and understanding of cloud platforms, particularly within Azure, having worked with ALDS, EventHub, Stream Analytics, HDInsight, Synapse Analytics, Data Factory, Cosmos DB, Kubernetes. Similar experience with AWS/GCP is also fine.
- Strong functional programming and ability with complex data structures, with understanding and experience in data warehousing concepts.
- Expertise in DevOps functions, contributing to CI/CD pipelines, and experience in implementing MLOps pipelines in production is advantageous.
- Proficient in using source control tools, preferably Bitbucket, with a good understanding of branching and merging strategies.
This role is part in the UNITE program which will be Westpac’s biggest transformation project ever. It is a business-led, tech-enabled transformation - delivering simplification and benefits for our customers, employees and shareholders.
A major priority for the Group over the next 3 to 4 years, UNITE is about delivering ‘one best way’ to make our processes, systems and tech simpler so we can deliver a better experience for customers, make things easier for our people, and reduce risk for generations to come.
#UNITEProgram
Why join us?
We’re obsessed with becoming our customers #1 banking partner for life and we’re looking for people who are passionate about helping us achieve that goal. In return we’re committed to making Westpac the best place to work in the country. Here are just a few of the ways we’re already doing that:
- Special offers on banking products and discounts from top brands, including generous employee-only mortgage rates!
- Flexible work arrangements to help you achieve a greater work/life balance, and a variety of leave options including Culture, Lifestyle and Wellbeing leave.
- Tailored learning and development opportunities to help your grow your career within the bank.
- Lots of opportunities to ‘give back’ to the Community by getting involved in our many volunteering initiatives
Create your future today
To get started, simply click on the APPLY or APPLY NOW button
We’re all about creating a supportive and inclusive community. We welcome everyone – no matter your age, gender, background, or abilities. We also provide additional support to welcome our veterans, Indigenous Australians and neurodiverse community.
If you need any adjustments during the recruitment process, you can find out more information and additional contact details by visiting the "People with Disability and/or needing Accessibility Requirements" page on our website.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Azure Banking Bitbucket CI/CD Cosmos DB Data Warehousing DevOps Engineering GCP HBase HDFS Kubernetes MLOps Pipelines PySpark Python Scala Spark Streaming
Perks/benefits: Career development Flex hours
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.