Senior Data Engineer - PySpark
Sydney, NSW, Australia
Westpac
Westpac is Australia's first bank with a range of innovative financial packages to support your personal, business or corporate banking needs.Create your best future and join Westpac as a Senior Data Engineer - PySparkĀ
Whatās the role?
An exciting opportunity is available for a highly motivated Senior Data Engineer to join within WIB Technology, Financial Markets in Sydney. The business is committed to advancing its' position within the FX and Fixed Income space through investment in technology and recruitment of high-calibre individuals to positively influence outcomes. A key part of that strategy is the development of Data Engineering capabilities and analytics capabilities to support regulatory compliance and other necessary tools to support these operations.
Join a dynamic data engineering team that works closely with Business Analysts to deliver cutting-edge data solutions that support Westpacās Financial Markets objectives while meeting Risk, Regulatory, and Compliance requirements. In this role, youāll collaborate with the business and fellow engineers to design and implement solutions using big data technologies, particularly within a Spark environment.
What do I need?
- Expert level core Python development skills including hands-on coding with production-grade systems
- Strong understanding of PySpark/ Spark technologies, distributed computing concepts and Spark performance tuning
- Strong understanding of cloud big data implementations/tools such as AWS EMR, Databricks, Palantir Foundry, or equivalent
- Well versed in Data Structures, complexity theory and CS fundamentals
- Strong analytical and communication skills - capable of translating business requirements into performant data solutions
- Familiarity with modern CI/CD practices, modular code structuring, and automated testing for pipelines
- Experience in financial domain development as a data engineer
- Highly motivated, and suitably equipped to work directly with sales/traders/quants
Why join us?
Weāre obsessed with becoming our customers' #1 banking partner for life and weāre looking for people who are passionate about helping us achieve that goal. In return, weāre committed to making Westpac the best place to work in the country. Here are just a few of the ways weāre already doing that:
- Special offers on banking products and discounts from top brands, including generous employee-only mortgage rates!
- Flexible work arrangements to help you achieve a greater work/life balance, and a variety of leave options including Culture, Lifestyle and Wellbeing leave.Ā
- Tailored learning and development opportunities to help your grow your career within the bank.Ā
- Lots of opportunities to āgive backā to the Community by getting involved in our many volunteering initiatives.
Create your future today
To get started, simply click on the APPLY or APPLY NOW button
Weāre all about creating a supportive and inclusive community. We welcome everyone ā no matter your age, gender, background, or abilities. We also provide additional support to welcome our veterans, Indigenous Australians and neurodiverse community.
If you need any adjustments during the recruitment process, you can find out more information and additional contact details by visiting theĀ "People with Disability and/or needing Accessibility Requirements"Ā page on ourĀ website.
Ā
* Salary range is an estimate based on our AI, ML, Data Science Salary Index š°
Tags: AWS Banking Big Data CI/CD Databricks Engineering Pipelines PySpark Python Spark Testing
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.