Data Engineer
Surry Hills, Australia
Endeavour Group
Company Description
Let’s create a more sociable future together
At Endeavour, we’re totally into what we do. With a portfolio that includes Dan Murphy’s, BWS, ALH Hotels, Pinnacle Drinks and more, we love to bring people together. Together we share our passion for our products and industry; it’s what inspires us to dream big, and continue to create new experiences for our customers and teams across Australia. If you thrive on positive energy, we want to meet you!
Job Description
- Be uniquely you, come as you are
- Bring your passion and feel the energy
- Hybrid / Flexible working
The Data Engineer - D & AI is a key member of the Group Data Practices team within the D & AI function. This role has line management into the Data Engineering Chapter Lead but receives daily tasks from their delivery squad.
Endeavour operates an Agile, matrixed environment, with Practices/Chapters providing people management and capabilities, whilst Product squads deliver business missions. Chapter members are embedded in cross-functional delivery squads, bringing their specific skill to that squad.
Your primary role is to design, build and deploy technology solutions, as a hands-on technology expert with specialist skills building data products. Depending on the needs of the business, this could be a data service/application and/or product, ml model implementation, Data lake/warehouse data pipelines (cloud gcp, cloud azure, sql server), etl/elt, data retention and governance tools implementation, master data management tech implementation, visualisation tools and analytics tools implementations.
Sitting within cross-functional delivery squads, this role works closely with Business Analysts, Developers, Integration Engineers, Solution Architects, Data Architect, Machine Learning Engineers, Data Scientists, Data Analysts and domain SMEs to deliver on Tribe missions.
Sound good? Read on.
Here is a taster of what you can expect in this role:
Work with team members and business SMEs to understand the requirements including business problem or opportunity, data requirements, and technology requirements
Contribute to documentation of requirements and user stories in Jira/Confluence, as required
Build and deploy back-end software services, data applications/services and/or APIs
Build and deploy data pipelines on the data platform
Productionise ML models
Document relevant information required for knowledge sharing across the team and for operational support handover
Knowledge sharing amongst the data engineering chapter and project/squad team members
Collaborate with team and stakeholders to ensure successful delivery
Adhere to technology standards, data governance & privacy policies and security standards
Adhere to corporate governance policies
Attend/contribute to squad agile ceremonies (e.g. standups, sprint planning etc)
Attend/contribute to project meetings and deliverables
Build and deploy using devops and infrastructure as code
Provide input into handover to the support team for new builds/enhancements
3rd level support for incidents relating to appropriate productionised data products/services
Comply with the change process and provide inputs, as required, and attend CAB, where required
Qualifications
Now let’s talk about you:
Software development skills and experience
Back-end development skills, such as APIs
Experience with distributed programming (e.g. Apache Spark)
Cloud data pipeline build, deploy and maintain/support skills
Python and PySpark skills
SQL skills
An in-depth understanding of common databases and data structures.
Experience working with big data cloud platforms (Azure, Google Cloud Platform, AWS)
Experience working in agile environment
DevOps experience
CI/CD experience
Infrastructure as code experience
Experience with Java and/or C#
Experience with Object-Oriented programming (OOP)
Experience with Unit Testing, test driven development (TDD)
Desired:
Google Cloud Platform experience
Azure Databricks experience
Experience with secure coding practices
Experience working with retail offline (e.g. store sales) and online data sets (e.g. ecommerce)
Experience working with Personally Identifiable Information (PII) data
Experience working with unstructured data
Data science knowledge and/or experience productioning ML models
Retail industry experience
The benefits are good too!
- We offer flexible working in every sense
- An exclusive discount card for BWS, Dan Murphy’s, Woolworths, BIG W and other Endeavour Group brands, including our ALH pubs
- Monthly meeting-free days
- Your health and wellbeing is your most important asset, and as one of our valued team members, it’s our first priority. You will have a range of free services to help you live well and support your physical, mental and financial wellbeing
- Endeavour Group is full of opportunities - use our dedicated learning and development options to grow an idea, yourself, and your career. This is just the start, so dream big.
At Endeavour, we value being a workplace where everyone’s welcome - if you meet a number of the requirements (and not all), we encourage you to apply.
Additional Information
We are together creators
With a portfolio that includes Dan Murphy’s, BWS, ALH Hotels, Pinnacle Drinks and more, Endeavour Group is big on sociability. Together we create the moments that bring millions of people together. And together we have more fun, create more opportunities, and score a lot more goals. We’re serious about creating a safe, inclusive and fun place to rock up to where equal opportunity is key, and flexibility is part of how we roll.
We’re all about creating a more sociable future - for our customers and each other. If this job excites you - and you’re close-enough on the requirements, reach out, we’d love to hear from you.
You can learn more about working with us on LinkedIn or at endeavourgroupcareers.com.au.
Our Talent Team and Hiring Leaders kindly request no unsolicited resumes or approaches from Recruitment Agencies. Endeavour Group is not responsible for any fees related to unsolicited resumes.
#WeAreTogetherCreators #ComeAsYouAre #DreamBig #FeelTheEnergy #LeaveYourMark #EndeavourGroup
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs AWS Azure Big Data CI/CD Confluence Databricks Data governance Data management Data pipelines DevOps E-commerce ELT Engineering ETL GCP Google Cloud Java Jira Machine Learning ML models OOP Pipelines Privacy PySpark Python Security Spark SQL TDD Testing Unstructured data
Perks/benefits: Career development Equity / stock options Flex hours Health care Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.