Senior Data Engineer

Company Description

At Shift, we’re business specialists dedicated to helping Australian SMEs take control of their cashflow, streamline trade terms and choose the right financial products. 

We believe Australian businesses are the driving force behind our economy and are core to our communities. That’s why our business expertise, focus on relationships, and market-leading technology is at the core of everything we do.  

Our unique approach to product innovation combined with our collaborative culture means you can build your career in a supportive environment. You’ll be joining a diverse team of over 250 people who are always looking to deliver better outcomes for Australian businesses. 

Job Description

We're looking for a Senior Data Engineer who’s passionate about creating data solutions that power thoughtful decision-making. In this role, you’ll build and maintain modern data pipelines on Azure using tools like Databricks, Azure Data Factory, and Delta Lake, while contributing to a team that values collaboration, inclusion, and continuous improvement.

This is a great opportunity for someone who enjoys partnering with diverse teams, bringing ideas to life, and building scalable solutions that have real business impact.

What you’ll do:

• Design, develop, and maintain secure, scalable ELT data pipelines using Azure tools
• Ensure data is accurate, consistent, and ready for analysis through strong governance practices
• Collaborate closely with analysts, engineers, and business stakeholders to understand goals and deliver trusted data products
• Build data models that consolidate complex sources into actionable insights
• Identify opportunities to improve performance, reliability, and cost-efficiency across systems
• Support the development of others through knowledge sharing, mentoring, and inclusive design practices
• Contribute to architecture, documentation, and automation to help the team scale sustainably
• Use tools like Unity Catalog, Azure Functions, and DevOps pipelines to manage metadata, schema evolution, and deployment

Qualifications

What you'll have: 

• Around 5+ years of experience in data engineering or a related field
• Proficiency in Python and SQL, with a focus on clean, maintainable code
• Experience with Azure Databricks, Delta Lake, Azure SQL, and Azure Data Lake Gen2
• Familiarity with CI/CD practices and data orchestration using tools like Azure Functions and Delta Live Tables
• A collaborative mindset and strong communication skills - able to partner across technical and non-technical teams
• A passion for solving complex problems and improving data systems over time
• Commitment to continuous learning and staying current with evolving technologies
• Relevant tertiary qualifications or equivalent experience

Additional Information

Key benefits: 

• Collaborative teams – a flat structure means everyone can learn from colleagues and senior leaders around the business.  
• Be involved – come together with all of your colleagues every 100 days to share the product and technology roadmap and business strategy.  
• Flexible working environment – we’re headquartered in North Sydney with state based workplaces and offer a flexible work policy.  
• Family support – industry leading 26 weeks paid parental leave.  
• Varied workspaces – our office enables areas for collaboration, brainstorming and socialising as well as focus zones. 
• Range of benefits – supporting your physical, psychological and financial wellbeing. 

#LI-Hybrid