Lead Data Engineer

⭐️⭐️ NEWLY CREATED ROLE !! ⭐️⭐️

Who are we?

So you might ask, who's CreditorWatch? Well, we are a leading Australian data and technology company that provides businesses with access to unique data and innovative products. By using our platform, our customers can confidently manage their commercial relationships, improve productivity and reduce financial risk.

As a commercial credit reporting bureau, we offer a complete suite of credit reporting products and data insights covering the entire customer lifecycle, from customer onboarding and credit decision automation to credit risk management and automated collections.

We were established in 2010 and most recently were named as one of AFR's Top 10 Best Places to Work as well as certified by Great Place to Work consecutively across 2022 and 2023.

We saw significant growth in 2024 and that's not about to change. We are on track to break records in 2025, scaling at pace, making this the perfect time to join CreditorWatch.

Our Purpose

✅ Empower Australian businesses to trade confidently with their customers.

Our Mission

🏆 We aim to be number one in our industry by delivering unique data insights and innovative products.

Your Role & Team

We are excited to launch a newly created role as a Lead Data Engineer.

In this role, you will lead a cross-functional team that designs and implements data-centric architectures within our applications.

Your focus will be to establish best practices for our data engineering function whilst being the technical manager of our Commercial Data as a business asset.

You'll provide people leadership, technical direction and architectural guidance while maintaining hands-on involvement in critical technical decisions and implementations.

Please note, our data engineering team are building customer facing products using data native technologies - this isn't an internal analytics focused function.

This role reports directly to the Head of Data and is a full-time opportunity offering hybrid working conditions based out of our Sydney CBD office.

Responsibilities

What your team is collectively responsible for delivering:

• Design and implement data pipelines and models to support customer-facing applications and rapid product iteration.
• Deliver data to product applications via API, files and tables with a focus on performance and scalability.
• Source and ingest data from internal and external applications via database transfer, API, and other mechanisms.
• Implement data technology, governance, and stewardship of our Commercial Data.
• Build and maintain ML architectures and technology for Data Scientists that support both batch and real-time inference.
• Drive technical excellence and innovation within the data domain.

What you as the Lead will be responsible for:

• Provide technical leadership to ensure the team delivers on its purpose and impact.
• Develop and grow the individuals within the team and their careers.
• Architect and oversee software and data architectures that align with product needs and technology strategy.
• Establish data modelling standards and best practices for consistency and quality.
• Set direction for data processing frameworks, ETL processes, and data pipelines.
• Collaborate with software engineering leads on API strategies and cross-functional initiatives.
• Define data security, governance, and compliance frameworks.
• Drive database performance optimisation and caching strategies.
• Foster a culture of technical excellence, innovation, and continuous learning.
• Lead the team in agile development processes.
• Communicate complex data concepts to technical and non-technical stakeholders.
• Evaluate emerging technologies and develop implementation roadmaps.

Our ideal candidate

Technical:

• Data modelling, schema design, and data storage technologies
• Data warehousing, data lakes, and data integration patterns
• Data processing frameworks, both batch and real time
• SQL and Python for data manipulation and transformation
• RESTful principles and API design concepts
• Data security best practices and access control mechanisms
• Data governance principles, including data quality, data lineage, and data privacy regulations
• Database performance optimisation techniques
• Agile development methodologies
• Continuous integration and deployment practices

People & Team:

• Ability to identify resourcing requirements and build teams to fulfil outcomes
• Team workflows and rituals
• Team development journey
• Feedback practices and strategies
• Ability to lead and mentor team members

Skills:

• Strong problem-solving and analytical skills
• Proficiency in data processing languages (e.g., SQL, Python)
• Expertise in at least one software language (e.g. Python)
• Expertise in designing and implementing data architectures
• Ability to develop efficient data processing frameworks and pipelines for batch and real time requirements
• Familiarity with API integration and data service delivery
• Knowledge of database performance optimisation and data caching
• Experience with data security and governance practices
• Excellent communication and collaboration skills
• Proficiency in version control systems (e.g., Git)

More than just work

🏃🏽‍♀️ Keep Active – All employees get a Fitness First Platinum gym membership.

☕️ Daily Fuel – Barista-made coffee, breakfast, snacks, lunches and drinks on us – we got you!

📲 Phone Credits - We pay you $50 per month to put towards your plans - how good.

❤️‍🩹 Wellness Days – Receive an additional day off each month. Whether you’re pursuing physical activities, cultivating your mental wellbeing or supporting your community… this is your time to switch off from work.

💆🏽‍♂️ Monthly Massages – We offer monthly in-house massages to soothe those sore spots and tight knots. Poor posture? Stressful week? We get it.

💰 Bonus Shares – We offer our dedicated employees’ performance-based bonuses. Our employees are also permitted to gain access to our bespoke Employee Share Scheme, giving you the rare opportunity to invest in a growing technology company.

🤩 Fun Activities – We love escaping the workplace to do fun stuff. Whether its pasta-making, sailing classes, touch footy, winery tours, go karting or relaxing on the company boat (yeah… we own a boat) – these monthly team building activities will keep you feeling valued and connected.

👩🏻‍⚖️ Legal Services – Our employees get access to free legal services – from conveyancing and property advice to legal assistance around wills, trusts, powers of attorney and more. We make life easier for you, saving you time, money and unnecessary headaches.

Our Values

⚡️ The 1%’ers add up – Our commitment to going that one step further sets us apart, as we believe that small efforts or improvements in any aspect of our work collectively lead to significant success.

👊🏼 We are dependable and trustworthy – Our clients are everything to us and we are passionate about maintaining and delivering reliable and trusted services to them.

📈 We are committed to growth – Our success comes from our ability to grow and adapt; both collectively and individually. We set the bar high to ensure we continue to innovate and exceed expectations. We are dedicated to the development of our business and our people.

🫶🏾 Our people make the difference – Just as we help small businesses think big, we help our employees achieve their aspirations. We provide our people with challenges and opportunities, supporting them to live their best lives.

Recruitment Process – We like to keep it simple!

1. Phone Screening – A deep dive into the company, role and experience required, including a thorough review of your match to the role – let’s get to know each other and ensure the opportunity is a match!
2. Short Coding assessment - To understand your technical ability and will be used in the next Technical stage.
3. Technical Interview  – to understand if there is a technical fit from both sides.
4. Values Meeting – We’d love to hear why CreditorWatch and see how you’d fit into our world.

We are committed to you

We offer a fantastic culture with open communication and rewards and recognition that include probation celebrations, all-staff birthday and service anniversary celebrations.

We are an equal opportunity employer and committed to excellence through diversity. We do not discriminate on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

We are a 2024 Circle Back Initiative Employer – we commit to respond to every applicant.