Lead Data Engineer
Sydney
MyPass Global
MyPass Global is award-winning workforce management software. Join 100's of organisations to reduce costs & simplify compliance, resourcing & recruitment.MyPass Global is a multi-award-winning workforce compliance software company. Our cutting-edge technology helps companies in high-stakes industries reduce risk, save up to 70% on back-office costs, and create safer work environments through our digital workforce solutions.
With our industry-first digital Skills Passport, workers can seamlessly manage their training and competency information. In essence, we are building a global worker credentialing platform designed to create safer, more connected, and agile workplaces. As we rapidly expand with offices worldwide, we are seeking the next generation of innovative MyPassers to join us in shaping the future of our industry.
The role:
- The key purpose of this role is to lead a data engineering squad focused on designing, developing, and optimising robust, scalable data solutions and pipelines. This role requires expertise in cloud data platforms, dimensional data modeling, and advanced SQL skills, as well as the ability to bridge the gap between data engineering and software engineering principles. The Lead Data Engineer will collaborate closely with cross-functional teams to understand data requirements and implement efficient and reliable data solutions, including potentially providing APIs for data access and integration.
Day to day:
- Lead and manage the members of a data engineering squad.
- Provide strong technical leadership and coaching to your squad and the department.
- Work in an agile data engineering environment to deliver high-quality data solutions.
- Design, develop, and maintain data pipelines and infrastructure.
- Write clean, efficient, and well-documented code and SQL queries.
- Collaborate with cross-functional teams to gather requirements and implement data solutions, including potentially designing and developing APIs.
- Conduct peer reviews and ensure code quality and adherence to best practices.
- Participate in the full data development lifecycle, from planning and design to deployment, operation, and maintenance.
- Contribute technically to ensure design feasibility, approach, usability, architecture, code quality, testability, scalability, and performance.
- Suggest appropriate technologies, techniques, and standards to help deliver our goals.
- Participate in agile ceremonies to help provide visibility and accountability towards the delivery of projects you're working on.
- Support and develop other data engineers by providing advice, coaching, mentoring, and educational opportunities (brown bags, anyone?).
- Work to help ensure homogeneous code contributions from everyone on your team.
- Work with a geographically distributed data engineering team.
- Assist with driving the adoption of good practices across the department.
- Update job knowledge by studying state-of-the-art development tools, programming techniques, and technologies; participating in educational opportunities; maintaining personal networks; and participating in professional organisations.
Our ideal MyPasser:
- At least 7 years of experience in Data Engineering and 1 year of experience leading teams.
- Advanced SQL skills.
- Experience in Dimensional Data Modelling.
- Familiarity with Python or other programming languages in data engineering context.
- Optimising / Performance tuning SQL code.
- Building and optimising data pipelines.
- Solid understanding of CI/CD workflows for data teams.
- Experience with API design and development (RESTful APIs).Strong understanding of data warehousing and data lake concepts.
- Ability to apply software engineering principles to data engineering tasks.
- Tech Stack:
- Experience with modern cloud data platform e.g. Snowflake/Databricks/AWS Redshift/BiqQuery/Azure Synapse/Azure SQLExposure to Cloud providers AWS/Azure/GCP
- Nice to have:
- Experience using DBTExperience working on Snowflake or RedShiftExposure to AWSExposure to TerraformExposure to graph databases, cypher / openCypherExposure to docker/container services
Life at MyPass:
- Flexible Hybrid - Ability to mix your working week between the MyPass office and your home office
- Paw Friendly - Pet-friendly office in the CBD
- Celebrate You - Gift cards on your work anniversaries
- Be Healthy - Wellbeing policy with a strong focus on whatever makes you feel good from the inside out, free subscription to the WithU app and complimentary office yoga & pilates sessions
- Fuel Your Growth Journey - Unlocking your potential with a blend of in-person and online learning and development opportunities
- Be Comfortable - Casual Friday every day!
- We Love to Have Fun - Team outings, weekly lunches, team events, the list goes on…
- Generous Employee Referral Program - Rewards for referring top talent
We’re big on culture. So much so that the team we've carefully curated are not only high-performers, they're also excellent humans. We foster an environment that is open, respectful and collaborative, where the status quo is challenged and both success and failure are celebrated.
MyPass champions diversity at all levels of the company, and we live by our core values that set us apart. We cultivate an inclusive culture and do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We are dedicated to creating a workplace where everyone feels valued, respected, and empowered to bring their authentic selves to work. Our mantra is to make things happen, every single day.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Architecture AWS Azure CI/CD Databricks Data pipelines Data Warehousing Docker Engineering GCP Pipelines Python Redshift Snowflake SQL
Perks/benefits: Career development Flex hours Home office stipend Lunch / meals Pet friendly Startup environment Team events Yoga
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.