Sr AWS Big Data Engineer

As an AWS Big Data Engineer, you will provide advanced IT technical services, including the evaluation, selection, configuration, implementation, development, and integration of new or existing Big Data AWS technologies and tools. You will also build data knowledge to support our business partners.

In this role, you will:

• Troubleshoot and optimize new and existing ETL pipelines.
• Analyze complex business problems, gather necessary information, document requirements, and develop technical solutions.
• Provide advanced IT technical services and direction for software, middleware, or hardware projects on a single platform.
• Ensure the viability of IT deliverables, recommend development options, and conduct testing.
• Identify potential solutions and may approve those proposed by team members. Resolve complex issues uncovered by testing and internal clients.
• Maintain current knowledge of IT development methodology, architecture design, and technical standards. Mentor less experienced IT staff and identify training needs.
• Review and approve documentation and diagrams created by other crew members. Write documentation, including technical standards and processes.
• Identify opportunities for continuous quality improvement of technical standards, methodologies, and technologies.
• Participate in design, code, and test inspections throughout the product lifecycle to contribute technical expertise and identify issues. Present technical status and issues at milestone reviews.
• Comply with Information Technology and Information Security policies and procedures, ensuring deliverables meet requirements.
• Participate in special projects and perform other duties as assigned.

Required skills:

• 6+ years of Data Engineering experience.
• Strong experience with Python development, especially in data engineering.
• Experience or enthusiasm to learn AWS services such as RedShift, Aurora, EMR, Glue, CloudFormation, CloudWatch, IAM, S3, and Tableau.
• Experience with CI/CD pipeline tools like Bamboo, Bitbucket, GitHub.
• Experience building Spark data processing applications (Python, PySpark).
• Experience with test automation and test-driven development practices.
• Experience with SQL development.

​

​

​

Special Factors

Sponsorship

Vanguard is not offering visa sponsorship for this position.

About Vanguard

At Vanguard, we don't just have a mission—we're on a mission.

To work for the long-term financial wellbeing of our clients. To lead through product and services that transform our clients' lives. To learn and develop our skills as individuals and as a team. From Malvern to Melbourne, our mission drives us forward and inspires us to be our best.

Our commitment to diversity, equity, and inclusion

Vanguard’s commitment to diversity, equity, and inclusion (DEI) is central to our ability to deliver on our mission. We aspire to create a work environment that is inclusive, equitable, and diverse—one that enables our employees, whom we call crew, to thrive and bring their best selves to work every day on behalf of our clients.

Cultivating DEI lifts our entire organization, and everyone shares accountability for our progress—from our senior leaders who lay the foundation and set the example for inclusive behaviors to crew who are growing in their personal DEI learning experiences.

Together, we’re on a mission. We are fueled by the value of diverse voices and connected through friendships and a culture of care—for our clients, our communities, and each other.    

Vanguard’s DEI journey has no finish line. Our commitment is enduring, and we remain focused on the path ahead. To learn more about Vanguard goals and progress toward DEI, download our Diversity, Equity, and Inclusion Report.

How We Work

Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.