Data Engineer, Specialist (Self-Directed)
Malvern, PA, United States
We are hiring a senior AWS Data Engineer to help Vanguard's Chief Data and Analytics Office (CDAO) Personal Investor (PI) team build out data products to support multiple initiatives with Self-Directed business. This initiative will help advance Vanguard’s self managed investment strategies.
As a part of Data Engineering (DE), you will build solutions utilizing Glue ETL, Spark framework, Athena, S3, Lambda, SageMaker and other AWS services. Most of our coding is done in Python but Bash, Unix and other scripting expertise is also preferred. Along with development, DE Engineers help model and master data within data lake house and Personal Investor data lake. DE is also a critical partner to analytics and AI / ML teams, helping enable their insights.
As a senior data engineer, you will mentor engineers within the team. DE leads invest heavily in the growth of their engineers because they know as a team, we can accomplish more than just as individuals. DE evolves rapidly and we need leads that are ready to embrace the opportunity and challenge of those changes.
You may ask: What do I need to become a lead in DE? We are looking for:
Track record of great leadership and teamwork
Advanced to expert Python skills (or a comparable language)
Advanced to expert knowledge of Spark framework
Advanced to expert SQL abilities
Solid AWS service and feature awareness
History of growing your knowledge quickly and deeply
You may also ask: What am I going to learn as a lead in DE? You will:
Sharpen your leadership abilities
Grow your expertise in Python, Spark, and SQL
Advance your understanding of AWS Glue ETL, Athena, S3, IAM, RedShift, Lambda, SageMaker and other services
Build out significant skills in data modeling and warehousing
Help create a platform that serves critical business needs
Learn what it is like to work on a fast-paced, dynamic, and tight-knit team
Core Responsibilities
- Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing.
- Troubleshoots software and processes for data consistency and integrity. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions.
- Translates business specifications into design specifications and code. Responsible for writing complex programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
- Partners with internal clients to gain an expert understanding of business functions and informational needs. Works closely with other technical and data analytics experts across the business to implement data solutions.
- Leads all phases of solution development. Explains technical considerations at related meetings, including those with internal clients and less experienced team members.
- Assesses data quality and tests code thoroughly for accuracy of intended purpose. Provides data analysis guidance and serves as a technical consultant for the client.
- Educates and develops junior data engineers on the team while applying quality control to their work. Develops data engineering standards and contributes expertise to other data expert teams across Vanguard.
- Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.
- Participates in special projects and performs other duties as assigned.
Qualifications
Minimum of eight years data analytics, programming, database administration, or data management experience.
Undergraduate degree or equivalent combination of training and experience. Graduate degree preferred.
Python, SQL, AWS Data Product knowledge
Special Factors
Sponsorship
Vanguard is not offering visa sponsorship for this position.About Vanguard
At Vanguard, we don't just have a mission—we're on a mission.
To work for the long-term financial wellbeing of our clients. To lead through product and services that transform our clients' lives. To learn and develop our skills as individuals and as a team. From Malvern to Melbourne, our mission drives us forward and inspires us to be our best.
Our commitment to diversity, equity, and inclusion
Vanguard’s commitment to diversity, equity, and inclusion (DEI) is central to our ability to deliver on our mission. We aspire to create a work environment that is inclusive, equitable, and diverse—one that enables our employees, whom we call crew, to thrive and bring their best selves to work every day on behalf of our clients.
Cultivating DEI lifts our entire organization, and everyone shares accountability for our progress—from our senior leaders who lay the foundation and set the example for inclusive behaviors to crew who are growing in their personal DEI learning experiences.
Together, we’re on a mission. We are fueled by the value of diverse voices and connected through friendships and a culture of care—for our clients, our communities, and each other.
Vanguard’s DEI journey has no finish line. Our commitment is enduring, and we remain focused on the path ahead. To learn more about Vanguard goals and progress toward DEI, download our Diversity, Equity, and Inclusion Report.
How We Work
Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Athena AWS AWS Glue Data analysis Data Analytics Data management Data quality Engineering ETL Lambda Machine Learning Python Redshift SageMaker Spark SQL Testing
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.