Senior Data Engineer

WM, a Fortune 250 company, is the leading provider of comprehensive waste and environmental services in North America. We are strongly committed to a foundation of operating excellence, professionalism and financial strength. WM serves nearly 25 million customers in residential, commercial, industrial and municipal markets throughout North America through a network of collection operations, transfer stations, landfills, recycling facilities and waste-based energy production projects.

I. Job Summary
This position is responsible for developing Python modules using Numpy, Pandas, and dynamic programming in AWS and Snowflake. They will expand and optimize our ETL and data pipeline architecture and data flow across our Business Portfolio. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our data product owners, developers, data architects, data analysts, and data scientists on BI and Analytic initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

The candidate will also assist in issue resolution, job orchestration, automation, and continuous improvement of our data integration processes.

II. Essential Duties and Responsibilities
To perform this job successfully, an individual must be able to perform each duty satisfactorily. Other ancillary duties may be assigned.  

• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Cloud Integration ETL Tools, Cloud Data Warehouse, SQL, and AWS.
• Design and develop ELT, ETL, event-driven data integration architecture solutions.
• Work with Data Analysts, Data Architects, BI Architects, Data Scientists, and Data Product Owners to establish an understanding of source data and determine data transformation/integration requirements.
• Troubleshoot and tune complex SQL queries.
• Utilize On-Prem and Cloud-based ETL platforms, Cloud Data Warehouse, AWS, GitHub, various scripting languages, SQL, querying tools, data quality tools, and metadata management tools.
• Develop data validation processes to ensure data quality.
• Demonstrated ability to work individually and as part of a team in a collaborative manner.
• Mentors and fosters growth of peers and team members.
• May work on-call shifts on a rotation basis.

III. Supervisory Responsibilities
May coach and mentor less-experienced analysts and act as team leader on systems projects. 

IV. Qualifications
The requirements listed below are representative of the qualifications necessary to perform the job.  
  
A. Education and Experience

• Education: Bachelor’s Degree in Computer Science, MIS, or similar area of study
• Experience: Five (5) years of previous experience (in addition to education requirement).

B. Certificates, Licenses, Registrations or Other Requirements

• None required.

C. Other Knowledge, Skills or Abilities Required

Advanced knowledge or skills in one or more of the following is required:

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), and familiarity with a variety of databases.
• Experience working with Cloud Data Warehouses like Snowflake, Google BigQuery, Amazon Redshift.
• Experience with Cloud Integration Tools like Matillion, Dell Boomi, Informatica Cloud, Talend, AWS Glue.
• Experience with AWS cloud services: EC2, S3, Lambda, SQS, SNS, etc.
• Experience with GitHub and its integration with ETL tools for version control.
• Familiarity with modern data management tools and platforms including Spark, Hadoop/Hive, NoSQL, APIs, Streaming, and other analytic data platforms.
• Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc., is a plus.
• Experience with Agile/Scrum methodologies is valuable.
• Ability to lead a group to consensus, solve problems, and accomplish tasks.
• Ability to mentor and train less knowledgeable peers and individuals.
• Excellent interpersonal and communication skills (both written and verbal).
• Ability to multitask, meet deadlines, and work in a fast-paced environment.
• Ability to adapt to change.
• General business knowledge and concepts.
• Ability to multitask, meet deadlines, and work in a fast-paced environment.
• Demonstrate flexibility and a willingness to undertake a wide variety of challenging tasks.
• Extraordinary attention to detail and accuracy.

D. Other Knowledge, Skills or Abilities that Contribute to Success

May require advanced skills in one or more of the following:

• Web application development, imaging technology.
• Ability to multitask, meet deadlines, and work in a fast-paced environment.
• Demonstrate flexibility and a willingness to undertake a wide variety of challenging tasks.

V. Work Environment
Listed below are key points regarding environmental demands and work environment of the job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of the job.

• Required to use motor coordination with finger dexterity (such as keyboarding, machine operation, etc.) most of the work day;
• Required to exert physical effort in handling objects less than 30 pounds rarely;
• Required to be exposed to physical occupational risks (such as cuts, burns, exposure to toxic chemicals, etc.) rarely;
• Required to be exposed to physical environment which involves dirt, odors, noise, weather extremes or similar elements rarely;
• Normal setting for this job is an office setting.

Benefits
At WM, each eligible employee receives a competitive total compensation package including Medical, Dental, Vision, Life Insurance and Short Term Disability. As well as a Stock Purchase Plan, Company match on 401K, and more! Our employees also receive Paid Vacation, Holidays, and Personal Days. Please note that benefits may vary by site.

If this sounds like the opportunity that you have been looking for, please click Apply.

ABOUT WM WM (WM.com) is North America’s largest comprehensive waste management environmental solutions provider. Previously known as Waste Management and based in Houston, Texas, WM is driven by commitments to put people first and achieve success with integrity. The company, through its subsidiaries, provides collection, recycling and disposal services to millions of residential, commercial, industrial and municipal customers throughout the U.S. and Canada. With innovative infrastructure and capabilities in recycling, organics and renewable energy, WM provides environmental solutions to and collaborates with its customers in helping them achieve their sustainability goals. WM has the largest disposal network and collection fleet in North America, is the largest recycler of post-consumer materials and is the leader in beneficial reuse of landfill gas, with a growing network of renewable natural gas plants and the most gas-to-electricity plants in North America. WM’s fleet includes nearly 11,000 natural gas trucks – the largest heavy-duty natural gas truck fleet of its kind in North America – where more than half are fueled by renewable natural gas. To learn more about WM and the company’s sustainability progress and solutions, visit Sustainability.WM.com.

Equal Employment Opportunity

For United States: WM is an equal opportunity employer.  All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity, national origin, age, disability, status as a protected veteran or any other characteristic protected under applicable federal, state, or local law.

For Canada: WM is committed to the principle of equal employment for all applicants and employees, without discrimination on the basis of all grounds protected by applicable human rights legislation. Accommodations are available on request for candidates taking part in all aspects of the selection process. Please notify us if you require accommodation.

Real ID

In order to travel by air or access federal property, federal law requires individuals have a REAL ID or an acceptable alternative.  This position may require the successful candidate to travel by air for business reasons, or service federal property.  Accordingly, successful candidates must have, or be willing to obtain, a REAL ID, or TSA approved alternative.