Data Engineer

Overview

The Data Engineer is responsible for responsible for building and optimizing our data platform. This position will partner closely with our analytics, data science, and campaign teams, to ensure that we are able to leverage data and analytics to support, protect and engage AAA Members.

Responsibilities

• Fully own critical portions of AAA Life’s data platform. Collaborate with stakeholders to understand needs, build data products that meet the need using best practices, and develop data pipelines to ensure the timely delivery of high quality data.
• Continually deliver new data sources and capabilities to develop an increasingly powerful data platform that enables new customer experience, analytical capabilities and improves decision making.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Innovate, explore new technologies, make your own tools and find new ways to address old problems.

Qualifications

• Bachelor's degree in computer science, engineering, mathematics, or a related technical discipline. Masters Preferred.
• 4+ years of industry experience in software development, data engineering, business intelligence, data science, or related field
• 5+ years of experience as a Data Engineer.
• Advanced working SQL knowledge.
• 2+ years of experience using Python.
• Demonstrated strength in data modeling, ETL development, and data warehousing
• Experience using big data technologies (Hadoop, Hive, Hbase, Spark, EMR, etc.)
• Experience with other ETL tech (Informatica, SSIS, etc) is preferred.
• Experience delivering end-to-end projects independently.
• Experience using business intelligence reporting tools (Tableau, Power BI, Cognos, etc.).
• Knowledge of data management fundamentals and data storage principles.
• Experience with stream-processing systems (Storm, Spark-Streaming, etc).
• Knowledge of distributed systems as it pertains to data storage and computing.
• Experience with AWS cloud services or (EC2, EMR, RDS, Redshift Google/Azure equivalents).
• Experience using AWS big data technologies to build/operate highly available, distributed systems for data extraction, ingestion, and processing of large data sets.
• Experience with open source data tools such as Airflow, Hadoop, Spark, or DBT.
• Proven success in communicating with end-users, technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy.
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, version control, build processes, testing, and observability.
• AWS Professional or Specialty Certification

Benefits:

• Pension and Retirement Plans
• Medical, Dental and Vision Coverage
• Paid Time Off
• Paid Parental Leave
• Hybrid Work Environment
• 401K
• Support for Community Involvement