Lead Data Engineer (Hybrid)
AF-WI Madison Natl HQ, United States
American Family Insurance
You will report to a Senior Manager, Engineering.
Position Compensation Range:
$128,000.00 - $216,000.00Pay Rate Type:
SalaryCompensation may vary based on the job level and your geographic work location. Relocation support is offered for eligible candidates.
Job DescriptionResponsibilities:
- Work with the Security Operations Center (SOC) to ensure data pipelines meet the needs of security analysts and incident responders.
- Develop data feeds for SIEM systems and other security tools.
- Lead an engineering team to meet project deadlines and priorities.
- Ensure the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.
- Document critical workflows and operational support aspects of team's responsibilities
- Develop understanding of data sources, granularity, availability, and limitations.
- Provide proactive technical oversight and advice to application architecture and development teams promoting re-use, design for scale, stability, and operational efficiency of data/analytical solutions.
- Create maintainable, scalable code to load and manipulate data in the data warehouse.
- Facilitate communication upward and across project teams and partners.
Requirements:
- Demonstrated experience providing customer-oriented solutions or support.
- In-depth knowledge of SQL or NoSQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores).
- Hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions.
- Employ design patterns and generalize code to address common use cases.
- Author high quality, reusable code and contributing to the division's inventory of libraries.
- Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions.
- Applied knowledge of cloud computing (AWS, GCP, Azure).
- Knowledge of open source machine learning toolkits, such as sklearn, Spark ML, or H2O.
- Solid data understanding in the data rich industries like insurance or financial
- Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas).
- Experience with database internals, such as indexes, binary logging, and transactions.
- Experience using tools for infrastructure-as-code (e.g. Docker, CloudFormation, Terraform).
- Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
- Practical experience authoring and consuming web services.
In this hybrid role, you will work at least 10 days per month from the office. You should reside within approximately 35-50 miles of one of the following office locations: Madison, WI 53783 or Boston, MA 02110.
#LI-Hybrid
Your offer will be made contingent on the results of applicable background checks and signing a non-disclosure agreement for proprietary information, trade secrets, and inventions.
We encourage you to apply even if you do not meet all of the requirements listed above. Skills can be used in many different ways, and your life and professional experience may be relevant beyond what a list of requirements will capture. We encourage those who are passionate about what we do to apply!
We provide benefits that support your physical, emotional, and financial wellbeing. You will have access to comprehensive medical, dental, vision and wellbeing benefits that enable you to take care of your health. We also offer a competitive 401(k) contribution, a pension plan, an annual incentive, 9 paid holidays and a paid time off program (23 days accrued annually for full-time employees). In addition, our student loan repayment program and paid-family leave are available to support our employees and their families. Interns and contingent workers are not eligible for American Family Insurance Group benefits.
We are an equal opportunity employer. It is our policy to comply with all applicable federal, state and local laws pertaining to non-discrimination, non-harassment and equal opportunity. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.
#LI-DB1Tags: Architecture AWS Azure Big Data CI/CD CloudFormation Data pipelines Data warehouse Docker Engineering ETL GCP Git Hadoop Jenkins Machine Learning NoSQL Open Source Pipelines Privacy Python RDBMS Scikit-learn Security Spark SQL Terraform
Perks/benefits: Career development Competitive pay Health care Medical leave Relocation support
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.