Sr Associate, Sr Data Engineer
New York, NY, US
Full Time Senior-level / Expert USD 95K - 162K
New York Life Insurance Co
Protect and build your future with comprehensive one-on-one guidance from New York Life. Learn about our life insurance and financial product offerings.Location Designation: Hybrid - 3 days per week
Engages in collaborative relationships across architecture, product management, data and product
delivery teams to design, implement solutions based on defined business challenges and outcomes
· Participate on scrum teams working in short sprints and ensure on time delivery with high quality
· Build and maintain Data engineering solutions on cloud platforms using AWS or Azure services.
· Design, develop, and implement scalable data transformations and ETL/ELT processes using Python,
PySpark, and or Data Integration tools IDMC, DBT
· Collaborate with Data Architects and Data analysts to understand data requirements and translate them
into scalable, high performant data integration and pipeline solutions.
· Develop and maintain data models and schemas to support data integration and analysis
· Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues
· Optimize and tune data integration pipelines for performance, reliability, and scalability
· Implement data quality and validation checks to ensure accuracy and integrity of data through testing
· Build the infrastructure required for optimal ETL/ELT of data from a wide variety of data sources using SQL
and AWS big data technologies
· Develop and debug code in PySpark/Spark/Python. Strong SQL and query optimization techniques
· Maintaining high degree of knowledge and expertise in cloud-based technologies contributing to go
forward best practices, standards and patterns
· Active participant in relevant communities of practice to exchange ideas and knowledge
Pay Transparency
Salary Range: $95,000-$162,500
Overtime eligible: Exempt
Discretionary bonus eligible: Yes
Sales bonus eligible: No
Actual base salary will be determined based on several factors but not limited to individual’s experience, skills, qualifications, and job location. Additionally, employees are eligible for an annual discretionary bonus. In addition to base salary, employees may also be eligible to participate in an incentive program.
Our Benefits
We provide a full package of benefits for employees – and have unique offerings for a modern workforce, including leave programs, adoption assistance, and student loan repayment programs. Based on feedback from our employees, we continue to refine and add benefits to our offering, so that you can flourish both inside and outside of work. Click here to discover more about our comprehensive benefit options or visit our NYL Benefits Site.
Our Diversity Promise
We believe in a diverse workforce because it is our mission to advocate for the financial security and success of people in every community. This is why diversity, equity, and inclusion (DEI) are guiding principles that are embedded in our brand and our culture. Click here to learn more about how we have been recognized for our leadership.
Recognized as one of Fortune’s World’s Most Admired Companies, New York Life is committed to improving local communities through a culture of employee giving and volunteerism, supported by the Foundation. We're proud that due to our mutuality, we operate in the best interests of our policy owners. To learn more about career opportunities at New York Life, please visit the Careers page of www.NewYorkLife.com.
Job Requisition ID: 91573
Tags: Architecture AWS Azure Big Data Data quality dbt ELT Engineering ETL Pipelines PySpark Python Scrum Security Spark SQL Testing
Perks/benefits: Career development Equity / stock options Salary bonus
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.