Principal Data Engineer

Job Description:

Position Description:

Develops innovative data solutions utilizing modern data and analytic engineering practices. Works directly with Corporate Technology Group (“CTG”) Product Owners and Architects to enhance the features of A&F Analytics and Reports solution and to migrates the A&F Analytics & Reporting Platform to a cloud infrastructure. Drives automation and performance optimization of existing applications and re-engineers some critical applications that need to be integrated with Data Lake Solution framework. Sources data from the existing legacy feed system to the Snowflake Data Lake through secure channels. Optimizes the existing foundation and consumption layer using Snowflake best standard and practices to process vast amounts of data with improved performance and advanced features. Plans, designs, configures, and installs the AWS Cloud-Computing platform and ensures that all corresponding components on Fidelity’s on-premises servers are migrated to AWS Cloud Infrastructure.

Primary Responsibilities:

• Develops ingestion and transformation frameworks to establish data pipelines that can collect logs and enable metadata for the consumption layer.
• Provides solutions to performance issues with analytics and reporting platforms that support Fidelity’s products.
• Coordinates and executes tasks to achieve the milestone plan and participates in the organizational Agile transformation model to meet the day-to-day requirements.
• Prepares transition documents, conducts knowledge transfer sessions to end-users on daily operations of delivered solutions, and provides support for CTG users on the new systems.
• Works with business partners, stakeholders, and various Architecture teams to plan, design, and develop the enhanced A&F services.
• Attends brainstorming sessions and Scrum meetings with stakeholders to design and finalize architecture plans with alternate solutions, suggestions, recommendations, and best practices in-line with cloud computing standards and Fidelity’s processes and policies.
• Implements logging and monitoring mechanisms to capture all processes and changes, identifies any issues, and proactively troubleshoots the bugs.

Education and Experience:

Bachelor’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and five (5) years of experience as a Principal Data Engineer (or closely related occupation) developing data solutions for firm-wide financial data lakes to support reporting and analytical needs.

Or, alternatively, Master’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and three (3) years of experience as a Principal Data Engineer (or closely related occupation) developing data solutions for firm-wide financial data lakes to support reporting and analytical needs.

Skills and Knowledge:

Candidate must also possess:

• Demonstrated Expertise (“DE”) designing database features and migrating the existing financial applications to the Cloud platform by applying relational database concepts and flat file processing concepts, using Oracle database and UNIX shell scripts, including developing Informatica workflows, database objects, stored procedures, SQLs using Informatica PowerCenter and SQL developer.
• DE building platforms for consumption at an enterprise level in a financial service environment, using Cloud based architecture, Amazon Web Services (AWS) (Lambda, EMR, or S3), PySpark, and Oracle.
• DE developing Python based data ingestion application to load structured data from relational databases into a Cloud SaaS based Data Lake Platform including Snowflake, using Amazon Web Services (AWS) (Lambda, EMR, or S3, and EC2), Jenkins, GitHub, AtScale, Power BI, and Control-M.
• DE in the full software development lifecycles (‘SDLC”) including functional design, architecture design, implementation, and testing, according to scrum-based Agile methodologies, using Informatica Power Center, Netezza, Oracle, and UNIX shell scripting or XML.

#PE1M2

#LI-DNI

Certifications:

Category:

Fidelity’s hybrid working model blends the best of both onsite and offsite work experiences. Working onsite is important for our business strategy and our culture. We also value the benefits that working offsite offers associates. Most hybrid roles require associates to work onsite every other week (all business days, M-F) in a Fidelity office.