Databricks/Data Modeler

Company

Federal Reserve Bank of New York

Working at the Federal Reserve Bank of New York positions you at the center of the financial world with a unique perspective on national and international markets and economies. You will work in an environment with a diverse group of experienced professionals to foster and support the safety, soundness, and vitality of our economic and financial systems.  

The Bank’s flexible work model supports balancing the demands of work and life, while prioritizing the value of connecting and collaborating with our colleagues in person. Employees are expected to live within a commutable distance of their primary work location to support team collaboration.

What we do:

Provides leadership in data management and analytics (supported by data) to define and solve important business problems in collaboration with business leaders. Partners with management and delivers viable solutions and operations to support data initiatives. Defines business data requirements and works with Technology service providers to define and deliver the appropriate solutions. Supports creation of data standards, ongoing data quality support, and exception management as it relates to projects and support of ongoing production applications while working closely with the Data Management teams to aid in the procurement of data services. More specifically:

o    Create data products in Databricks
o    Leverage best design practices for modeling a data lakehouse architecture to convert current (RDBMS) data models to best represent data in Databricks
o    Re-architect legacy data (from existing applications and/or databases) to migrate to Databricks while optimizing for query performance, compute and storage costs.

Your role as a Data Modeler:

• Create data products in Databricks

• Leverage best design practices for modeling a data lakehouse architecture to convert current (RDBMS) data models to best represent data in Databricks

• Re-architect legacy data (from existing applications and/or databases) to migrate to Databricks while optimizing for query performance, compute and storage costs

Top Skills

• Financial industry experience, strong knowledge of business domains including fixed income products, trades, positions, and reference data

• Data modeling experience (conceptual, logical, and physical), relational and dimensional data model design

• ETL experience with Databricks and Spark

• Data processing and analytics in Databricks

• Strong analytical skills

What we are looking for:

Core Responsibilities

• Leverage financial industry expertise to define conceptual, logical and physical data models in Databricks to support new and existing business domains

• Work with product owners, system architects, data engineers, and vendors to create data models optimized for query performance, compute and storage costs

• Define best practices for the implementation of the Bronze/Silver/Gold data layers of the lakehouse

• Provide data model documentation and artifacts generated from data, data dictionary, data definitions, etc.

Qualifications

• Data Modeling: Expertise in designing and implementing data models optimized for storage, retrieval, and analytics within Databricks on AWS, including conceptual, logical, and physical data modeling

• Databricks Proficiency: In-depth knowledge and hands-on experience with AWS Databricks platform, including Databricks SQL, Runtime, clusters, notebooks, and integrations.

• ELT (Extract, Load, Transform) Processes: Proficiency in developing ETL pipelines to extract data from various sources, transform it as per business requirements, and load it into the central data lake using Databricks tools and Spark

• Data Integration: Experience integrating data from heterogeneous sources (relational databases, APIs, files) into Databricks while ensuring data quality, consistency, and lineage

• Performance Optimization: Ability to optimize data processing workflows and SQL queries in Databricks for performance, scalability, and cost-effectiveness, leveraging partitioning, clustering, caching, and Spark optimization techniques

• Data Governance and Security: Understanding of data governance principles and implementing security measures to ensure data integrity, confidentiality, and compliance within the centralized data lake environment

• Advanced SQL and Spark Skills: Proficiency in writing complex SQL queries and Spark code (Scala/Python) for data manipulation, transformation, aggregation, and analysis tasks within Databricks notebooks

• Cloud Architecture: Understanding of cloud computing principles, AWS architecture, and services for designing scalable and resilient data solutions

• Data Visualization: Basic knowledge of data visualization tools (e.g. Tableau) to create insightful visualizations and dashboards for data analysis and reporting purposes

Salary Range: $159,400 - $274,200 / year  

We believe in transparency at the NY Fed. This salary range reflects a variety of skills and experiences candidates may bring to the job. We pay individuals along this range based on their unique backgrounds. Whether you’re stretching into the job or are a more seasoned candidate, we aim to pay competitively for your contributions.  

  

Our Touchstone Behaviors—Communicate Authentically, Collaborate Inclusively, Drive Progress, Develop Others, and Take Ownership—help shape the culture of the Bank. They also provide a shared language for how we work together and achieve success, and they set clear expectations for leading with impact at every stage of your career with us. Learn more.  

  

Benefits:  

Our organization offers benefits that are the best fit for you at every stage of your career:  

• Fully paid Pension plan and 401k with Generous Match  

• Comprehensive Insurance Plans (Medical, Dental and Vision including Flexible Spending Accounts and HSA)  

• Subsidized Public Transportation Program  

• Tuition Assistance Program   

• Onsite Fitness & Wellness Center  

• And more

The New York Fed expects its employees to perform their duties with honesty, integrity, and impartiality, and without improper preferential treatment of any person. Learn more about our code of conduct and conflicts of interest rules.  

  

The Federal Reserve Bank of New York is committed to a diverse workforce and to providing equal employment opportunity to all persons without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, age, genetic information, disability, pregnancy, or military service.  

  

We value accessibility for all candidates and are happy to provide an accommodation or assistance. Please email us at ny.leaves@ny.frb.org and we’ll be glad to help. Please note, this is a dedicated e-mail box designed exclusively to assist applications with accommodation requests in relation to our recruiting process. All other inquires including the status of applications will not receive a response from this e-mail box.   

  

This is not necessarily an exhaustive list of all responsibilities, duties, performance standards or requirements, efforts, skills or working conditions associated with the job. While this is intended to be an accurate reflection of the current job, management reserves the right to revise the job or to require that other or different tasks be performed when circumstances change.  

This position requires access to confidential supervisory information (CSI) and/or Federal Open Market Committee (FOMC) information. Access to CSI and FOMC information is limited to U.S. citizens, lawful permanent residents, individuals who meet the definition of “protected individual” under 8 U.S.C. § 1324b(a)(3), and certain other nonimmigrants. All non-U.S. citizens authorized to access CSI and/or FOMC information must sign a declaration of intent to expeditiously become a lawful permanent resident and thereafter a U.S. citizen when eligible.   

Full Time / Part Time

Full time

Regular / Temporary

Regular

Job Exempt (Yes / No)

Yes

Job Category

Data Analytics Family Group

Work Shift

First (United States of America)

The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.

Always verify and apply to jobs on Federal Reserve System Careers (https://rb.wd5.myworkdayjobs.com/FRS) or through verified Federal Reserve Bank social media channels.

Privacy Notice