Data Engineering Manager

About HireRight

HireRight is the premier global background screening and workforce solutions provider. We bring clarity and confidence to vetting and hiring decisions through integrated, tailored solutions, driving a higher standard of accuracy in everything we do. Combining in-house talent, personalized services, and proprietary technology, we ensure the best candidate experience possible. PBSA accredited and based in Nashville, TN, we offer expertise from our regional centers across 200 countries and territories in The Americas, Europe, Asia, and the Middle East. Our commitment to get it right every time, everywhere, makes us the trusted partner of businesses and organizations worldwide.

Overview

• Design, build, test and deploy new data pipelines within On Prem or Cloud Data Eco-Systems
• Coordinates oversight into existing data pipelines, including the implementation of solutions that will simplify and increase performance.
• Ensures team follows best practices and execute architected techniques and solutions for data collection, management and usage to aid in company-wide data governance and management framework.
• Work closely with the data analysts and scientists, and database and systems administrators to create data solutions.
• Evaluate new data sources for quality and attribution to support product requirements.
• Documents new/existing pipelines, Data Sets and Data Sets lineage.
• The work activity includes processing complex data sets, leveraging technologies used to process these disparate data sets and understanding the correlations as well as patterns that exist between these different complex data sets.
• Sets team priorities to ensure task completion.
• Participate in the formulation of departmental objectives, plans and policies.
• Sets goals, provides feedback to team members, and conducts regular performance evaluations.
• Interprets customer needs and assesses requirements; works with team members to aid in understanding tasks to support the production of solutions.
• Engages in recruiting and training of new staff.
• Provides concise status updates and challenges to senior management.

Responsibilities

• Strong communication skills, with the ability to present complex technical solutions in a manner that can be interpreted by a general audience. This includes proficiency in Powerpoint, Visio, Drawio, etc.
• Familiar with software development life cycle as it relates to data integration and data quality.
• Experience in designing and building production data pipelines from ingestion to consumption within a hybrid data architecture, using Java, Python, Scala, C#, etc.
• Experience in Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
• Experience in Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.
• Strong experience in common data warehouse modelling principles including Kimball, Inmon.
• Strong experience with data processing frameworks such as Apache Spark and Hadoop
• Ensuring data quality and consistency through data cleaning, transformation, and integration processes.
• Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
• Experience in Managing Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance.
• Collaborating with data scientists, business analysts, and other stakeholders to understand data requirements and implement appropriate data solutions.
• Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information.
• Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks.
• Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
• Knowledge of Microsoft BI Stack (SSRS/SSAS (Tabular with DAX & OLAP with MDX) SSIS) is desirable.
• Keeping abreast of the latest Azure features and technologies to enhance data engineering processes and capabilities.
• Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards.
• Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging.
• Skills in navigating interpersonal dynamics, resolving team conflicts while maintaining a positive work culture.

Qualifications

• BA/BS in Computer Science, engineering or related field, or equivalent experience.
• 5+ years of experiencing in a leadership role, managing and mentoring teams.
• 5+ years of experience in area of data management and/or data curation.
• 5+ years development experience with Oracle and/or SQL Server.
• 5+ years of Experience with Python/Pyspark frameworks/libraries.
• Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
• Ability to develop, implement and optimize code using procedural languages such as PL/SQL, T-SQL, etc..
• Experienced with SSIS and C# development
• Experienced with data normalization and denormalization techniques
• Experienced in implementing largescale event based streaming architectures
• Experienced data transformation and data processing techniques
• Knowledge of API and Microservice development
• Experienced in Agile methodology and/or pair programming
• Preferred knowledge of AI/ML concepts and technologies
• Preferred experience with Stream-processing systems
• Preferred working knowledge of cloud architectures on Azure or GCP
• Strong communication skills
• Strong writing and documentation skills
• Experienced in working with cross functional teams, building alignment and collaboration
• Preferred certification Azure Data Engineering Associate (DP203) and Implementing Analytic Solutions Using Microsoft Fabric (DP600).

What do we offer

In exchange for your expertise, HireRight offers an excellent employee benefit package which includes:

• Medical
• Dental
• Vision
• Paid Life/AD&D Insurance
• Voluntary Life Insurance
• Short- & Long-Term Disability
• Flexible Spending Accounts
• 401K
• Generous Vacation and Sick Program
• 10 Paid Holidays
• Education Assistance Program
• Business Casual Attire
• Generous Referral Program
• Employee Discounts and Rewards
• And much more!

*All resumes are held in confidence. Only candidates whose profiles closely match requirements will be contacted during this search.

HireRight, LLC is an Equal Opportunity Employer

Minorities / Females / Veterans / Disabilities