Principal/Lead Data Engineer - Azure Databricks

Arlington, VA, United States

Peraton

Peraton drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted and highly...

View all jobs at Peraton

Apply now Apply later

Responsibilities

Peraton is seeking an experienced Principal/Lead Data Engineer - Azure Databricks to become part of Peraton’s Department of State (DoS) Diplomatic Security Cyber Mission (DSCM) program providing leading cyber and technology security experience to enable innovative, effective and secure business processes. 

 

Location: Rosslyn, VA or Beltsville, MD

 

As a Principal/Lead Data Engineer - Azure Databricks on the DSCM team, you will play a pivotal role in consolidating and integrating existing data warehouses, data marts, and applications into an Integrated Enterprise Data Warehouse.

 

In this role, you will: 

  • Perform detailed analyses of data and data source characteristics, relationships, and logic necessary for the effective implementation of information systems.
  • Identify and document problems traced to both original data quality issues and system outputs, and recommend solutions.
  • Combine domain knowledge and knowledge of system performance requirements in supporting system development and performance testing processes.
  • Provide recommendations for normalization to enable data visualizations and advanced analytics-AI
  • Manage complex projects and schedules with multiple objectives and priorities
  • Work collaboratively with a broad range of stakeholders across organizational boundaries to accomplish mission goals
  • Work under tight deadlines within a fast-paced environment
  • Demonstrated expertise in integrating new technologies and data analytics techniques to enhance cybersecurity infrastructure.
  • Strong leadership and mentoring skills, with a track record of guiding data engineering teams to successful project outcomes and professional growth.

#DSCM

Qualifications

Minimum Requirements: 

  • Bachelor's degree and a minimum of 9 years’ of relevant experience, a minimum of 7 years with Masters; minimum of 4 years with PhD.
    • An additional 4 years of experience may be substituted in lieu of the degree requirement.
  • Possess at least ONE of the following certifications:
    • CCNA-Security, CND, CySA+, GICSP, GSEC, Security+ CE, or SSCP
  • Demonstrated hands -on experience with Azure Databricks - both batch and streaming experience
  • Strong experience with building Data pipeline (ETL) and medallion architecture and developing pipelines for Petabytes of security logs.
  • Ability to create and maintain rich interactive visualizations through data interpretation and analysis, with reporting components from multiple data sources.
  • Understanding of data models & Common Information Model (CIM) and manage structured and unstructured datasets and managing insights through Data Cataloging tool set such as MS-Purview/Alation.
  • Engineering & Programming experience with building data lakes, frameworks, including Sirens/CSMA (Cyber Security Mesh Architecture).
  • Programming experience with frameworks, including Python, C#, SQL, Scala.

Azure Cloud Management:

  • Manage, optimize, and scale Azure cloud environments, ensuring efficient deployment, management, and high availability of cloud resources.

Engineering & Advanced Analytics Management:

  • Apply data engineering principles to manage Big data security analytics environment.
  • Developing pipelines in Data transformation/ orchestration.
  • Extending high data quality to advanced analytics pipelines.
  • U.S. citizenship required. 
  • An active Secret Security security clearance.
    • The ability to obtain a final Top Secret security clearance.

Desired:

  • Azure Fundamentals (AZ-900).
  • Security+ certification.
  • Project Management certification/Safe Agile trained.
  • Team Leadership experience, managing team of engineers.
  • Microsoft Azure AI Fundamentals (AI-900).

Peraton Overview

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we’re keeping people around the world safe and secure.

Target Salary Range

$135,000 - $216,000. This represents the typical salary range for this position based on experience and other factors.

EEO

EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.
Apply now Apply later
Job stats:  0  0  0

Tags: Agile Architecture Azure Big Data Data Analytics Databricks Data quality Data warehouse Engineering ETL PhD Pipelines Python Scala Security SQL Streaming Testing

Perks/benefits: Startup environment

Region: North America
Country: United States

More jobs like this