Data Engineer

Job Description:

Overview
The Data Engineer is responsible for maintaining efficient data pipelines and addressing data challenges such as inconsistency, quality issues, and complex transformation.

The Data Engineer is a fully onsite role in Columbus, Ohio. Remote work is not available.

Candidates must complete a 10-panel drug screen and pre-employment background check.

Job Description
Responsibilities:

• Maintain efficient data pipelines, addressing data challenges such as inconsistency, quality issues, and complex transformation.

• Ingest diverse data sets into the bronze layer, including internal client data and data from external providers.

• Collaborate with the team to understand pipeline structure and mechanize ad hoc data streams.

• Clean and merge dirty data into usable building blocks in the silver layer.

• Prepare and format data for reporting purposes in the gold layer.

• Utilize GCP services such as Cloud Scheduler and Cloud Functions.

• Develop comprehensive testing strategies to ensure data integrity and pipeline functionality using Python notebooks.

• Collaborate closely with the Data Manager to design and execute data reporting pipelines.

• Lead technical project development with a high degree of autonomy, owning key tech improvements such as writing Python SDKs and researching efficient methods of data transformation.

Qualifications:

• Bachelor of Science in Computer Science, Mathematics, or related field.

• 3 years of experience in Python and its data-related libraries, such as but not limited to Pandas, NumPy, or SciPy.

• 2 years of experience as the central architect for back end Ecommerce development projects.

• 2 years of experience ingesting data with diverse APIs.

• 2 years of experience with version control using Git.

• 2 years of experience as a lead developer defining project requirements and designing solutions.

• 1 year of experience designing and executing data reporting pipelines with diverse production and event generated databases.

• 1 year of experience developing with Google Cloud Platform (GCP).

• Google Data Engineer Certification required.

By applying to Rogue, regardless of the platform you choose to use, you are agreeing to Rogue's preferred methods of communication (i.e. text message). Submitting an application, through whatever online forum is ultimately used, constitutes a knowing and voluntary agreement to send and receive text messages during the recruitment process.