Data Engineer

If you’re passionate about building a better future for individuals, communities, and our country—and you’re committed to working hard to play your part in building that future—consider Craft Education as the next step in your career.

 

Craft Education is on a mission to solve skilled labor shortages by powering work-based learning pathways for all.  

 

At Craft, we’re revolutionizing the apprenticeship degree, combining on-the-job learning with accredited instruction to create innovative educational pathways that accommodate working professionals and meet employer needs.  Our flagship product - Craft Connect - helps organizations administer apprentice degree programs and address mission-critical data and reporting needs.  Through the same platform, Craft is also transforming how on-the-job learning converts into academic credits.

 

Our team of technology, education and workforce professionals also provides technical assistance to organizations looking to launch and manage apprenticeship degree programs.  We are working tirelessly to accelerate the expansion of these programs along with the data infrastructure that underpins them.  

 

If you’re looking to join the work-based learning revolution, we’d love to talk with you.  At Craft, you’ll have the opportunity to solve hard problems in a high-growth startup environment and make a lasting impact on the future of education and workforce development.  We couldn’t be more excited to advance this work as a team of innovative, collaborative and mission-oriented professionals - we hope you’ll consider joining us.

The salary range for this position takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs.

At WGU, it is not typical for an individual to be hired at or near the top of the range for their position, and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is:
 

Pay Range: $87,200.00 - $130,800.00

Job Description

Job Summary

The principal function of the Data Engineer is to build robust ETL/ ELT pipelines to make data available to Data Analysts, Data Scientists, and other internal business units. The Data Engineer will be responsible for coding and working through the development cycle of ETL/ELT jobs and BI reporting. They will understand business requirements and design optimal ETL/ELT process for data acquisition, transformation, and publication for ease of analysis.

The Data Engineer will follow agile development methodology for timely delivery of accurate data. They must have coding proficiency to write unit tests for pipeline functionality as well as data quality – this includes job monitoring, alerting, and code versioning and deployment. This position is also expected to develop, modify, and deploy formal and ad hoc reports.

Essential Functions and Responsibilities:

• Develop and build ETL/ELT data pipelines for use in data analysis.

• Create and maintain optimal data pipeline architecture.

• Keep our data separated and secure across multiple cloud environments.

• Assemble large, complex data sets that meet functional / non-functional business requirements.

• Deliver ad hoc and analytical reports to internal users and teams.

• Monitor and maintain ETL/ELT jobs and troubleshoot load issues.

• Manage change requests/ticket queues for analytical reports and ETL/ELT jobs.

• Perform data/technology discovery from new sources and third-party applications for data ingestion.

• Create complex reports and dashboards Metabase.

• Ingest and transform structured, semi structured and unstructured data from sources including relational databases, NoSQL, external APIs, JSON, XML, delimited files, and more.

• Work and deliver in agile methodology for new development projects. Deliver efficient and effective solutions on time.

• Performs other related duties as assigned.

Knowledge, Skill and Abilities:

• Ability to analyze and understand data source and design a data model for data capture and ETL/ ELT.

• Ability to identify bugs and apply fix and check data quality via process/pipeline audits.

• Ability to work with team members, as well as cross-team for product delivery.

• Ability to work in agile environment with timely delivery of ETL/ ELT pipelines and reports.

• Ability to deal with a variety of variables under limited standardization.

• Ability to interpret various instructions.

• Ability to perform basic math, use decimals to compute ratios & percentages, and to draw and interpret graphs.

• Ability to prepare memos, reports, and essays using proper punctuation, spelling, and grammar.

• Ability to communicate clearly, effectively and appropriately with all audiences.

• Ability to work independently, is self-motivated, and a strong team player.

• Use of industry best practices for code development, testing, implementation and documentation

Organizational or Student Impact:

• Works on a variety of technical projects of moderate scope with some instruction.

• Uses discretion to prioritize work and evaluate problem-solving approaches.

• Limit errors to prevent impact to client operations, costs, or schedules.

Problem Solving & Decision Making:

• This position requires general supervision on all work.

• May help lead/coordinate small-medium scope projects.

• Guidance is required around project scopes and methodology.

• Work generally reviewed for accuracy.

Communication & Influence:

• Communicates with contacts both within the department and function on matters that may require some explanation or interpretation.

• May work to influence parties within the department at an operational level regarding policies and best practices.

Leadership & Talent Management:

• May provide guidance and assistance to more junior technical professionals.

Job Qualifications:

Minimum Qualifications:

• B. S. in Business, Management Information Systems, Computer Science, or a related field, or an equivalent combination of experience and training.

• 2 years of related experience

• Knowledge and Exposure to tools and concepts like:

  •  Jira

  • Confluence

  • GitHub

  • Data Integrity

  • Validation and testing

  • Relational SQL and NoSQL databases

  • Object-oriented/object function scripting languages: Python, Java, Scala

  • Big data tools: Hadoop, Spark, Kafka, Databricks, etc.

• Exposure to analytical reporting tools, preferably Metabase

Preferred Qualifications:

• 2 years of prior relevant work experience or advanced degrees in Data Integration, Big Data, or Business Intelligence

• Early-stage company exposure

Physical Requirements:

• Prolonged periods sitting at a desk and working on a computer.

• Must be able to lift up to 15 pounds at times.

Position & Application Details

Full-Time Regular Positions (classified as regular and working 40 standard weekly hours): This is a full-time, regular position (classified for 40 standard weekly hours) that is eligible for bonuses; medical, dental, vision, telehealth and mental healthcare; health savings account and flexible spending account; basic and voluntary life insurance; disability coverage; accident, critical illness and hospital indemnity supplemental coverages; legal and identity theft coverage; retirement savings plan; wellbeing program; discounted WGU tuition; and flexible paid time off for rest and relaxation with no need for accrual, flexible paid sick time with no need for accrual, 11 paid holidays, and other paid leaves, including up to 12 weeks of parental leave.

How to Apply: If interested, an application will need to be submitted online. Internal WGU employees will need to apply through the internal job board in Workday.

Additional Information

Disclaimer: The job posting highlights the most critical responsibilities and requirements of the job. It’s not all-inclusive.

Accommodations: Applicants with disabilities who require assistance or accommodation during the application or interview process should contact our Talent Acquisition team at recruiting@wgu.edu.

Equal Employment Opportunity: All qualified applicants will receive consideration for employment without regard to any protected characteristic as required by law.