Data Engineer II

Would you enjoy a Data Operations role that includes processing data, data analysis, data development and LINUX shell scripting work? You will be performing (ETL) Extraction Transformation and Load tasks, the timely processing and delivery of data builds with varying frequencies, data build automation and automation/monitoring the pulse of a deployment process.

The perfect candidate for this role will have the ability to work independently for various tasks, but they will also collaborate with various technical and non-technical audiences. The individual will support our data developers, software engineers, business analysts and data architects on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects
 

Responsibilities

• Own a specific set or group of data transfers/builds in various capacities including transferring incoming data using sftp, unzip files, check files (correct name, correct number of files, not corrupt, matches layout, matches fixed length), create call in ECL to process files and enable movement through deployment process, review build statistics after processing.
• Perform simultaneous execution of multiple tasks following and reacting, when necessary, throughout the day.
• Produce code that is efficient, repeatable, without defects, and adherent to best practices and internal standards such as naming conventions, encapsulation, etc.
• Contributes to design, coding and reviews of moderate processes.
• Good level of intimacy within a specific data content area.
• Complete data engineering bug fixes and issues, researching and identifying root causes as appropriate.
• Identify opportunities to apply automation or other tools to improve effectiveness or efficiency.
• Innovate process improvements that enable efficient delivery and maintenance.
• Participate in the development processes, coding best practices, and code reviews.
• Work with stakeholders including the Executive, Product, Data and Architecture teams to assist with data related technical issues, enhancements and to support their data infrastructure needs.
• Complete simple data engineering bug fixes and resolve technical issues as necessary.

Qualifications:

• Bachelor's degree holder.
• 2-4 years of data or database management experience, skills, and competencies.
• Strong LINUX ksh/bash scripting skills dealing manipulation of files and automation processes utilizing: crontab, awk, sed, cut, paste, variations of date, if/then/else, case/esac, while loops, for loops, functions, use of variables over hard coding, sourcing,…..)
• Cloud Azure experience
• Experience with file management.
• Experience with ETL tasks (any tool would do).
• Experience with SFTP.
• Strong debugging/problem solving skills. Must enjoy digging deep into problems.
• Attention to detail.
• Strong organizational skills.
• Ability to provide detail information and summarize to various levels of staff including management.
• Ability to effectively resolve issues/problems to reach a workable and successful solution.
• Ability to understand and develop systems of simple tomoderate complexity.
• Ability to work in ambiguous situations.
• Ability to deliver a quality code product as scheduled.

Nice-to-have:

• Experience with a programming language (e.g. JAVA, PYTHON, C/C++, .net) for some development work.
• Experience with process automation.
• Familiarity with using GIT Hub.
• Medium to strong database knowledge; modifying/designing and creating procedures to insert, update, query moderate MySQL DB used for tracking a deployment process
• Ability and desire to learn new processes and technologies utilizing our HPCC systems and opensource code, ECL. (This is an opportunity to learn ECL our open source software language that maximizes the rapid utilization of our massive databases)

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.