Data Engineer

With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility℠.

Job Description

Data Engineer will work closely with the rest of the product team and business peers to effectively execute Data project initiatives. This person should be able to deliver in a fast-paced and deadline- driven environment. Along with development, candidate will be responsible for maintenance of the data applications and would be expected to automate the processes with no or minimal human

intervention

Tasks/Responsibilities

• Development and maintenance of ELT snowflake data warehouse solutions
• Collaborate with internal and external technology and business partners to implement product changes
• Produce detail design and unit test documents, as required
• Critically analyze business requirements, architect and implement Data solutions
• Define, develop and maintain standards and processes to ensure effective ETL solution
• Production maintenance
• Work closely with product manager to develop and execute action plans to address gaps
• Recommend innovations that enhance and/or provide a competitive advantage to the organization
• Communicate effectively with both the business and technical teams
• Mentor junior offshore developers to accomplish results
• Build and continuously improve data engineering best practices

Requirements Skills/Experience

• Must-have skills for this PAR: Min 8 years of Data engineering experience using ETL/ELT technologies
• 6+ years ETL/ELT experience working with IICS, Informatica, StreamSets, DBT, Python, Data bricks, Snowflake and ADF or equivalent technologies
• 4+ years hands on experience with Snowflake
• Experience working with SSIS, SSRS, and Power BI
• 3+ years hands on experience working in an Azure environment, Azure functions, Azure logic apps.
• Experience with external file conversion and loads for multiple file types, JSON, XML, CSV, Parquet, Domino
• experience with unstructured, semi structured datasets
• Experience working in insurance or reinsurance industry is highly desirable
• 3+ years hands on experience with agile methodologies
• Experience with Data warehouse/ data lake/ data hub modeling
• Experience working with external data feed to enrich internal data- desired
• 3+ years hands on experience with data standardization/conformance/transformation process
• Solid understanding of MDM and reference data
• 3+ years hands on experience with CI/CD process, especially in data engineering
• Experience working in SOX and SOC-2 compliant environment
• Experience with automated monitoring of data loads
• Support of production environment
• Strong understanding of technologies utilized in the industry and the ability to see their impact as well as enhancement management and product lifecycle development
• Knowledge of source code version control systems such as Git including branching/merging, resolving code conflicts, and 3-way and baseless merges
• Knowledge and experience with ML is a plus
• Relevant experience working with 3rd party vendors to deliver results

Education

Bachelor’s degree in computer science, MIS or related field required

#LI-ZP1

#LI-HYBRID

For individuals assigned or hired to work in California, Colorado, Hawaii, Jersey City, NJ; New York State; and/or Washington State, the base salary range is listed below. This range is as of the time of posting. Position is incentive eligible.

$90,000 - $160,000/year

• Total individual compensation (base salary, short & long-term incentives) offered will take into account a number of factors including but not limited to geographic location, scope & responsibilities of the role, qualifications, talent availability & specialization as well as business needs.  The above range may be modified in the future

• Click here to learn more on available benefits

Do you like solving complex business problems, working with talented colleagues and have an innovative mindset? Arch may be a great fit for you. If this job isn’t the right fit but you’re interested in working for Arch, create a job alert! Simply create an account and opt in to receive emails when we have job openings that meet your criteria. Join our talent community to share your preferences directly with Arch’s Talent Acquisition team.