Senior Data Engineer - Remote East Coast

Position Summary

As a Senior Data Engineer, the candidate will be responsible in integrating, analyzing raw data, developing, and maintaining datasets and improving data quality and efficiency. The engineer needs to have strong analytical skills and will involve various methods to integrate different data sources, transform data into useful business drivers. Candidate should be intimate with several data stores, integration tools/technologies, data transformation methods, data modelling and analysis. Candidate should be able to work across projects involving multiple stakeholders. Having strong technical and programming skills while working with business, architects, partners to resolve complex system issues.

Responsibilities

• Develops and maintains scalable data pipelines, integration tools and builds out new API integrations to support continuing increases in data usage, volume, and complexity.

• Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition.
• Strong Programming, SQL skills across structured and unstructured data. Intimate with most Azure services including ADF, Azure Functions, ASB, API, Synapse, SQL
• ETL, ELT with Data Lake and Data Warehouse data platforms
• Should be self-starter with strong execution and delivery mindset.
• Monitor and manage database performance
• Excellent knowledge of data backup, recovery, security, integrity and SQL
• Hands-on experience with database standards and end user applications

• Designs data integrations, data quality framework and integrate it with monitoring services. Strong hands-on capabilities across integration toolsets including but not limited to ADF, Replication, CDC etc.
• Integrate data from different SORs, combine raw information and create resulting models ready for consumption.
• Interpret trends and patterns.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, DB, SQL, and data pipelines performance tuning, optimizing data delivery, and automating manual processes
• Build solution prototypes as needed and write algorithms against data.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
• Works closely with a team of frontend and backend engineers, product managers, and analysts
• Data Management, Modelling, Architecture, and Integration

• Develop and maintain database documentation, including data standards, procedures and definitions for data elements and tables in the company.

Experience and Competencies

Minimum Requirements

• At least 10 years of experience in technology, specifically in the data field
• Bachelors degree in technology related discipline is preferred. In lieu of degree, 14 years of experience is required.
• Solid balance between architecture strategy, technical IT skills and strong business process knowledge
• 4+ years of Python, NodeJs or Java development experience
• 4+ years of experience with schema design and dimensional data modeling
• Experience in technology platforms across Microsoft Azure, Cloud Computing, Software as a Services (SaaS), Integration Platform as a Service (IPaaS), Infrastructure as a Service (IaaS)
• Previous experience as a data engineer or in a similar role
• Technical expertise with data models, data mining, and segmentation techniques
• Hands-on 7+ years' experience with SQL, Data integration, Data analysis, Data Modelling, and design
• Experience working and implementing solutions with Microservices Architecture
• Experience working with Data warehousing and Data Lake solutions.
• Demonstrated ability to instrument Data Quality & Management standards and processes.
• 4+ years working with data integration and ETL tools, such as Azure Data Factory, CDC, Replication, Talend, Informatica etc.
• Strong problem-solving and analytical skills
• Excellent communication and collaboration abilities
• Adaptability and a willingness to learn new technologies and techniques.
• Ability to work with CI/CD pipelines and Automation.
• Demonstrated ability to handle/organize multiple complex technical projects simultaneously without compromising the quality of work or the final product.
• Demonstrated strong analytical & troubleshooting skills, as well as excellent written and verbal communication skills.
• Ability to understand the long-term ("big picture") and short-term perspectives of situations and how they relate to achieving targeted business outcomes.
• Ability to estimate the financial and business impact of technology alternatives.
• Ability to apply multiple technical solutions to enable future-state business capabilities that, in turn, drive targeted business outcomes.
• Ability to quickly comprehend the functions and capabilities of existing, new, and emerging technologies that enable and drive new business designs and models.
• Demonstrated ability to work well with others and be respected as a leader.

Highly Desired

• Masters in computer science or related field is a plus.
• Data engineering certifications is a plus

There will be periodic requirements to travel for in-person events, at the discretion of your manager or the requirement of the company.