Senior Data Engineer

Responsibilities 

• A problem-solving mindset with the ability to understand business challenges and how to apply analytics expertise to solve them. 
• Build compelling, clear, and powerful visualizations of data. 
• Design, architect and implement Azure Data Factory V2 Pipelines. 
• Should have worked on Team Foundation Server / GIT as part of ADF Implementation. 
• Experience in migration projects like moving/implementing code from other ETL tool to ADF. 
• Develop solution to implement error logging, alerting mechanism using various available azure services. 
• A team mentality empowered by the ability to work with a diverse set of individuals. 
• Tell a clear story, highlight insights we had not previously seen and do it all faster than we’ve been able to previously. 
• Create, maintain, and document a robust set of metrics to monitor day-to-day bug detection and long-term performance tracking/tuning. 
• Have strong understanding of best practices, standards and guidelines in each technology/product and apply same to produce high quality deliverables  
• Should be able to take responsibility for the software life cycle - set up all environment, design, code, test, repository mgmt. and deployments as applicable and as required 

Required Qualifications 

• Minimum 5-7 years of Development experience in ADF. 
• At least 3-5 years of experience in T-SQL, creating complex store procedures, triggers etc. 
• Should have used Azure DevOps extensively as part of projects 
• Should have worked on SQL Database, Azure SQL Database, Azure Datawarehouse, salesforce connectors, snowflake connectors and should be comfortable with data warehousing concepts. 
• Should have worked on Azure Logic Apps, Azure Functions for not less than 3 years. 
• 4+ Years professional experience in a data Engineer/analyst role or similar. 
• Knowledge in creating Power BI Reports & Dashboards [Optional] 
• Should have worked on Service Bus, Event Hub. 

Preferred Qualifications 

• Experience working on Data Migration / Code implementation from other ETL tools using ADF will be an advantage. 
• Experience with Azure Data Factory, SSIS package, managed identity, service principles and other deployment activities 
• Experience with building CI/CD pipelines in Data environments and different patterns of deployment activities 
• Experience working on Azure Analysis Service with intermediate expertise in writing DAX. 
• Exposer to NOSQL databases Cosmos DB, Kusto DB. 
• Preferred Azure Cloud Shell, PowerShell, Azure CLI and Work with other Azure stack modules like Azure Data Lakes, SQL, Data warehouse, SF connectors, etc. 
• Excellent communication, organizational transformation, and leadership skills 
• Eager to continuously learn and grow.