Senior Azure Data Engineer

About the Role:

We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, working with Azure cloud services, and designing and implementing scalable data solutions. You will play a crucial role in developing, optimizing, and maintaining data pipelines and architectures, ensuring data quality and availability across various platforms.

Key Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Build and optimize data storage solutions using Azure Data Lake, Azure SQL Database, and Azure Cosmos DB.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Implement data quality checks, data governance, and security best practices across data platforms.
• Monitor, troubleshoot, and optimize data workflows for performance and scalability.
• Develop and maintain data models, data cataloging, and metadata management.
• Automate data integration and transformation processes using Azure DevOps and CI/CD pipelines.
• Stay up-to-date with emerging Azure technologies and data engineering trends.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 3+ years of experience in data engineering with a focus on Azure cloud services.
• Proficiency in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database.
• Strong experience with SQL, Python, or other scripting languages.
• Familiarity with data modeling, ETL design, and big data tools such as Hadoop or Spark.
• Experience with data warehousing concepts, data lakes, and data pipelines.
• Understanding of data governance, data quality, and security best practices.
• Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.

Preferred Skills:

• Azure certification (e.g., Microsoft Certified: Azure Data Engineer Associate) is a plus.
• Experience with Azure Logic Apps, Azure Functions, and API Management.
• Knowledge of Power BI, Tableau, or other data visualization tools.