Azure Databricks Engineer

This is a remote position.

Job Description:

We are seeking an experienced Azure Databricks Engineer to join our team. The ideal candidate will have over seven years of experience in designing, implementing, and managing data solutions using Azure technologies. This role requires a strong background in Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS) Gen 2, Synapse Analytics, Spark SQL, Azure SQL and Python.

Key Responsibilities:

• Lead the design and implementation of data solutions using Azure services.
  
• Develop and optimize data pipelines using Azure Data Factory and Databricks.
  
• Manage and maintain data storage solutions in Azure Data Lake Storage Gen 2.
  
• Implement data models and analytics solutions using Azure Synapse Analytics.
  
• Collaborate with cross-functional teams to define data requirements and ensure data integrity.
  
• Provide technical leadership and mentorship to junior team members.
  
• Stay up-to-date with the latest Azure technologies and best practices.
  

Qualifications:

• 7+ years of experience in data engineering and analytics.
  
• Expertise in Azure Databricks, ADF, ADLS Gen 2, Synapse, and Python.
  
• Strong understanding of data architecture and data management best practices.
  
• Excellent problem-solving skills and attention to detail.
  
• Proven ability to lead and manage technical projects.
  
• Strong communication and collaboration skills.
  

• Analyze and understand existing Spark SQL queries within Databricks notebooks and pipelines.
  
• Translate complex Spark SQL logic into optimized and equivalent Azure SQL(T-sql) queries.
  
• Strong proficiency in Spark SQL, Python, and T-SQL.
  

Preferred Qualifications:

• Azure certifications (e.g., Azure Data Engineer, Azure Solutions Architect).
  
• Experience with other data technologies and tools.
  

Requirements