Databricks Developer

We are seeking a talented and experienced Azure Databricks Developer to join our dynamic team. As an Azure Databricks Developer, you will be responsible for designing, developing, and maintaining data pipelines and analytics solutions using Azure Databricks. Your expertise will play a critical role in transforming data into actionable insights, supporting the company's data-driven decision-making process.

JOB RESPONSIBILITIES:

• Design, develop, and maintain data pipelines within Azure Databricks for ETL/ELT processes to ensure data is properly ingested, processed, and stored.
• Implement data transformations and data cleaning techniques to ensure data quality and consistency for analysis.
• Collaborate with data engineers and data scientists to integrate data from various sources into Azure Databricks, making it available for analytics and reporting and analysis.
• Continuously monitor and optimize the performance of Azure Databricks clusters to ensure efficient data processing and analysis.

• Write and maintain code in Python, Scala, or other relevant languages to build data processing and transformation logic within Azure Databricks notebooks.
• Develop and maintain data models and structures that enable efficient querying and reporting on the Azure Databricks platform.
• Ensure that data security and compliance standards are adhered to in the development and maintenance of data pipelines and analytics solutions.
• Create and maintain documentation for data pipelines, processes, and workflows to facilitate knowledge sharing and team collaboration.
• Work closely with data engineers, data scientists, and business stakeholders to understand data requirements and deliver solutions that meet business needs.

• Identify and resolve issues related to data pipelines, performance, and data quality. Provide support as needed.

Requirements

Required Skills & Experience:

• Fluent English-Spanish, good verbal and written communications skills
• +3 years of experience in data engineering and development, with a focus on Azure Databricks.

• Strong programming skills in languages like Python, Scala, or SQL.
• Proficiency in working with big data technologies, data lakes, and data warehousing concepts.
• Experience with data modeling, data integration, and data transformation.
• Familiarity with cloud services, particularly Microsoft Azure.
• Knowledge of data security and compliance best practices.

• Strong problem-solving and communication skills.
• Strong communication skills and the ability to work collaboratively with cross-functional teams.
• Attention to quality and detail.
• Motivated, enthusiastic individual with ability to work on own initiative.

Qualifications:

• Bachelor’s degree in information science or related field is a plus.
• Relevant certifications (e.g., Databricks Certified Data Engineer Associate/Professional, DP-203 Azure Data Engineer) is a plus.