Senior Manager of Data Engineering - Databricks

Company Description

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.

Job Description

We are looking for a skilled and experienced Manager in Data Engineering with a focus on Databricks. The ideal candidate will lead our data engineering team to design, develop, and maintain our data infrastructure, ensuring our data is accurate, timely, and available for analysis. The candidate will also be responsible for managing a team of data engineers to support our organization's data needs, and work closely with other teams to ensure data integrity and compliance. 

Responsibilities: 

• Manage a team of data engineers to develop, maintain, and improve data pipelines, data architecture, and data models using Databricks. 

• Design and implement scalable and efficient data processing solutions to meet business requirements. 

• Work closely with other teams, including Data Science, Product, and Operations, to ensure data quality, accuracy, and compliance with regulations. 

• Implement best practices for data governance, data security, and data privacy. 

• Manage and prioritize multiple projects and initiatives simultaneously. 

• Evaluate and recommend new technologies, tools, and processes to improve our data engineering capabilities. 

• Collaborate with other managers to develop and execute strategies to drive the organization's data initiatives. 

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Systems, or related field. 

• 6+ years of experience in data engineering with a focus on Bigdata and Apache Spark based solutions. 

• 2 years of Experience building and maintaining data pipelines using Databricks. 

• 2 years of Experience managing a team of data engineers. 

• Strong understanding of distributed computing, data architecture, and data modeling. 

• Familiarity with cloud-based data platforms such as AWS, Azure, or Google Cloud. 

• Experience with SQL, Python, and other programming languages. 

• Excellent problem-solving skills and ability to prioritize and manage multiple tasks. 

• Strong communication and collaboration skills. 

• Experience in data governance, data security, and data privacy. 

• Familiarity with data security and privacy regulations such as GDPR and CCPA. 

Preferred qualifications: 

• Databricks Certification(s). 

• Familiarity with agile development methodologies.