Senior Java Developer with Databricks Expertise - Senior Manager

We are seeking a seasoned senior java developer with extensive experience in databricks to join our innovative development team. The ideal candidate will have a robust background in java development, distributed computing, and big data technologies, with a focus on Databricks. Proficiency in cloud platforms like Azure and data warehousing solutions such as Snowflake is essential. This role offers the opportunity to lead the design and implementation of cutting-edge data solutions that drive business intelligence and analytics.

Key Responsibilities:

• Lead the design, development, and deployment of scalable Java applications integrated with Databricks for big data processing

• Architect and optimize distributed computing solutions using Apache Spark within the Databricks environment to handle large-scalable datasets efficiently

• Implement and manage data lake house architecture using Databricks, ensuring data integrity, security, and accessibility.

• Develop and maintain ETL pipelines using Databricks and Apache Spark, automating data workflows to improve processing efficiency

• Provide technical leadership in system architecture design, making informed decisions to meet business requirements and scalability needs

• Optimize cloud resource utilization on platforms like Azure ensuring cost-effective and reliable data processing solutions

Must-Have Skills :

• Bachelor's degree in Computer Science, Information Technology, or a related field

• Minimum of 7 years of hands-on experience in Java development, with a deep understanding of object-oriented principles

• Extensive experience working with Databricks, including designing and implementing data pipelines, managing clusters, and utilizing Databricks notebooks

• Proficiency in distributed computing frameworks, particularly Apache Spark, within the Databricks environment.

• Strong experience with cloud platforms especially Microsoft Azure, including services like Azure Data Lake Storage (ADLS) and Azure Data Factory

• Solid understanding of data warehousing concepts and hands-on experience with Snowflake

• Experience with version control system such as Git and familiarity with CI/CD pipelines

• Excellent problem-solving skills, attention to detail and the ability to work effectively in a collaborative team environment

Good-to-Have Skills:

• Experience with additional programming languages such as Python or Scala

• Knowledge of containerization technologies like Docker and orchestration tools like Kubernetes

• Understanding of agile development methodologies and experience working in Agile teams

• Familiarity with monitoring and logging tools to ensure application reliability and performance

• Contributions to open-source projects or active participation in relevant technical communities

State Street's Speak Up Line