Oracle Databricks Developer - Manager

Hyderabad, India

⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️

State Street

State Street provides investment servicing, investment management, investment research and trading services to institutional investors worldwide.

View all jobs at State Street

Apply now Apply later

Role Summary & Role Description:

Technical Manager with specific Oracle, PLSQL and design, develop, and optimize data workflows on the Databricks platform. The ideal candidate will have deep expertise in Apache Spark, Pyspark, Python, job orchestration, and CI/CD integration to support scalable data engineering and analytics solutions.  Analyzes, designs, develops and maintains software applications to support business units.

Expected to spend 80% of the time on hands-on development, design and architecture and remaining 20% on guiding the team on technology and removing other impediments Capital Markets Projects experience preferred Provides advanced technical expertise in analyzing, designing, estimating, and developing software applications to project schedule. Oversees systems design and implementation of most complex design components. Creates project plans and deliverables and monitors task deadlines. Oversees, maintains and supports existing software applications. Provides subject matter expertise in reviewing, analyzing, and resolving complex issues. Designs and executes end to end system tests of new installations and/or software prior to release to minimize failures and impact to business and end users. Responsible for resolution, communication, and escalation of critical technical issues. Prepares user and systems documentation as needed. Identifies and recommends Industry best practices. Serves as a mentor to junior staff.

  • Acts as a technical lead/mentor for developers in day to day and overall  project areas.
  • Ability to lead a team of agile developers.
  • Worked in a complex deadline driven projects with minimal supervision. Ability to architect/design/develop with minimum requirements by effectively coordinating activities between business analysts, scrum leads, developers and managers.
  • Ability to provide agile status notes on  day to day project tasks.

Technical Skills

  • Design and implement robust ETL pipelines using Databricks notebooks and workflows.
  • Proficiency in Python, Scala, Apache Spark, SQL, and Spark DataFrames.
  • Experience with job orchestration tools and scheduling frameworks.
  • Optimize Spark jobs for performance and cost-efficiency.
  • Develop and manage job orchestration strategies using Databricks Jobs and Workflows.
  • Familiarity with CI/CD practices and tools.
  • Monitor and troubleshoot production jobs, ensuring reliability and data quality.
  • Implement security and governance best practices including access control and encryption.
  • Strong Practical experience using Scrum, Agile modelling and adaptive software development.
  • Ability to understand and grasp the big picture of system components.
  • Experience building environment and architecture and design guides and architecture and application blueprints.
  • Strong understanding of data modeling, warehousing, and performance tuning.
  • Excellent problem-solving and communication skills.

Core/Must have skills:

Oracle, SQL, PLSQL, Python, Scala, Apache Spark, Spark Streaming, CI CD pipeline, AWS cloud experience

Good to have skills:

Airflow

Work Schedule: 12 PM IST to 9 PM (IST)

About State Street:

What we do. State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world. From technology to product innovation, we’re making our mark on the financial services industry. For more than two centuries, we’ve been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.

Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive and comprehensive. Details vary by location, but you may expect generous medical care, insurance and savings plans, among other perks. You’ll have access to flexible Work Programs to help you match your needs. And our wealth of development programs and educational support will help you reach your full potential.

Inclusion, Diversity and Social Responsibility. We truly believe our employees’ diverse backgrounds, experiences and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.

State Street is an equal opportunity and affirmative action employer.

Discover more at StateStreet.com/careers

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  1  0  0

Tags: Agile Airflow Architecture AWS CI/CD Databricks Data quality Engineering ETL Oracle Pipelines PySpark Python Research Scala Scrum Security Spark SQL Streaming

Perks/benefits: Career development Flex hours Health care Team events

Region: Asia/Pacific
Country: India

More jobs like this