Senior Data Engineer

Organization:  At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Senior Data Engineer

Location: Bangalore

Business & Team:

The Chief Data and Analytics Office (CDAO) – Data Platforms is in place to realise a data-driven organisation for Commonwealth Bank Group. We do this by solving complex problems around data for the business and activating data for strategic and sustained competitive advantage to enhance the financial wellbeing of our customers in a safe, sound and secure way.

As we embark on our cloud journey, the team is focussed towards building robust data processing frameworks for the bank, enabling secure and seamless data processing for our tenants in simplified and automated way.

Impact & Contribution:

As a data engineer, you will be part of a large cloud engineering cohort that are all aligned on executing the technology strategy, working alongside AWS Engineers and Cloud Architects to help create scalable and federated cloud native systems. We are establishing a greenfield landscape from ground up, partnering with our stakeholders to design, develop and deliver frameworks that underpin our ability to deliver enhanced data solutions with robust controls for our internal customers deriving value for Banks customers.

Bring your expertise in building scalable frameworks on cloud platform, with focus on automation and innovation.

Roles & responsibilities:

• Possesses hands-on technical experience working in AWS. Individual should be have knowledge about AWS services like: S3, Kinesis,Lambda,IAM
• Possess understanding of Streaming frameworks
• Familiarity with Kafka core concepts for streaming data processing
• Well versed in Unix Shell scripting and Python scripting
• Passionate about Cloud/DevOps/Automation and possess a keen interest to solve complex problems in a systematic approach.
• Possess the ability work independently and collaborate closely with team members and technology leads.
• Exhibit a proactive approach, constantly seeking innovative solutions to complex technical challenges. 

Essential Skills:

• Relevant experience of 8-12 years., Designing, developing, and deploying large-scale streaming data processing systems using Apache Kafka
• Amazon Web Services (AWS) cloud services, specifically:, AWS Kinesis (Data Streams, Firehose, Analytics)
• AWS Lambda (Serverless Compute Service),AWS S3 (Object Storage)
• AWS IAM (Identity and Access Management), Strong understanding of streaming data processing concepts, including:, Event-driven architectures
• Real-time data processing, Data ingestion, processing, and delivery, Experience with Kafka Core Concepts , such as:
• Producers, Consumers, Topics, Partitions, Replication, Kafka Streams API (for real-time data processing)
• Familiarity with AWS Streaming Services , including:, AWS Kinesis Streams (data ingestion)
• AWS Kinesis Firehose (data delivery to Amazon S3 or other targets)AWS Kinesis Analytics (real-time data processing and analysis)
• Experience with Streaming Data Processing Frameworks , such as Apache Flink or Spark Streaming, Experience with IaC : terraform, Familiarity with CI/CD Pipelines , such as Jenkins

Educational Qualifications:

• Bachelor’s degree in Engineering (Computer Science/Information Technology)

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.