Staff Data Engineer
Bangalore - Manyata Tech Park Road, India
Commonwealth Bank
CommBank offers personal banking, business solutions, institutional banking, company information, and moreOrganization:
At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Staff Data Engineer
Location: Bangalore
Business & Team: CST
Impact & contribution:
Reduce the deployment time of model by utilising advance tools and technology. In this role you’ll assist execution of strategic initiatives to improve team effectiveness and performance.
Reporting lines: Reports to Senior Manager
Roles & Responsibilities:
Lead the design and development of highly reliable and scalable data pipelines and data platforms with comprehensive test coverage.
Develop strategic data programs and data products.
Participate in domain planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy.
Partner with teams to engineer improvements to the scaling and reliability of our services.
Provide data engineering practice consultancy across platforms, products and delivery teams.
Identify and drive opportunities for continuous improvement within the team and in delivery of products.
Deliver high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice.
Develop reusable frameworks and tooling to accelerate data engineering maturity.
Take responsibility for nominated technical assets related to areas of expertise including roadmaps and technical direction.
Provide thought leadership, mentorship and up-skilling to other engineering teams.
Contribute to internal online discussion around engineering, delivery and technology e.g. blog posts, knowledge base articles.
Essential Skills:
9+ years of Experience
We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but having significant experience and exposure with some of these (or equivalents) will set you up for success in this team.
Scala, ANSI/ISO SQL, or Ab Initio graph along with backend coding expertise in Java and Python
Advanced understanding of Ab Initio Products including GDE, TFW and TDM
Hadoop / Teradata platform, using Spark , TCF and various ETL frameworks
Cloud migration experience ideally using AWS (Snowflake, etc.)
Realtime streaming technologies, Kafka is desirable.
Advanced understanding of Unix Shell Scripting.
Education Qualification:
Bachelor’s degree in Engineering in Computer Science/Information Technology
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 26/03/2025* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Computer Science Data pipelines Engineering ETL Hadoop Java Kafka Pipelines Python Scala Shell scripting Snowflake Spark SQL Streaming Teradata
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.