Senior Data Engineer
Bangalore - Manyata Tech Park Road, India
Commonwealth Bank
CommBank offers personal banking, business solutions, institutional banking, company information, and moreOrganization:
At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Senior Data Engineer
Location: Bangalore
Business & Team: Business Banking Technology
Impact & contribution:
As an Engineer, you will be required to build strong working relationships with key business and stakeholders to improve outcomes, drive engineering standards across the group, identify engineering improvement opportunities to improve our status on risk, compliance, vulnerabilities and general health of our technical solutions, while improving our E2E engineering outcomes to drive better technical outcomes across BB Tech.
Roles & Responsibilities:
You will be expected to perform the following tasks and responsibilities in a manner consistent with CBA's
Core Responsibilities
Understand our customers' core business objectives and build end-to-end data centric solutions to address them.
Lead or participate in the definition, execution and communication of ETL strategy and technical solution.
Development of data staging, architecture and consuming internal and external application interfaces
Cooperate with business and operational users, other data management staff and infrastructure teams to ensure adherence to client and company guidelines, restrictions and requirements as well as industry standards.
Participate in the full lifecycle of agile projects (ideation through implementation)
Designs technical solutions and consumption patterns for business requirements with increasing complexity.
Adhere to the Code of Conduct. The Code of Conduct sets the standards of behaviour, actions and decisions we expect from our people.
Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks
Influence and guide stakeholders to ensure that solutions are robust, secure and highly available
Uplift the quality of technical solutions by applying industry best practice
Role model continuous improvement mindset in team and project interactions
Contributor to delivery planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy.
Essential Skills:
7-10 years’ experience in design, architecture or development in Analytics and Data Warehousing.
Experience in building end-to-end solutions with the big data platform, Spark or scala programming.
5 years of Solid experience in ETL pipeline building with spark or scala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
Experience in Big data platform for ETL development with AWS cloud platform.
Proficiency in AWS cloud services, specifically EC2, S3, Lambda, Athena, Kinesis, Redshift, Glue, EMR, DynamoDB, IAM, Secret Manager, Step functions, SQS, SNS, Cloud Watch.
Excellent skills in Python-based framework development are mandatory.
Should have experience with Oracle SQL database programming, SQL performance tuning, and relational model analysis.
Experience in ETL Abinitio tools like GDE, Express-IT, Control centre, Meta programming is a plus.
Extensive experience with Teradata data warehouses and Cloudera Hadoop. Proficient across Enterprise Analytics/BI/DW/ETL technologies such as Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, Hive
Analytics & BI Architecture appreciation and broad experience across all technology disciplines.
Experience in working within a Data Delivery Life Cycle framework & Agile Methodology.
Extensive experience in large enterprise environments handling large volume of datasets with High SLAs
Good knowledge in developing UNIX scripts, Oracle SQL/PL-SQL, and Autosys JIL Scripts.
Experience in solution design would be good.
Self-starter, autonomous working
Strong analytical skills and Strong interpersonal & communication skills
Be creative, innovative, pro-active in terms of finding solutions
Problem solving – advanced conceptual, analytical and problem-solving skills to analyses complex information for key insights and present as meaningful information to senior management
Communication – expert oral and written communication skills with ability to lead discussions with a varied stakeholder across levels
Risk Mindset –All CommBank employees are expected to proactively identify and understand, openly discuss and act on current and future risks.
Education/Qualifications
Bachelor’s degree in engineering in Computer Science/Information Technology
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 10/02/2025* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Athena AWS Banking Big Data Computer Science Data management Data Warehousing DynamoDB EC2 Engineering ETL Hadoop Kinesis Lambda Oracle Python Redshift SAS Scala Spark SQL Step Functions Tableau Teradata
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.