Data Engineer - Software Consultant

We exist to make it better. 

We’re a new generation software company based in Hyderabad, helping to scale digital businesses to disrupt global utility retail markets. We provide technology development, customer experience and process optimisation services to support our award-winning utility retailers in New Zealand and Australia. 

It’s an exciting time where traditional utilities need to innovate. Consumers expect companies to do good for their employees, customers, local communities, and for the future of the planet (all while offering seamless user experience that’s great value). Our strategy recognises that the exceptional technology we create makes us one of the best consumer facing businesses in our industry.

Purpose of the Job

We are seeking a highly skilled and experienced Data Engineer with expertise in Python, SQL and AWS. The ideal candidate will have over 5+ years of extensive experience in demonstrating expertise in data engineering methodologies, data pipelines, and AWS cloud-based data solutions. The successful candidate will play a crucial role in ensuring the timely delivery of high-quality data solutions within budget constraints.

Responsibilities

• Data Pipeline Development: Design, develop, and deploy robust and scalable data pipelines using Python. Achieving the set SLOs for data processing.
• AWS Data Services: Utilize a deep understanding of AWS services (e.g., S3, Glue, Lambda, Athena, DMS, RDS, Bedrock) to design and manage cloud-based data platforms.
• Data Integration: Implement and optimize data integration processes from various sources into data lakes and data warehouses on AWS.
• Secure Data Implementation: Development and implementation of robust security within the data lifecycle on AWS. Good knowledge in data security practices, vulnerability management, and the ability to incorporate security measures into data pipelines.
• Problem Solving: Proactively identify data challenges and propose innovative solutions to address them. Troubleshoot complex data issues and provide resolutions to ensure project success in a timely manner.

 Outcomes

• High productivity with data quality and security intact.
• Improved data accessibility and collaboration across the organization.
• Continuous improvement in data engineering processes and methodologies.
• Quality data deliverables and effective operational support in managing the data infrastructure in production environments on AWS.

Desired Skills

• Having expertise in data engineering, data pipelines, and cloud-based data solutions on AWS.
• Proven programming ability in SQL, Python and database knowledge.
• Extensive experience in AWS data services such as S3, Athena, Glue, Lambda, DMS, RDS, Bedrock etc.
• Experience in data modeling and ETL processes.
• Strong expertise in data pipeline development and optimization on AWS.
• Working knowledge of data warehousing solutions on AWS.
• Working knowledge of Linux Ubuntu environment is a plus.
• Familiarity with data testing frameworks.
• Experience with data visualization and BI tools is a plus and will be considered an added advantage.
• Monitoring and achieving the set SLOs for the data teams.
• Should have experience working in an agile development model, delivering data solutions every sprint.
• Excellent written and verbal communication skills with an ability to collaborate with cross-functional teams.
• Understanding the data requirements, designing the data solutions, and delivering it with the help of various teams each sprint.
• High proficiency with data engineering practices, tools, and workflows.
• Continuously discover, evaluate, and implement new data technologies to maximize data processing efficiency.

Qualifications required:

B.E/B.Tech(CSE) / M.E/M.Tech(CSE) / MCA - Computer Science / Information Technology/Data Science.

Our vision is to be the most loved company wherever we play.

At the heart of our business is a purpose led culture. We’re a community at heart, and we know our people are unstoppable when they have the empowerment to come up with the answers. Here’s some of the benefits we give:

• Flexible working
• Growth academy and internal career opportunities - we grow our people while we grow our company
• Competitive salary
• Five extra days of paid leave every year to do the things that matter to you
• A paid volunteer day every year to give back to your community
• Parental leave that’s above and beyond legal requirements

Want to help us make it better? Apply and we’ll be in touch.