Assistant Manager, Data Engineering
Bangalore, India
Ocwen Financial Corporation
Onity is committed to helping our customers save money, build equity and stay in their homes.Requisition Template
POSITION SUMMARY: We are seeking an experienced Data Engineer to lead a small team of data engineers in leveraging AWS native technologies such as Lambda and Glue to build a data Lakehouse environment. The ideal candidate will have a strong background in data engineering, a deep understanding of AWS services, and proven leadership skills
JOB FUNCTIONS AND RESPONSIBILITIES
- Lead and mentor a team of data engineers, fostering a collaborative and innovative environment.
- Design, develop, and maintain scalable data pipelines using AWS native technologies including AWS Glue, Lamda etc.
- Implement best practices for data management, including data quality, data governance, and data security.
- Ensure high standards by reviewing architecture, design, and code.
- Collaborate with cross-functional teams to deliver and operate large scale, distributed services in the cloud
- Optimize data workflows for performance and cost-efficiency.
- Own system architecture, scalability, reliability, and performance
- Stay updated with the latest advancements in AWS technologies and data engineering practices
EDUCATION / EXPERIENCE
- BE/B Tech/MSc/MCA – with Specialization in Computer Science/Information Systems.
- 5+ years of non-internship professional software development experience
- Experience with AWS components to build and expand lake house in AWS
- Experience building Python programs across Glue ETL jobs and Lambda functions
- Design & Build S3 buckets, tiers, lifecycle policies, as strategic storage layer for Data Lake
- Experience building applications based on data in both Relational databases (e.g. MySQL), NoSQL databases (e.g. DynamoDB, MongoDB) and filesystems (e.g. S3, HDFS)
- Require 3+ hands-on experience on AWS S3, Spark,Glue ETL & Catalog, Lamba Functions, Athena & Kafka
- 2-3 years of experience in writing SQL Queries.
- Certified on one of - Solution Architect, Data Engineer or Data Analytics Specialty by AWS
WORK SCHEDULE OR TRAVEL REQUIREMENTS
No travel requirements. Mid Shift (2PM – 11PM)
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Athena AWS AWS Glue Computer Science Data Analytics Data governance Data management Data pipelines Data quality DynamoDB Engineering ETL HDFS Kafka Lambda MongoDB MySQL NoSQL Pipelines Python RDBMS Security Spark SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.