Data Engineering Expert
22F The Globe Tower, Philippines
Globe Group
At Globe, our goal is to create a wonderful world for our people, business, and nation. By uniting people of passion who believe they can make a difference, we are confident that we can achieve this goal.
Job Description
We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible to- Create and maintain scalable, maintainable and reliable pipeline that process very large quantities of structured and unstructured data.
- Unify streaming and batch processing modes into one cohesive framework of processing including monitoring and alerting that fit into a unified and reliable Big Data infrastructure.
- Build streaming data pipelines that enable the business to adapt in real-time.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Regularly reviews work with/from peers with a goal of improving personal knowledge of the systems, ensuring that code changes meet business goals and technology best practices.
Key Responsibilities:
- Provides technical expertise, troubleshoots, guides and supports during design, development, testing, production, and post-production
- Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Understand the source system, capture and document business rules
- Provides expert technical knowledge and solutions pertaining to Data integration.
- Identify opportunities to optimize the environment, implement monitoring, quality and validation processes to ensure data accuracy and integrity.
- Conduct unit testing and component integration testing for solutions developed
- Design and implementation of continuous integration and deployment
Skills:
- Apache Spark
- Scala
- Spark query tuning and performance optimization
- Database design and management(both sql and nosql)
- Experience with Big Data Solution on Cloud preferably AWS (S3, Redshift,
Dynamodb, EMR, Glue etc)
- Must be proficiency with Git
- Must have experience in Unit Test/Test Driven Development
- Must have experience with or knowledge of Agile Software Development methodologies
- With excellent problem solving and troubleshooting skills
- With excellent oral and written communication skills with a keen sense of
customer service
QUALIFICATIONS:
Graduate of any data engineering-related bachelor's degree, or
At least 3 years in a data engineering role
Open to work in a hybrid setup and to report to BGC, Taguig
Equal Opportunity Employer
Globe’s hiring process promotes equal opportunity to applicants, Any form of discrimination is not tolerated throughout the entire employee lifecycle, including the hiring process such as in posting vacancies, selecting, and interviewing applicants.
Globe’s Diversity, Equity and Inclusion Policy Commitment can be accessed here
Make Your Passion Part of Your Profession. Attracting the best and brightest Talents is pivotal to our success. If you are ready to share our purpose of Creating a Globe of Good, explore opportunities with us.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs AWS Big Data Data pipelines Data quality DynamoDB Engineering Git NoSQL Pipelines Redshift Scala Spark SQL Streaming Testing Unstructured data
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.