Assistant manager Data engineer
Kuala Lumpur, Malaysia
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
New Era Technology
New Era is a Technology Solution Provider, that delivers tech solutions to securely connect people, places, & information around the globe.Join New Era Technology, where People First is at the heart of everything we do. With a global team of over 4,500 professionals, we’re committed to creating a workplace where everyone feels valued, empowered, and inspired to grow. Our mission is to securely connect people, places, and information with end-to-end technology solutions at scale.
At New Era, you’ll join a team-oriented culture that prioritizes your personal and professional development. Work alongside industry-certified experts, access continuous training, and enjoy competitive benefits. Driven by values like Community, Integrity, Agility, and Commitment, we nurture our people to deliver exceptional customer service.
If you want to make an impact in a supportive, growth-oriented environment, New Era is the place for you. Apply today and help us shape the future of work—together.
🌟 Hiring: Assistant Manager, Data Engineering – Malaysia (Client Location) | New Era Technology 🌟
Client Location: Kuala Lumpur
Company: New Era Technology – www.neweratech.com
Work Type: Full-Time, Permanent
🚀 About the Role:
New Era Technology is looking for experienced Assistant Manager, Data Engineering to be deployed at our prestigious client in Malaysia at their Kuala Lumpur office.
The selected candidates will be part of the Digital and Data department will be responsible for system design, development and implementation of regional frontend systems.Provide maintenance and support on production systems.
🛠️ Key Responsibilities:
- Design, develop, document and implement end- to-end data pipelines and data integration processes, both batch and real-time. This include data analysis, data profiling, data cleansing, data lineage, data mapping, data transformation, developing ETL / ELT jobs and workflows, and deployment of data solutions.
- Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes.
- Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of ETL / ELT processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards.
POSITION DESCRIPTION
- Prepare test data, assist to create and execute test plans, test cases and test scripts.
- Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors and internal business stakeholders, to understand data needs, gather requirements and implement data solutions to deliver business goals.
- BAU support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.
KEY PERFORMANCE INDICATORS
- Maturity level on technical skillsets of management and development on big data platform including data modeling design, data transformation, big data programming and performance tuning
- Effectiveness of project contribution, including from technical support, project management and team collaboration perspective, to deliver data lake system on assigned local countries
- Level of understanding on business requirements and capability to transform them into technical solution
- Variety of new technologies (such as Azure and AWS Big Data Solution, Power BI, Tableau, Python and etc) and techniques being learnt that can be applied to solution delivery
EXTERNAL & INTERNAL CONTACTS
- Group Infrastructure Team, Security Teams and Operation Team
- Group Project Team
- Local country Project Team (IT and User)
QUALIFICATIONS / EXPERIENCE
- Bachelor's degree in IT, Computer Science or related Engineering.
- At least 5 years of relevant experience in data engineering or related field
- In-depth understanding of data structures, algorithms, databases, and software engineering.
- Experience in data management and data warehousing technologies (data mart, data lake, lake house)
- Ability to write efficient and scalable code
- Experience with end-to-end data processing pipelines, ETL/ELT, and data warehousing
- Knowledge of distributed systems and experience working with distributed data processing technologies.
- 5+ years of professional experience in implementing operational data stores, data warehouses, data mart and large scale data architectures in Unix and/or Windows environments
- 5+ years of hands-on ETL development experience, including transforming complex data structures from multiple sources
- 5+ years of experience with big data technologies including Azure and AWS, Azure data factory, Databricks, Synapse, Hadoop, Hive, Storm, Presto, and real-time data transformation and processing technologies such as Confluent Kafka, ksqldb, kstream, Apache Flink, and Apache Spark Streaming.
- 5+ years of experience in implementing data models using dimensional modeling and data vault modeling techniques.
- Experience with scripting languages such as Shell, Perl or Python
- Experience with any software development methodologies.
KNOWLEDGE & TECHNICAL SKILLS
- Strong knowledge of various database technologies (RDBMS, NoSQL, and columnar).
- Ability to handle and process different types of data (structured, semi-structured, and unstructured).
- Strong proficiency in at least one programming language such as Python, Java or Scala.
- Knowledge of MDM, Data Governance tools, and Informatica technologies.
- Prior experience in the insurance industry is an advantage.
- Knowledge of data security and privacy best practices, such as encryption and data masking
- DevOps (CI/CD) and data privacy regulations knowledge.
Good to Have
- Experience in API development and integration. E.g. SOAP, RestAPI
- Build and modify APIs(Restful) and programs using Phyton or Java
👤 Preferred Candidate:
- Nationality: Malaysians preferred
- Availability: Immediate joiners or candidates who can join at short notice.
📧 How to Apply:
Send your updated resume to Sravani.Karri@neweratech.com with the subject line:
“Assistant Manager, Data Engineering – Malaysia”
🔗 About Us:
New Era Technology (www.neweratech.com) is a global IT services provider with a footprint in 80+ countries, delivering cutting-edge digital transformation, consulting, and staffing services across industries
New Era Technology, Inc., and its subsidiaries (“New Era” “we”, “us”, or “our”) in its operating regions worldwide are committed to respecting your privacy and recognize the need for appropriate protection and management of any Personal Data that you may provide us. In this, we are also committed to providing you with a positive experience on our websites and while using our products, services and solutions (“Solutions”).
View our Privacy Policy here https://www.neweratech.com/us/privacy-policy/
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: API Development APIs Architecture AWS Azure Big Data CI/CD Computer Science Consulting Data analysis Databricks Data governance Data management Data pipelines Data quality Data Warehousing DevOps Distributed Systems ELT Engineering ETL Flink Hadoop Informatica Java Kafka NoSQL Perl Pipelines Power BI Privacy Python RDBMS Scala Security Spark Streaming Tableau
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.