Data Engineer

Data Engineer

Important Information

Location: Kuala Lumpur Malaysia
Experience: 5 years
Job Mode: Full-time Contract
Work Mode: On-Site
 
Job Summary

Skilled and motivated Data Engineer to join our data infrastructure team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, and data science initiatives. You will work closely with data scientists, analysts, and software engineers to ensure data availability, quality, and integrity across the organization.

Responsibilities & Duties 

• Design, develop, and maintain robust and scalable ETL/ELT pipelines to process structured and unstructured data from various sources.
• Build and maintain data infrastructure and architecture (e.g., data lakes, data warehouses).
• Collaborate with data analysts, scientists, and business stakeholders to understand data requirements and deliver data solutions.
• Ensure data quality and consistency by implementing monitoring and validation processes.
• Optimize performance and scalability of data systems.
• Manage data ingestion, transformation, and storage using tools like Apache Spark, Kafka, Airflow, etc.
• Maintain documentation and ensure compliance with data governance and security standards.
• Assist with migrating data pipelines and infrastructure to cloud platforms (e.g., AWS, GCP, Azure).

Qualifications & Skills

• Have experience in product / software development and have experience in process and delivery ownership
• Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services
• Hands on experience on cloud services and knowledge of data related cloud native services (AWS).
• Tools and programming languages required to implement data pipelines: SQL, Python / Pandas
• Tools required to implement automation and monitoring: Shell scripts, scheduling tools such as AirFlow
• Have experience in ETL tools such as Talend and/or cloud native services
• Experience implementing reporting using a data platform or reporting software (QuickSight, Power BI,etc.) product / software development
• Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services

About Encora 
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.   
 
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.