Data Engineer

Kuala Lumpur

Encora

Encora provides its clients with tailored innovation software engineering solutions across a wide range of leading-edge technologies.

View all jobs at Encora

Apply now Apply later

Data Engineer


Important Information

Location: Kuala Lumpur Malaysia
Experience: 5 years
Job Mode: Full-time Contract
Work Mode: On-Site
 
Job Summary

Skilled and motivated Data Engineer to join our data infrastructure team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, and data science initiatives. You will work closely with data scientists, analysts, and software engineers to ensure data availability, quality, and integrity across the organization.

 

Responsibilities & Duties 

  • Design, develop, and maintain robust and scalable ETL/ELT pipelines to process structured and unstructured data from various sources.
  • Build and maintain data infrastructure and architecture (e.g., data lakes, data warehouses).
  • Collaborate with data analysts, scientists, and business stakeholders to understand data requirements and deliver data solutions.
  • Ensure data quality and consistency by implementing monitoring and validation processes.
  • Optimize performance and scalability of data systems.
  • Manage data ingestion, transformation, and storage using tools like Apache Spark, Kafka, Airflow, etc.
  • Maintain documentation and ensure compliance with data governance and security standards.
  • Assist with migrating data pipelines and infrastructure to cloud platforms (e.g., AWS, GCP, Azure).

 

Qualifications & Skills

  • Have experience in product / software development and have experience in process and delivery ownership
  • Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services
  • Hands on experience on cloud services and knowledge of data related cloud native services (AWS).
  • Tools and programming languages required to implement data pipelines: SQL, Python / Pandas
  • Tools required to implement automation and monitoring: Shell scripts, scheduling tools such as AirFlow
  • Have experience in ETL tools such as Talend and/or cloud native services
  • Experience implementing reporting using a data platform or reporting software (QuickSight, Power BI,etc.) product / software development
  • Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services

 

About Encora 
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.   
 
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.

 

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0
Category: Engineering Jobs

Tags: Airflow Architecture AWS Azure Data governance Data pipelines Data quality ELT Engineering ETL GCP Hadoop Jupyter Kafka LLMs Pandas Pipelines Power BI Python QuickSight Security Spark SQL Talend Unstructured data

Region: Asia/Pacific
Country: Malaysia

More jobs like this