Data Engineer
Tasks
- Aggregate and analyze data
- Build data pipelines
- Build data warehouses and lakes
- Collaborate with data science stakeholders
- Design data architectures
- Develop data ingestion pipelines
- Ensure data quality and integrity
- Ensure data system reliability
- Implement data governance
- Implement data validation and cleansing
- Manage data storage systems
- Optimize data processing workflows
- Process and transform data
- Troubleshoot data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Kinesis | Apache Beam | Apache Flink | Apache Kafka | Apache NiFi | Apache Spark | Data Cleansing | Data Governance | Data Ingestion | Data Lakes | Data Pipelines | Data Quality | Data Validation | Data Warehousing | Java | NoSQL Databases | Python | Relational databases | Scala
Education
Roles
Related jobs
-
Mid-level Full TimeJohor, Malaysia21h ago
-
Senior-level Full TimeKuala Lumpur, Malaysia21h ago
-
Data Engineer Intern USD 42K-55KApache Spark | Data Visualization | ELT | ETL | NoSQLHands-on experience | Industry networking | Multicultural environment | Project coordination experienceEntry-level Full Time InternshipMalaysia1d ago
-
Amazon Web Services | CI/CD | Data Pipelines | Databricks | EKSHybrid workSenior-level Full TimeKuala Lumpur, Malaysia3d ago
-
Manufacturing Engineer – Data Science USD 81K-116KAWS | Anomaly Detection | Azure | CI/CD | Cause analysisCross-functional collaboration | Development curriculum | Mentorship | Structured onboardingEntry-level Full TimePasir Gudang, Malaysia3d ago
-
Executive, Data Analytics EUR 95K-110KAnalytics engineering | BigQuery | Cloud platform | DBT | Data GovernanceDiscounted flights | Discounts on eateries | Growth opportunities | Unlimited training | Vacation timeExecutive-level Full TimeKuala Lumpur, Federal Territory of Kuala …3d ago
-
AI Data Engineer USD 125K-209KAmazon Redshift | Anomaly Detection | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimePenang Bayan Lepas, Malaysia3d ago
-
AWS | Airflow | Automated retraining | CI/CD | Context learningMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …3d ago
-
Configuration & Asset Data Governance Lead 1 USD 113K-170KData Governance | Data Management | Data Quality | Data governance frameworks | Governance frameworksSenior-level Full TimeKuala Lumpur, MY, 504704d ago
-
Senior Data Engineer USD 119K-165KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon AthenaCareer development | Flexible working arrangements | Hybrid work arrangement | Paid parental leave | Partner leaveSenior-level Full TimeMY: Kuala Lumpur - Bangsar South …4d ago
-
Senior-level Full TimeKuala Lumpur, Federal Territory of Kuala …4d ago
-
Machine Learning Engineer (4023) INR 3000K-5000KA/B | A/B Testing | AML | AWS SageMaker | Anomaly DetectionSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …4d ago
-
Engineer, Data Analytics Engineering (AI/ML) USD 70K-110KApache Spark | DVC | Detectron2 | Docker | GitEntry-level Full TimeBatu Kawan, Penang, Malaysia6d ago
-
Mid-level Full TimePetaling Jaya, MY6d ago
-
Mid-level Full TimePetaling Jaya, MY6d ago
-
Machine Learning Engineer - APAC USD 71K-126KA/B | A/B Testing | Agentic development | B testing | CI/CDBenefits for family | Flexible working arrangements | Learning and development resourcesMid-level Full TimeMalaysia-LN Kuala Lumpur6d ago
-
Data Science Engagement Lead USD 124K-186KAWS | Agile | Artificial Intelligence | Azure | CI/CDDiversity and inclusion | Flexible working hours | Growth opportunities | Paid parental leave | Paid time offSenior-level Full TimeCyberjaya-Wisma Shell, Malaysia6d ago
-
None Full TimePenang 15, Penang, Malaysia6d ago
-
Senior-level Full TimePetaling Jaya, MY6d ago
-
Machine Learning Engineer - APAC USD 71K-130KA/B | A/B Testing | B testing | CI/CD | CalibrationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeMalaysia-LN Kuala Lumpur6d ago
-
Senior Machine Learning Engineer (ACE) USD 152K-234KA/B | A/B Testing | B testing | Data Analysis | Data MiningBirthday leave | FlexWork | Medical insurance | Parental leave | Term life insuranceSenior-level Full TimePetaling Jaya, Malaysia7d ago
-
Senior IT Pillar Specialist USD 130K-188KAPI Integration | CI/CD | Cloud deployment | Containerization | Data GovernanceSenior-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …10d ago
-
Senior Informatica Consultant / Data Analyst Lead USD 114K-162KALDON | Bitbucket | Cause analysis | Change and Release | Change and Release ManagementSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …10d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Laid back environment | Portfolio and LinkedIn submission support | Remote friendly distributed workMid-level Full TimeKuala Lumpur, Malaysia11d ago
-
SAS Viya Production Support /SAS Application Support USD 85K-116KALDON | Bitbucket | Control-M | Jenkins | LinuxSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …11d ago