Senior Data Engineer
Kuala Lumpur, Malaysia
USD 101K-188K (estimate) Senior-level Full Time
Tasks
- Build spark pipelines
- Design data platform features
- Develop data transformations and aggregations
- Document and improve data processes
- Follow data governance and security standards
- Implement data quality checks
- Monitor and troubleshoot pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Amazon S3 | Apache Airflow | Bitbucket | CI/CD | Code Analysis | Confluence | Data Lake | Data Lakehouse | Data Warehousing | Dynamic code analysis | ETL | Elasticsearch | Elasticsearch Kibana | Git | Java | Jenkins | Jira | Kibana | Kubernetes | Maven | OpenShift | Spark | Static Code Analysis
Education
Roles
Regions
Countries
States
Related jobs
-
Senior Storage Engineer USD 100K-105KAWS EC2 | AWS VPC | Active Directory | Amazon EBS | Amazon S3On-call duties | Shift workSenior-level Full TimeMY Ipoh, Malaysia3d ago
-
Mid-level Full TimeKuala Lumpur4d ago
-
Senior Data Engineer CAD 140K-185KAWS | Algorithms | Apache Airflow | Apache Spark | Auto ScalingBirthday leave | Employee assistance programme | FlexWork | GrabFlex | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia4d ago
-
Mid-level Full TimeKuala Lumpur - RedQ, Malaysia4d ago
-
Data Engineering, Consultant USD 119K-180KADLS Gen2 | API Integration | Access Control | Apache Spark | Asset bundlesSenior-level Full TimeMY-Kuala Lumpur-Menara AIA, Malaysia4d ago
-
Senior Data Engineer USD 98K-157KAPI Integration | Azure Data | Azure Data Factory | Azure SQL | Azure SQL DatabaseFlexible work practices | Hybrid work | Insurance coverage | Learning and development | Medical coverageSenior-level Full TimePetaling Jaya, Malaysia4d ago
-
Data platform technical lead USD 115K-183KApache Storm | Automation | Azure | Azure Data Factory | BashDiversity and inclusion | Hybrid workingSenior-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia4d ago
-
Agile | Batch data | Batch data ingestion | Data Ingestion | Data QualityMid-level Full TimeKuala Lumpur, Malaysia4d ago
-
Agile | Batch data | Batch data ingestion | Data Ingestion | Data ModelingMid-level Full TimeKuala Lumpur, Malaysia4d ago
-
Azure Data | Azure Data Factory | BaaN | Data Factory | Data ModelingMid-level Full TimeBayan Lepas, Penang, Malaysia5d ago
-
Data Engineer PLN 150K-276KAgile | Authentication | Azure | Azure Functions | DAXAnnual leave | Birthday leave | Career progression | Company pension | Employee assistance programMid-level Full TimeKuala Lumpur, Malaysia5d ago
-
Lead Software Engineer GBP 32K-35KAWS | AWS Lambda | Amazon ECS | Amazon EKS | Auto ScalingHybrid work | Remote work flexibility | Reward and recognition | Volunteering opportunities | Wellness programsEntry-level Full TimeCyberjaya, Selangor, Malaysia R5d ago
-
Software Engineer I GBP 32K-33KAWS | Angular | CI/CD | Git | JavaEmployee benefits | Hybrid work arrangementEntry-level Full TimeCyberjaya, Selangor, Malaysia5d ago
-
DevOps / Operation Engineer USD 120K-164KAPM | Argo | CI/CD | ELK Stack | GoMedical insurance | Performance bonusMid-level Full TimeKuala Lumpur, WP, Malaysia5d ago
-
Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse AnalyticsAnnual leave | Medical and hospitalization coverage | Medical leave | Performance bonusMid-level Full TimeKuala Lumpur, WP, Malaysia5d ago
-
Engineer, Data Analytics Engineering USD 119K-258KAWS | Azure | Data Engineering | Data Governance | Data QualityMid-level Full TimeBatu Kawan, Penang, Malaysia6d ago
-
Senior Data Governance Engineer USD 128K-162KAmazon Web Services | Automation | Azure | Business glossary | CI/CDSenior-level Full TimeKuala Lumpur, MY6d ago
-
Engineer, Data Analytics Engineering USD 119K-258KAWS | Azure | Big Data | Cloud Computing | Data pipelineMid-level Full TimeBatu Kawan, Penang, Malaysia6d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K8D Problem Solving | Agile | Artificial Intelligence | Automated testing | Cloud ComputingEmployee resource groups | Flexible work environment | Remote work optionSenior-level Full TimeShah Alam, Malaysia6d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K5-why | 8D | Agile | Automated testing | Data GovernanceFlexible work environment | Remote work optionSenior-level Full TimeShah Alam, Malaysia6d ago
-
Data Analytics Quality Engineering Manager USD 162K-200K5 Whys | 8D methodology | Agile | Artificial Intelligence | Automated testingEmployee resource groups | Flexible work environment | Inclusive work environment | Remote work optionSenior-level Full TimeIpoh, Perak, Malaysia6d ago
-
Data Analytics Quality Engineering Manager USD 162K-200K5 Whys | 8D | Agile | Artificial Intelligence | Automated testingFlexible work environment | Remote work optionSenior-level Full TimeBayan Lepas, Penang, Malaysia6d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K5 Whys | 8D | Agile | Artificial Intelligence | Automated testingEmployee resource groups | Flexible work environment | Remote work option | Rotational weekend supportSenior-level Full TimeIpoh, Perak, Malaysia6d ago
-
Senior Data Analytics Quality Engineer USD 156K-190KAgile | Automated testing | Data Governance | Data Modeling | Data PipelinesCareer development opportunities | Employee resource groups | Flexible work environment | Remote work optionSenior-level Full TimeBayan Lepas, Penang, Malaysia6d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K5 Whys | 8D | Agile | Data Governance | Data ModelingFlexible work environment | Remote work optionSenior-level Full TimeShah Alam, Malaysia6d ago