Big Data Hadoop Developer
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Senior-level Full Time
Tasks
- Build Hive Spark and MapReduce jobs
- Collaborate with BI, Analytics, and Data Science teams
- Create ETL pipelines for structured and unstructured data
- Design Hadoop data processing solutions
- Develop and optimize batch and real time pipelines
- Ensure data security, governance, and compliance
- Integrate MariaDB or Oracle DB into Hadoop
- Optimize Hive queries and Spark jobs
- Troubleshoot Hadoop job failures and database connectivity
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Ambari | Apache NiFi | Azure HDInsight | Bucketing | Cassandra | Cloud Dataproc | Cloudera Manager | Data Ingestion | ETL | Flume | Git | Google Cloud | Google Cloud Dataproc | HBase | HDFS | Hadoop | Hive | Indexing | Java | Jenkins | Kafka | Linux | MapReduce | Oozie | PL/SQL | Partitioning | Python | SQL | Scala | Shell Scripting | Spark | Sqoop | YARN
Education
N/A
Regions
Countries
States
Related jobs
-
Agentic AI Engineer, AI Automation EUR 54K-76KAWS | Agentic AI | Agile | Authentication | AzureAnnual leave | Birthday day off | Employee resource groups | Flexible end times | Flexible start timesMid-level Full TimeKuala Lumpur5d ago
-
Data Administrator USD 85K-120KDAX | Data Modeling | Multidimensional modeling | Power BI | Power PivotMid-level Full TimeKuala Lumpur, MY, Malaysia11d ago
-
AI Coding Agents | AI coding | Agent systems | ClickHouse | Code AnalysisCross-functional team collaboration | Mandarin language support collaborationMid-level Full TimeFederal Territory of Kuala Lumpur, Federal …13d ago
-
Senior-level Full TimeKuala Lumpur, Malaysia1mo ago
-
Software Developer/ Software Programmer(ETL) USD 110K-155KApache NiFi | Automation | Batch Processing | Data Governance | Data WarehouseSenior-level Full TimeKuala Lumpur1mo ago
-
Developer 2, Programming USD 106K-139KData Provisioning | Data Warehousing | Data integration | Data virtualization | Database ViewsEntry-level Full TimeGeorge Town, Penang, Malaysia1mo ago
-
AI Developer MYR 68K-113KAWS | Algorithms | Big Data | Databases | Google CloudAnnual health screening | Career development | Company mobile phone | Continuous training | Employee engagement activitiesMid-level Full TimeKelana Jaya, Selangor, Malaysia R1mo ago
-
Mid-level Full TimePetaling Jaya, Selangor, Malaysia1mo ago
-
Software Developer/ Software Programmer(ETL) USD 110K-155KApache NiFi | Data Governance | Data Warehouse | ETL | Metadata ManagementSenior-level Full TimeKuala Lumpur1mo ago