Big Data Hadoop Developer
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Senior-level Full Time
Tasks
- Build Hive Spark and MapReduce jobs
- Collaborate with BI, Analytics, and Data Science teams
- Create ETL pipelines for structured and unstructured data
- Design Hadoop data processing solutions
- Develop and optimize batch and real time pipelines
- Ensure data security, governance, and compliance
- Integrate MariaDB or Oracle DB into Hadoop
- Optimize Hive queries and Spark jobs
- Troubleshoot Hadoop job failures and database connectivity
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Ambari | Apache NiFi | Azure HDInsight | Bucketing | Cassandra | Cloud Dataproc | Cloudera Manager | Data Ingestion | ETL | Flume | Git | Google Cloud | Google Cloud Dataproc | HBase | HDFS | Hadoop | Hive | Indexing | Java | Jenkins | Kafka | Linux | MapReduce | Oozie | PL/SQL | Partitioning | Python | SQL | Scala | Shell Scripting | Spark | Sqoop | YARN
Education
N/A
Regions
Countries
States
Related jobs
-
Senior-level Full TimeKuala Lumpur, Malaysia19d ago
-
Software Developer/ Software Programmer(ETL) USD 110K-155KApache NiFi | Automation | Batch Processing | Data Governance | Data WarehouseSenior-level Full TimeKuala Lumpur20d ago
-
Senior-level Full TimeKuala Lumpur20d ago
-
TALEND Developer USD 95K-116KAutosys | Data Transformation | Data pipeline | Database performance | Database performance tuningMid-level Full TimeKuala Lumpur20d ago
-
Executive-level Full TimeShah Alam, Selangor, Malaysia20d ago
-
Developer 2, Programming USD 106K-139KData Provisioning | Data Warehousing | Data integration | Data virtualization | Database ViewsEntry-level Full TimeGeorge Town, Penang, Malaysia26d ago
-
AI Developer MYR 68K-113KAWS | Algorithms | Big Data | Databases | Google CloudAnnual health screening | Career development | Company mobile phone | Continuous training | Employee engagement activitiesMid-level Full TimeKelana Jaya, Selangor, Malaysia R26d ago
-
Mid-level Full TimePetaling Jaya, Selangor, Malaysia29d ago
-
Software Developer/ Software Programmer(ETL) USD 110K-155KApache NiFi | Data Governance | Data Warehouse | ETL | Metadata ManagementSenior-level Full TimeKuala Lumpur1mo ago
-
Senior Embedded (Rust) Software Developer USD 96K-200KAgile | C plus plus | C# | CI/CD | Code reviewFlat hierarchies | International environment | Open door philosophy | Remote workMid-level Full TimeMYS/ Kuala Lumpur1mo ago
-
Agile | Analysis Services | Azure | Denodo | Dynamics AXSenior-level ContractPuchong, Selangor, Malaysia1mo ago