Big Data Hadoop Developer
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Senior-level Full Time
Tasks
- Build Hive Spark and MapReduce jobs
- Collaborate with BI, Analytics, and Data Science teams
- Create ETL pipelines for structured and unstructured data
- Design Hadoop data processing solutions
- Develop and optimize batch and real time pipelines
- Ensure data security, governance, and compliance
- Integrate MariaDB or Oracle DB into Hadoop
- Optimize Hive queries and Spark jobs
- Troubleshoot Hadoop job failures and database connectivity
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Ambari | Apache NiFi | Azure HDInsight | Bucketing | Cassandra | Cloud Dataproc | Cloudera Manager | Data Ingestion | ETL | Flume | Git | Google Cloud | Google Cloud Dataproc | HBase | HDFS | Hadoop | Hive | Indexing | Java | Jenkins | Kafka | Linux | MapReduce | Oozie | PL/SQL | Partitioning | Python | SQL | Scala | Shell Scripting | Spark | Sqoop | YARN
Education
N/A
Regions
Countries
States
Related jobs
-
Data Science Developer (C#, .Net Core) DKK 800K-850KASP.NET | Amazon Web Services | Azure DevOps | C# | CI/CDAgile environment | Continuous improvementMid-level Full TimeKuala Lumpur, MY7h ago
-
Developer 2, Programming USD 106K-139KData Provisioning | Data Warehousing | Data integration | Data virtualization | Database ViewsEntry-level Full TimeGeorge Town, Penang, Malaysia5d ago
-
AI Developer MYR 68K-113KAWS | Algorithms | Big Data | Databases | Google CloudAnnual health screening | Career development | Company mobile phone | Continuous training | Employee engagement activitiesMid-level Full TimeKelana Jaya, Selangor, Malaysia R6d ago
-
Mid-level Full TimePetaling Jaya, Selangor, Malaysia8d ago
-
Software Developer/ Software Programmer(ETL) USD 110K-155KApache NiFi | Data Governance | Data Warehouse | ETL | Metadata ManagementSenior-level Full TimeKuala Lumpur11d ago
-
Senior Embedded (Rust) Software Developer USD 96K-200KAgile | C plus plus | C# | CI/CD | Code reviewFlat hierarchies | International environment | Open door philosophy | Remote workMid-level Full TimeMYS/ Kuala Lumpur25d ago
-
Agile | Analysis Services | Azure | Denodo | Dynamics AXSenior-level ContractPuchong, Selangor, Malaysia1mo ago
-
Senior-level Full TimeKuala Lumpur1mo ago
-
Lead Analyst, Process Transformation CAD 120K-170KApache Spark | Databricks | Hadoop | Informatica | PythonSenior-level Full TimeMY-Kuala Lumpur-IT, Malaysia1mo ago
-
Internship - Software Development (Embedded) USD 48K-80KAlgorithms | C# | C++ | Data Structure | Multithreaded programmingCross-cultural collaboration | Mentorship | Networking opportunities | TrainingEntry-level InternshipPetaling Jaya, Selangor, Malaysia1mo ago
-
TALEND Developer USD 95K-115KData Transformation | Data integration | ETL Development | Job Scheduling | Performance TuningMid-level Full TimeKuala Lumpur1mo ago
-
Data Modeling | Database Design | Indexing | Normalization | Query OptimizationSenior-level Full TimeKuala Lumpur, Malaysia1mo ago
-
Associate AI Solutions Engineer USD 102K-170KAPIs | Backend Development | Containerization | Data Processing | DockerHybrid workingMid-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia1mo ago
-
Senior-level Full TimePetaling Jaya (First Avenue), Malaysia1mo ago