Big Data Platform Administrator (Kafka / Hadoop / MongoDB)
Tasks
- Administer Apache NiFi pipelines
- Administer Hadoop platforms
- Administer Kafka platforms
- Administer MongoDB clusters
- Administer OpenSearch Elasticsearch platforms
- Administer Redis clusters
- Maintain runbooks
- Maintain technical documentation
- Manage incidents
- Monitor system health
- Participate in on-call support
- Participate in shift rotation
- Patch clusters
- Perform security governance support
- Provide Level 2 production support
- Provision clusters
- Resolve production issues
- Scale clusters
- Support real time payment transaction processing
- Support streaming infrastructure
- Troubleshoot platform issues
- Tune performance
Perks/Benefits
Skills/Tech-stack
AWS | AWS EMR | Apache Kafka | Apache NiFi | ETL | Elasticsearch | Flume | HBase | HDFS | Hadoop | Hive | JVM | Kerberos | Linux | MapReduce | MongoDB | Oozie | OpenSearch | PAM | Python | RAID | Redis | Shell | Sqoop | Virtual Machines | YARN
Education
N/A
Related jobs
-
Amazon Web Services | Apache Spark | Azure DevOps | CI/CD | Cloud platformOn-site flexibility | Remote work flexibilitySenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
Intern, Data Engineering & Platform SGD 36K-50KData Aggregation | Data Cleansing | Data Enrichment | Data Modeling | Data NormalizationEntry-level Full Time InternshipSLA-REVENUE HOUSE LEVEL 11, Singapore6d ago
-
Enterprise Data Delivery Lead SGD 132K-150KAgile | Audit management | Azure | Change Control | Cloud ComputingSenior-level Full TimeSingapore, SG11d ago
-
Senior-level Full TimeSingapore, Singapore, Singapore15d ago
-
Data Platform Manager SGD 120K-167KAPI | Access Management | Benchmarks | Data Governance | Data ModelingSenior-level Full TimeSingapore, Singapore, Singapore18d ago
-
Data Platform and Engineering Manager, SEAA SGD 120K-143KAccess Control | Data Governance | Data Lakehouse | Data Lineage | Data MartsMid-level Full TimeSINGAPORE OFFICE, Singapore22d ago
-
Database Administrator (Contract) SGD 88K-88KAWS | Always On | Backup and Recovery | CIS Baselines | Database AutomationMid-level Contract Full TimeMAS: MAS Building, Singapore22d ago
-
Data Platform Engineer SGD 160K-228KAKS | Apache Iceberg | Apache Ranger | Apache Spark | Azure DevOpsSenior-level Full TimeSingapore, SG1mo ago
-
Archival | Automation | Backup Retention | Backup and Recovery | Capacity Planning24x7 support teamMid-level Full TimeSingapore1mo ago
-
AWS | Automation | Backup and Recovery | Capacity Management | Cloud StorageSenior-level Full TimeSingapore1mo ago