Hadoop Administrator
Tasks
- Administer Apache YARN scheduling and resource allocation
- Administer and monitor HDFS
- Analyze logs and identify root causes
- Configure authentication and authorization
- Implement DistCp replication and DR cluster setup
- Implement access controls and audit logs
- Install and configure Hadoop clusters
- Manage HDFS storage replication and data balancing
- Manage Hive metastore and query tuning
- Monitor cluster health and resource utilization
- Optimize Hive queries and execution plans
- Perform cluster migration and data validation
- Plan and manage backup and disaster recovery
- Troubleshoot Hadoop and job failures
- Tune YARN queues and capacity scheduler
- Upgrade Hadoop clusters
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Spark | Apache Tez | Apache YARN | CentOS | DistCp | Hadoop Distributed File System | Hadoop Distributed File System HDFS | Linux | RHEL | Shell Scripting | Ubuntu
Education
N/A
Roles
Related jobs
-
Senior Database Administrator INR 1500K-3000KAutomation | Clustering | Database Upgrades | Database migrations | Database performanceOut-of-hours supportSenior-level Full TimeBengaluru, Karnataka, India2d ago
-
Associate TSE II INR 1000K-1800KAWS | Active Directory | Authentication | Azure | BenchmarkingFertility assistance | Hybrid work model | Parental leaveMid-level Full TimeGurugram4d ago
-
Senior System Administrator II [Storage Engineer] INR 1000K-1890KAWS EBS | AWS S3 | Ansible | Ceph | DASMid-level Full TimeBengaluru6d ago
-
Senior Database Administrator@ PEOPLE10 (Remote) INR 2800K-4000KAWS | Agile methodologies | Backup & Recovery | Database Backup | Database ClusteringCareer growth opportunities | Remote work | Skill development opportunitiesSenior-level Full TimeBengaluru, India R6d ago
-
MySQL Database Administrator INR 3000K-4000KAWS | Automation | Bash | Clustering | Database BackupCertification programs | Health insurance | Language courses | Mentorship programs | Professional development opportunitiesSenior-level Full TimeBengaluru, KA, India R7d ago
-
Senior Staff Server and Storage engineer INR 1500K-3000KAWS | Active Directory | Azure | Capacity Planning | Commvault24x7 on-call rotation | End-user trainingSenior-level Full TimeOffice - Bangalore IT/BT Park, India8d ago
-
Scality Storage Engineer INR 2486K-3500KAIX | Backup administration | Block Storage | CMDB | Cause analysis24x7 rotational shift coverage | Health and wellbeing benefits | Hybrid work schedule | Professional development programsSenior-level Full TimeBengaluru, Karnātaka, India15d ago
-
Scality Storage Engineer INR 2486K-3500KAIX | Advisory Board | Block Storage | Capacity Planning | Cause analysis24/7 rotational shifts | Health benefits | Hybrid work | Inclusive work environment | Professional developmentSenior-level Full TimeBengaluru, Karnātaka, India15d ago
-
Senior MSSQL Database Administrator | 6+ Years | Remote INR 2000K-2750KAmazon Web Services | Backup and Recovery | Data Migration | Data Modeling | Database AdministrationRemote workSenior-level Full TimeBengaluru, KA, India R22d ago
-
SAS Administrator INR 1400K-1978KAmazon Web Services | Ansible | Azure | Bash | Change Management24x7 shift work | 24x7x365 on call rotation | Training mentoring and best practicesMid-level Full TimePune, India23d ago
-
Amazon Web Services | DNS | ITIL | Jenkins | Linux24x7 shift rotation | 4 days work week | Night shift rotation | Zoom incident coordinationMid-level Full TimeBangalore, Karnataka23d ago
-
Database Administrator INR 1000K-1500KASM | AWS | AWS Managed Databases | Azure | Azure ManagedFlexible work hours | On-call supportMid-level Full TimeOff Embassy Golf Links Business Park, …26d ago
-
Lead Database Engineer INR 2520K-3380KAutomation | Backup & Recovery | Capacity Planning | Cause analysis | Database AdministrationCareer Development Programs | Elective benefits | Inclusive communities | Leadership training | On-demand coursesSenior-level Full TimeChennai, India28d ago
-
Sr. Database Engineer INR 2876K-3380KAnsible | Automation | Backup & Recovery | Bash | Capacity PlanningCareer Development Programs | Elective benefits | Inclusive peer communities and activities | Leadership training | Life Empowerment Assistance ProgramSenior-level Full TimeChennai, India28d ago
-
Oracle Database Administrator INR 1000K-2000K10046 tracing | ADDM | ADDR | ASH | AWRHybrid work model | Multicultural teams | Well-being programs | Work-life balance | Worldwide career opportunitiesMid-level Full TimeBangalore, India30d ago
-
Associate Vice President - Product Engineering - DevOps/DBA INR 1000K-1500KAWS | Apache Kafka | Apache Tomcat | Auto Scaling | AzureMid-level Full TimeMumbai, Maharashtra, India1mo ago
-
Technical Specialist-Cloud & Infra Engg INR 500K-2400KAWS DMS | AWS IAM | AWS SCT | AWS Schema Conversion Tool | Amazon Aurora24/7 on-call supportSenior-level Full TimeINDIA - HYDERABAD - BIRLASOFT OFFICE, …1mo ago
-
Sr Progress DBA INR 1000K-2200KAccess Management | AppServer | Backup and Restore | Capacity Planning | Data ArchitectureSenior-level Full TimeIndia - Bangalore - 5th floor, …1mo ago
-
Engineering Manager - DBA (Vendor) INR 1000K-1500KAWS Aurora | AWS DynamoDB | AWS RDS | Amazon S3 | Backup and RecoveryMid-level Full TimeNoida, Uttar Pradesh1mo ago
-
Senior PostgreSQL DBA / Database Platform Engineer INR 1500K-3440KAWS | Ansible | Automation | Azure | Azure MonitorSenior-level Full TimeChennai, IN1mo ago
-
Senior Oracle Database Administrator INR 500K-2000KAWS | Access Control | Active Data Guard | Ansible | AuditingSenior-level Full Timebangalore, India1mo ago
-
MS SQL Senior DBA INR 1000K-2125KAlwaysOn | Amazon Web Services | Azure | Backup and Recovery | Cloud platformSenior-level Full Timehosur road bangalore, India1mo ago
-
Database Administrator, PESDB INR 1500K-2300KAWS | Access Control | Automation | Database performance | Database performance tuningSenior-level Full TimeHyderabad, Telangana, IND1mo ago