BigData Platform Engineer

Bangalore, KA, India

Applications have closed

Prodapt

Prodapt is a leading service provider of digital and network services to the telecom and media industries. Our solutions transform and enhance customer experience.

View all jobs at Prodapt

Overview

We are hiring a BigData Platform Engineer to lead and work with migration team & platform teams. The ideal candidate should have strong experience in Big Data, Hive, Google Cloud Platform (GCP) specifically with BigQuery and Dataproc, as well as proficiency in Linux/Unix environments. 

Responsibilities

  • Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in BigQuery or DataProc platforms.
  • Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc.
  • Grant access to BQ datasets, GCS buckets and Hive tables etc.
  • Work closely with Leads, architects, product owners and PMO’s to enable new use cases in cloud.
  • Administer Cloud platforms (BigQuery and DataProc) and manage reliability of platforms
  • Monitor health of Cloud platforms, proactively identify the issues and address them
  • Monitor the systems, Generate Performance Reports and provide continuous improvements.
  • Develop frameworks to automate platform administration and monitoring tasks.
  • Develop scripts to automate reports and maintenance activities.
  • Work with cross functional teams to set up production environment and enable solutions for business.
  • Debug day to day issues in cloud platforms and provide solutions.
  • Perform Tuning and increase Operational efficiency on a continuous basis.
  • Interact with business users to answer their queries and solve their problems.
  • Able to help and Guide L1 support engineers to fix day-to-day Operational issues.

Requirements

  • Minimum 6+ years of work experience and 4-5 years of work experience in Big Data technologies.
  • Good experience in Level 2, 3 support for performing hot fixes and dealing with platform issues.
  • Experience in working Google cloud platform or other cloud platforms will be plus.
  • Good knowledge about Hadoop platform architecture, Hardware specs, Performance Benchmarking.
  • Require good Unix skills and good knowledge about Networking architecture, Datacenter issues etc.
  • Experience in tool Integration, automation, configuration management in GIT, Jira platforms.
  • Should be proficient in writing shell scripts, automating the scripts and designing scheduler processes.
  • Should be able to understand Python/Scala/Java programs and debug the issues.
  • Excellent oral, written communication and presentation skills, analytical and problem-solving skills.
  • Self-driven, Ability to work independently and as part of a team.

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Architecture Big Data BigQuery Dataproc GCP Git Google Cloud Hadoop Java Jira Linux Python Scala

Region: Asia/Pacific
Country: India

More jobs like this