BigData Platform Engineer
Bangalore, KA, India
Applications have closed
Prodapt
Prodapt is a leading service provider of digital and network services to the telecom and media industries. Our solutions transform and enhance customer experience.Overview
We are hiring a BigData Platform Engineer to lead and work with migration team & platform teams. The ideal candidate should have strong experience in Big Data, Hive, Google Cloud Platform (GCP) specifically with BigQuery and Dataproc, as well as proficiency in Linux/Unix environments.
Responsibilities
- Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in BigQuery or DataProc platforms.
- Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc.
- Grant access to BQ datasets, GCS buckets and Hive tables etc.
- Work closely with Leads, architects, product owners and PMO’s to enable new use cases in cloud.
- Administer Cloud platforms (BigQuery and DataProc) and manage reliability of platforms
- Monitor health of Cloud platforms, proactively identify the issues and address them
- Monitor the systems, Generate Performance Reports and provide continuous improvements.
- Develop frameworks to automate platform administration and monitoring tasks.
- Develop scripts to automate reports and maintenance activities.
- Work with cross functional teams to set up production environment and enable solutions for business.
- Debug day to day issues in cloud platforms and provide solutions.
- Perform Tuning and increase Operational efficiency on a continuous basis.
- Interact with business users to answer their queries and solve their problems.
- Able to help and Guide L1 support engineers to fix day-to-day Operational issues.
Requirements
- Minimum 6+ years of work experience and 4-5 years of work experience in Big Data technologies.
- Good experience in Level 2, 3 support for performing hot fixes and dealing with platform issues.
- Experience in working Google cloud platform or other cloud platforms will be plus.
- Good knowledge about Hadoop platform architecture, Hardware specs, Performance Benchmarking.
- Require good Unix skills and good knowledge about Networking architecture, Datacenter issues etc.
- Experience in tool Integration, automation, configuration management in GIT, Jira platforms.
- Should be proficient in writing shell scripts, automating the scripts and designing scheduler processes.
- Should be able to understand Python/Scala/Java programs and debug the issues.
- Excellent oral, written communication and presentation skills, analytical and problem-solving skills.
- Self-driven, Ability to work independently and as part of a team.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Categories:
Big Data Jobs
Engineering Jobs
Tags: Architecture Big Data BigQuery Dataproc GCP Git Google Cloud Hadoop Java Jira Linux Python Scala
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Sr. Data Engineer jobsData Scientist II jobsStaff Data Scientist jobsBI Developer jobsStaff Machine Learning Engineer jobsPrincipal Data Engineer jobsData Manager jobsSenior AI Engineer jobsJunior Data Analyst jobsData Science Intern jobsData Science Manager jobsResearch Scientist jobsBusiness Data Analyst jobsPrincipal Software Engineer jobsData Specialist jobsLead Data Analyst jobsSoftware Engineer II jobsData Analyst Intern jobsSr. Data Scientist jobsData Engineer III jobsBI Analyst jobsJunior Data Engineer jobsDevOps Engineer jobsSoftware Engineer, Machine Learning jobsAI/ML Engineer jobs
Snowflake jobsEconomics jobsLinux jobsOpen Source jobsData Warehousing jobsComputer Vision jobsMLOps jobsGoogle Cloud jobsAirflow jobsNoSQL jobsRDBMS jobsKafka jobsBanking jobsHadoop jobsJavaScript jobsClassification jobsScala jobsScikit-learn jobsPhysics jobsKPIs jobsData warehouse jobsOracle jobsTerraform jobsStreaming jobsGitHub jobs
PostgreSQL jobsScrum jobsPySpark jobsR&D jobsLooker jobsPandas jobsSAS jobsCX jobsBigQuery jobsData Mining jobsDistributed Systems jobsJira jobsdbt jobsRobotics jobsIndustrial jobsRedshift jobsUnstructured data jobsReact jobsMicroservices jobsJenkins jobsData strategy jobsNumPy jobsE-commerce jobsPharma jobsGPT jobs