Bigdata Engineer -Spark
Remote
Marktine Technology Solutions Pvt Ltd
This is a remote position.
Responsibilities:- As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies.
- Technical Design and development of ETL/Hadoop and Analytics services /components
- Contribute in end to end architecture and process flow
- Understand Business requirement and publish reusable designs
- Result oriented approach with ability to provide apt solutions.
- Proficient in performance improvement & fine-tuning ETL and Hadoop implementations
- Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies.
- Can work independently with minimum supervision.
- Strong analytical and problem solving skills
- Experience/Exposure to SQL, advanced SQL skills
Requirements
Skills Set:- Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies.
- Hands on experience with batch data ingestion (Sqoop)
- Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch)
- Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli)
- Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra)
- Understanding of Agile methodologies as well as SDLC life-cycles and processes.
- Strong Understanding of Data warehousing and lakes
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Categories:
Big Data Jobs
Engineering Jobs
Tags: Agile Architecture Avro Cassandra Data Warehousing Elasticsearch ETL Hadoop HBase HDFS MongoDB NoSQL Parquet RDBMS SDLC Spark SQL
Region:
Remote/Anywhere
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Engineer II jobsPrincipal Data Engineer jobsPrincipal Data Scientist jobsData Manager jobsContent writer - Freelance AI Tutor jobsWriter - Freelance AI Tutor jobsData Science Manager jobsData Scientist II jobsJunior Data Analyst jobsResearch Scientist jobsBusiness Data Analyst jobsSr Data Engineer jobsSenior Machine Learning Researcher jobsSr. Data Scientist jobsSoftware Engineer, Machine Learning jobsBI Analyst jobsLead Data Analyst jobsData Science Intern jobsJunior Data Engineer jobsData Engineer III jobsBusiness Intelligence Engineer jobsAzure Data Engineer jobsCopywriter - Freelance AI Tutor jobsData Analyst II jobsMLOps Engineer jobs
Economics jobsLinux jobsSnowflake jobsHadoop jobsOpen Source jobsRDBMS jobsPhysics jobsBanking jobsJavaScript jobsComputer Vision jobsMLOps jobsData Warehousing jobsScala jobsKafka jobsNoSQL jobsGoogle Cloud jobsAirflow jobsSAS jobsData warehouse jobsOracle jobsClassification jobsKPIs jobsPostgreSQL jobsStreaming jobsScikit-learn jobs
R&D jobsGitHub jobsScrum jobsData Mining jobsTerraform jobsLooker jobsCX jobsPySpark jobsPandas jobsDistributed Systems jobsJira jobsIndustrial jobsRobotics jobsReact jobsRedshift jobsBigQuery jobsMySQL jobsJenkins jobsMicroservices jobsUnstructured data jobsMatlab jobsdbt jobsE-commerce jobsData strategy jobsGPT jobs