Lead Engineer Big Data
Uttar Pradesh, Noida, India
- Zenon AI is a global boutique consulting firm and a leading AI partner for Fortune 500 firms. We partner with clients across the globe to identify their highest-value opportunities, address their most critical challenges, and transform their enterprises using advanced analytics and data science.
- Work with business and technology teams to analyze and assess business requirements and develop technical blueprints.
- Develop cloud enabled, highly scalable Big Data applications using technologies such as Spark, Scala, and open-source tools.
- Designing data models using RDBMS and NoSQL
- Leveraging industry best practices and experience and recommend solutions including solution architecture and design.
- Adhere to high design and coding standards, policies, and procedures.
- Willing to explore and learn new technologies.
- 7+ years of hands-on expertise using Big Data technologies and Frameworks.
- Min 4 years of relevant experience as Big Data Engineer
- Min 4 years of hands-on solid experience on Spark with Scala and Python
- Solid Experience in implementing Spark RDD Transformations, actions to
implement business analysis. - Hands on experience on Hadoop framework and other Big Data technologies like HDFS, Oozie, Airflow, Hive or Impala.
- Good hold on any cloud platform among AWS, Azure or GCP
- Good hold on container-based frameworks like Docker and Kubernetes
- Strong Problem-Solving, Analytical, and programming experience using Spark, Scala, RDD, DB2, Hadoop, APIs.
- Debugging applications to ensure low-latency and high-availability.
- Solid working experience with Databases like PostgreSQL or MySQL and writing optimized SQL queries.
- Well versed with Design patterns and various architectural patterns
- Good to have exposure on writing APIs using Java based frameworks like Spring Boot
- Good knowledge of agile methodology of Software development.
- Excellent communication and presentation skills.
- BS / MS in Computer Science or equivalent
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow APIs Architecture AWS Azure Big Data Computer Science Consulting Consulting firm DB2 Docker GCP Hadoop HDFS Java Kubernetes MySQL NoSQL Oozie Open Source PostgreSQL Python RDBMS Scala Spark SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.