Senior Data Engineer - R01550978

About Brillio:
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction. Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.
Senior Data Engineer

Primary Skills

• MapReduce, HDFS, Spark - Pyspark, ETL Fundamentals, SQL, SQL (Basic + Advanced), Spark - Scala, Python, Data Warehousing, Hive, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, Oozie

Specialization

• Big Data Engineering: Lead Data Engineer

Job requirements

• Job Description: Below    Your Experience • 5+ years of experience in large scale real-time stream processing using Apache Spark with messaging infrastructure like Kafka/Pulsar. • 7+ years of experience on Data Pipeline development, ETL and processing of structured and unstructured data. • 5+ years of experience using NoSQL systems like MongoDB, DynamoDB and SnowFlake /Athena. • Experience with technologies like EMR, S3, Lambda, AWS Fargate, CloudWatch, DataDog. • Experience owning and implementing technical/data solutions or pipelines. • Excellent written and verbal communication skills in English. • Strong work ethic and entrepreneurial spirit. Additional Information - Main skills set that are a must are: 1. Spark with Scala or Python 2. Apache Kafka 3.Snowflake and No-SQL DB experience like MongoDB 4. Experience in AWS cloud services. 5. Solid understanding of Medallion architecture, Parquet/ Iceberg Behavioral Competences • Excellent communication ability to communicate on different levels of seniority. • Team player; enjoying being part of a cross-functional setup. • Ability to perform well on time-critical endeavors and on multiple fronts at the time. • Strong dedication to quality and a 'client' mindset. • A passion for learning and continuous improvement.

 Know what it’s like to work and grow at Brillio: Click here