Data Engineer (Cloudera, Hadoop, Spark, Scala)

Overall Summary:

We are seeking a seasoned Data Engineer with expertise in Cloudera, Hadoop, and Spark to develop and optimize data ingestion pipelines. This role is ideal for a professional with a strong background in building and managing large-scale data infrastructures, specifically in a dynamic environment such as the banking sector.

Key Responsibilities:

• Design, construct, install, test, and maintain highly scalable data management systems, ensuring optimal extraction, transformation, and loading (ETL) of data from diverse data sources using SQL, Spark, and Cloudera technologies.
• Build high-performance algorithms, predictive models, and prototypes using Spark and Scala to support data analytics initiatives.
• Manage and deploy interactive Hive queries for data analysis and manipulation.
• Ensure data privacy and compliance with data governance standards and regulatory requirements.
• Collaborate with stakeholders, including Executive, Product, Data, and Design teams, to address data-related technical issues and support their data infrastructure needs.
• Work closely with data scientists to transform raw data and integrate algorithms and models into automated processes.

Software Requirements:

• Proficient in Spark, Scala, and Hive, with hands-on experience in Cloudera Data Platform (CDP).
• Strong experience in building and optimizing big data pipelines, architectures, and datasets.
• Solid experience with Spark SQL and ANSI SQL for data manipulation and analysis.
• Familiarity with data pipeline and workflow management tools.

Category-wise Technical Skills:

• Big Data Technologies: Expertise in Cloudera, Hadoop ecosystem, and Spark frameworks.
• Data Management: Strong understanding of ETL processes and data ingestion techniques.
• Programming Languages: Proficient in Scala and Spark for data processing and algorithm development.
• Data Analysis: Experience with Hive and SQL for querying data and generating insights.

Experience:

• 7 to 10 years of experience in data engineering, with a strong focus on Cloudera, Hadoop, Spark, and Scala.
• Experience in the banking sector, with a preference for experience in Payments or Financial Crime.
• Proven track record of supporting and collaborating with cross-functional teams in a fast-paced environment.

Day-to-Day Activities:

• Design and implement scalable data pipelines and ETL processes.
• Optimize existing data architectures and workflows for performance and efficiency.
• Collaborate with data scientists and analysts to support data-driven decision-making.
• Conduct regular maintenance and updates of data management systems.
• Participate in team meetings to discuss project progress, challenges, and solutions.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Relevant certifications in big data technologies (e.g., Cloudera Certified Developer for Apache Hadoop) are a plus.

Soft Skills:

• Strong project management and organizational skills, with the ability to manage multiple tasks and deadlines.
• Excellent communication and interpersonal skills to collaborate effectively with various stakeholders.
• Proactive and solution-oriented mindset, with strong analytical and problem-solving abilities.
• Ability to thrive in a dynamic environment and work well under pressure.

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice