Tech Lead – Scala/Spark – AVP – C12 - Chennai

We are seeking a Spark, Big Data - ETL Tech Lead for Commercial Card’s Global Data Repository development team. The successful candidate will interact with the Development Project Manager, the development, testing, and production support teams, as well as other departments within Citigroup (such as the System Administrators, Database Administrators, Data Centre Operations, and Change Control groups) for TTS platforms.

He/she requires exceptional communication skills across both technology and the business and will have a high degree of visibility. The candidate will be a rigorous technical lead with a strong understanding of how to build scalable, enterprise level global applications.

The ideal candidate will be dependable and resourceful software professional who can comfortably work in a large development team in a globally distributed, dynamic work environment that fosters diversity, teamwork and collaboration. The ability to work in high pressured environment is essential.

Responsibilities:

• Lead the design and implementation of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform.
• Develop and optimize Spark applications for performance and scalability.
• Responsible for providing technical leadership of multiple large scale/complex global software solutions.
• Integrate data from various sources, including Couchbase, Snowflake, and HBase, ensuring data quality and consistency.
• Experience of developing teams of permanent employees and vendors from 5 – 15 developers in size
• Build and sustain strong relationships with the senior business leaders associated with the platform
• Design, code, test, document and implement application release projects as part of development team.
• Work with onsite development partners to ensure design and coding best practices.
• Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules.
• Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns.
• Compliance with Citi's System Development Lifecycle and Information Security requirements.
• Oversee development scope, budgets, time line documents
• Monitor, update and communicate project timelines and milestones; obtain senior management feedback; understand potential speed bumps and client’s true concerns/needs.
• Stay updated with the latest trends and technologies in big data and cloud computing.
• Mentor and guide junior developers, providing technical leadership and expertise.

Key Challenges:

• Managing time and changing priorities in a dynamic environment
• Ability to provide quick turnaround to software issues and management requests
• Ability to assimilate key issues and concepts and come up to speed quickly

Qualifications:

• Bachelor’s or master’s degree in computer science, Information Technology, or equivalent
• Minimum 10 years of Proven experience in developing and managing big data solutions using Apache Spark. Having strong hold on Spark-core, Spark-SQL & Spark Streaming
• Minimum 6 years of experience in leading globally distributed teams successfully.
• Strong programming skills in Scala, Java, or Python.
• Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc.  
• Proficiency in SQL and experience with relational (Oracle/PL-SQL) and NoSQL databases like mongoDB.
• Demonstrated people and technical management skills.
• Demonstrated excellent software development skills. Strong experiences in implementation of complex file transformations like positional, xmls.
• Experience in building enterprise system with focus on recovery, stability, reliability, scalability and performance.
• Experience in working on Kafka, JMS / MQ applications.
• Experience in working multiple OS (Unix, Linux, Win)
• Familiarity with data warehousing concepts and ETL processes.
• Experience in performance tuning of large technical solutions with significant volumes
• Knowledge of data modeling, data architecture, and data integration techniques.
• Knowledge on best practices for data security, privacy, and compliance.

Key Competencies:

• Excellent organization skills, attention to detail, and ability to multi-task
• Demonstrated sense of responsibility and capability to deliver quickly
• Excellent communication skills. Clearly articulating and documenting technical and functional specifications is a key requirement.
• Proactive problem-solver
• Relationship builder and team player
• Negotiation, difficult conversation management and prioritization skills
• Flexibility to handle multiple complex projects and changing priorities
• Excellent verbal, written and interpersonal communication skills
• Good analytical and business skills
• Promotes teamwork and builds strong relationships within and across global teams
• Promotes continuous process improvement especially in code quality, testability & reliability

Desirable Skills:

• Experience in Java, Spring, ETL Tools like Talend, Ab Initio is a plus.
• Experience of migrating functionality from ETL tools to Spark.
• Experience/knowledge on Cloud technologies AWS, GCP.  
• Experience in Financial industry
• ETL Certification, Project Management Certification
• Experience with Commercial Cards applications and processes would be advantageous
• Experience with Agile methodology

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

------------------------------------------------------

Job Family Group:

------------------------------------------------------

Job Family:

------------------------------------------------------

Time Type:

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.