Technical Lead, AI & Data, Technology Consulting

We are seeking a highly skilled and experienced Technical Lead to join our dynamic team. The ideal candidate will have a strong background in ETL engineering in Azure and Spark -based frameworks. As an Technical Lead, you will be responsible for leading the design, development, and implementation of ETL processes and data integration solutions to support our data analytics and business intelligence initiatives.

Key Responsibilities:

• Lead the design, development, and implementation of ETL pipelines to extract, transform, and load data from various sources into data warehouses and data lakes using Azure Data Factory/ Synapse, Pyspark, SQL
• Experience in files, API’s and streaming based ingestion.
• Familiarity with metadata-based ingestion frameworks
• Design routines to capture data quality and apply corrections
• Monitor and optimize ETL processes for performance, scalability, and reliability.
• Troubleshoot and resolve data integration issues in a timely manner.
• Understands the technical integration touchpoints with other solution components such as front end applications and  data governance tools
• Collaborate with data architects, data scientists, and business stakeholders to understand
• Mentor and guide junior ETL engineers and provide technical leadership to the team.
• Stay up-to-date with the latest trends and best practices data integration technologies.

Key Skills and Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field. Master's degree preferred.
• 6 to 8 years of experience as a Technical Lead in Azure Data Engineering with strong expertise in ETL engineering and data integration techniques.
• Proficiency in PySpark
• Experience in implementation of data platforms in Singapore Government Commercial Cloud (GCC)
• Strong SQL skills and experience with relational databases and data warehousing solutions.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to work in a fast-paced, dynamic environment and manage multiple priorities.

Preferred Qualifications:

• Experience with Azure cloud-based data platforms
• Certifications in Azure data engineering or related areas.