Data Engineer (MDM APIs)

We are looking for an experienced and highly skilled Data Engineer to join our dynamic team. The successful candidate will have a strong background in API development, AWS services, and data processing. You will play a key role in building and maintaining our data infrastructure, ensuring efficient ETL processes, and supporting our data warehousing initiatives.

Key Responsibilities:

• Design, develop, and maintain APIs for seamless data integration and access.

• Leverage AWS services such as Lambda, Glue, S3, and EC2 to create scalable, reliable data pipelines.

• Work with NoSQL databases and manage data in various formats, particularly JSON.

• Develop and execute ETL processes to transform raw data into actionable insights.

• Write and optimize SQL queries for data extraction and analysis.

• Collaborate with cross-functional teams to gather data requirements and ensure data quality.

• Support data warehousing solutions using Snowflake or similar technologies.

• Monitor, troubleshoot, and optimize data pipelines and workflows for maximum efficiency.

Qualifications:

• Proficient in Python for data processing and scripting.

• Strong hands-on experience with AWS services, especially Lambda, Glue, S3, and EC2.

• Familiarity with NoSQL databases and data modeling concepts.

• Solid understanding of ETL processes and data warehousing principles.

• Strong experience in writing and optimizing SQL for data manipulation and analysis.

• Knowledge of Snowflake or other cloud-based data warehousing solutions is an advantage.

• Excellent problem-solving skills with a keen attention to detail.

• Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams.

Preferred Skills:

• API development, AWS (Lambda, Glue, S3, EC2)

• Familiarity with NoSQL databases and JSON data formats

• Python programming for ETL and data processing

• Expertise in SQL and data warehousing (Snowflake or similar)