Data Analytics Engineer

Overview

IDC seeks a skilled, motivated, and dedicated Senior Data Engineer and Team Leader to help build some of the most advanced data products. You will design and launch innovative analytical solutions by handling large datasets and developing tools for complex data operations. You'll be part of the Tracker & Spending Guides Data Operations Team, which powers IDC's global data products. If you are passionate about working with data and solving complex problems, this role is for you!

For more than five decades IDC and its businesses have been at the forefront of every major shift in the technology market, providing critical insights for tech suppliers and buyers. Our vision is to make the world a better place through technology.

Responsibilities

• Develop tools and applications for research analysts to assist with data quality analysis, modeling, data cleaning, ML forecasting, and more, primarily using Python.
• Build and optimize Python and Snowflake/PostgreSQL-based data pipelines to process IDC Tracker and Spending Guide data products.
• Design architecture for ingesting, cleaning, and transforming data from multiple sources into a single destination.
• Implement algorithms for data quality checks, outlier detection, and ensure accuracy and performance optimization.
• Prototype, test, and deploy end-to-end data operation pipelines, while optimizing for performance and scalability.
• Develop web-based applications using Streamlit for internal data visualization and reporting.
• Collaborate with global technical and analyst teams to gather requirements and ensure data quality standards are met.

Qualifications

• BA/BS in Computer Science, Mathematics, Statistics, Data Engineering, or equivalent experience (3-5 years) in related fields
• 2-5 years of relevant work experience in a technical role, preferably with experience managing individuals for team outcomes
• Proficiency in Python (required) and experience with SQL-based environments like Snowflake, PostgreSQL, or similar databases (e.g., MySQL, Oracle, Microsoft SQL).
• Strong communication skills for working with cross-functional teams.
• Experience with cloud platforms like AWS, Azure, or Google Cloud (preferred)
• Familiarity with machine learning, Gen AI, and advanced forecasting techniques (preferred)
• Experience developing algorithms for data quality checks and outlier detection (preferred)

IDC is an Equal Opportunity Employer. Applicants and employees are considered for positions and are evaluated without regard to mental or physical disability, handicap, race, color, religion, gender, gender identity and expression, ancestry, national origin, age, genetic information, military or veteran status, sexual orientation, marital status or other categories protected by law.

Why IDC ?IDC is the most respected global technology market research firm. We are changing the way the world thinks about the impact of technology on business and society. Our people, data, and analytics create global technology insights that accelerate customer success. IDC has been recognized for five consecutive years (2020, 2021, 2022, 2023, 2024) by the IIAR as the Analyst Firm of the Year which is one of the highest accolades for the technology market research industry.

Our collaborative, innovative and entrepreneurial culture is the perfect place for you to discover your future.

Recruitment Fraud Notice: IDG/IDC would like to inform you that we conduct our formal communications via corporate email, our Applicant Tracking System iCIMS, LinkedIn messaging, or directly by phone. We do not use any other platform (including Telegram, WhatsApp, Signal, text, instant message, etc.) to communicate with prospective candidates. If you receive any communication outside of our formal communications channels, please ignore it and block the sender or caller. In addition, we do not ask candidates to provide sensitive personally identifiable information such as bank account or social security numbers. If you have been contacted by someone claiming to represent a job offer, please report it as potential job fraud to law enforcement.