ETL/ELT Data Integration Engineer
Kochi, KL, India
McFadyen Digital
McFadyen Digital guides B2B organizations through transformative digital commerce strategies & future-ready technologies, navigating the best course to success.Company Description
McFadyen Digital is the leading advisor and implementer of eCommerce Marketplace solutions. During 15 years of implementing marketplaces, we’ve built dozens of platforms that cumulatively generate billions of dollars of gross merchandise value (GMV). We’re honored to have supported 10% of the Fortune 500 with their digital marketplace initiatives. Over 250 global brands like ABB, AB InBev, ACCO, Albertsons, American Red Cross, American Eagle Outfitters, US Army, US Agriculture Dept, (and many more) have entrusted their digital transformations to McFadyen. We operate global offices across the US, Brazil, and India. McFadyen Digital has been a trusted employer for 35 years and believes that people are the most important part of our company. We’re proud of our Great Place to Work certification.
Learn more about us at our website: www.mcfadyen.com
Job Description
McFadyen Digital is seeking an experienced ETL Integration Engineer to design, build, and optimize data pipelines that support our eCommerce marketplace solutions. This role will be responsible for integrating multi-source data from ERP, CRM, PIM, and eCommerce platforms into cloud-based data warehouses and analytics tools. The ideal candidate will have expertise in ETL/ELT processes, data modeling, and cloud platforms such as AWS, Azure, Google Cloud, and Snowflake.
The ETL Integration Engineer will collaborate closely with data architects, engineers, and analysts to ensure data integrity, security, and efficiency in large-scale commerce-driven data environments.
Responsibilities
Top 5 Responsibilities:
- Data Pipeline Development & Maintenance
- System & API Integration:
- Data Synchronization & Orchestration
- Data Consistency & Integrity Assurance
- Performance Monitoring & Optimization
Additional Responsibilities:
Design, develop, test, and optimize ETL/ELT workflows for data ingestion, transformation, and delivery.
Implement real-time and batch processing pipelines for efficient data movement.
Integrate APIs and external vendor systems with TSN data services.
Support data exchange between ERP platforms (SAP, Oracle) and third-party applications.
Implement bi-directional data sync processes to ensure accurate data flow between interconnected systems.
Develop workflow automation for streamlined data orchestration.
Enforce data validation, error handling, and logging mechanisms.
Ensure compliance with data governance and quality standards.
Continuously monitor ETL pipelines to identify and resolve performance bottlenecks.
Improve system scalability and efficiency for high-volume data transactions.
Hands-on experience in ETL/ELT development, data integration, and pipeline monitoring.
Proficiency in working with APIs, databases, and data transformation tools.
Strong knowledge of ERP systems (SAP, Oracle) and vendor platforms (e.g., AeroXchange).
Expertise in handling large-scale data sets while ensuring integrity and consistency.
Ability to troubleshoot and optimize integration workflows for performance and reliability.
Qualifications
- 6+ years of hands-on experience with ETL/ELT tools such as dbt, Apache Airflow, Informatica, Talend, or Fivetran in a cloud or hybrid environment.
- Expertise in SQL and database technologies (SQL, NoSQL, Graph databases) with experience in data modeling, schema design, and query optimization.
- Strong cloud experience with platforms like AWS Redshift, Snowflake, Google BigQuery, and Azure Synapse for large-scale data integration.
- Understanding of data security measures, including role-based access control (RBAC), row-level security (RLS), column-level security (CLS), and dynamic data masking (DDM).
- Experience integrating enterprise applications, including ERP, CRM, OMS, and PIM systems, into a centralized data ecosystem.
Additional Information
- Knowledge of big data and streaming technologies such as Apache Kafka, Spark, or Hadoop is a plus.
- Familiarity with BI and analytics tools (Power BI, Tableau, Looker, Google Analytics, Adobe Analytics).
- Understanding of AI/ML-driven data pipelines for predictive analytics and personalized customer insights.
- Experience with data governance, metadata management, and MDM frameworks.
- Excellent problem-solving skills, communication, and stakeholder management to work across multiple teams.
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
- Certifications such as AWS Certified Data Analytics, Google Professional Data Engineer, or Snowflake Data Architect are a plus.
What We Can Offer You:
- A career with thought leaders who literally wrote the book on Marketplace Best Practices.
- A career in the fast-paced world of retail eCommerce, digital marketplaces, and platform businesses.
- A career with first movers who are deploying new business models and strategies worldwide.
- A career in a flat management structure without a rigid hierarchy and bureaucracy.
- A career in a culture that rewards creativity and innovation, risk-taking, and teamwork.
Our Core Values: Client Focus, Owning the Outcome, Adaptable, Caring
McFadyen’s goal is to ensure that our clients are able to maximize the return on their technology investment by providing better service to their clients, partners and internal teams. At McFadyen we truly believe our employees are our most valuable asset. Across our locations in the US, Brazil, and India, we offer a world class work culture that enables top notch delivery for some of the world’s most influential companies.
McFadyen Digital is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under federal, state, or local law, where applicable.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs AWS Azure Big Data BigQuery Computer Science Data Analytics Data governance Data pipelines dbt E-commerce ELT Engineering ETL FiveTran GCP Google Cloud Hadoop Informatica Kafka Looker Machine Learning NoSQL Oracle Pipelines Power BI Redshift Security Snowflake Spark SQL Streaming Tableau Talend
Perks/benefits: Career development Flat hierarchy
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.