Senior Data Engineer

Job Summary:

We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience to join our offshore team in India. The ideal candidate should have expertise in data engineering, strong hands-on experience with the SODA Data Quality Platform, and excellent communication skills to collaborate with global stakeholders.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Implement and manage data quality frameworks using the SODA Data Quality Platform to ensure data accuracy and reliability.
• Collaborate with data analysts, data scientists, and business teams to understand data requirements.
• Work with various data storage technologies such as AWS, Azure, GCP, SQL, and NoSQL databases.
• Optimize data workflows for performance, scalability, and security.
• Monitor, troubleshoot, and resolve data pipeline issues proactively.
• Ensure compliance with data governance, security, and best practices.
• Provide mentorship and technical guidance to junior data engineers.

Required Skills & Qualifications:

• 8 + years of experience in Data Engineering, Big Data, or related fields.
• Expertise in SODA Data Quality Platform for data validation, monitoring, and anomaly detection.
• Strong proficiency in SQL, Python, Spark, and other data processing frameworks.
• Hands-on experience with cloud platforms (AWS, Azure, or GCP) for data processing and storage.
• Proficiency in data pipeline orchestration tools like Airflow, dbt, or similar.
• Knowledge of data warehousing concepts (Snowflake, Redshift, BigQuery, etc.).
• Strong understanding of data governance, security, and compliance standards.
• Excellent problem-solving and analytical skills.
• Strong communication skills with the ability to work with global teams and stakeholders.

Nice to Have:

• Experience with Kafka, Kinesis, or similar streaming technologies.
• Knowledge of machine learning model deployment and MLOps.
• Exposure to DevOps and CI/CD for data engineering workflows.