Senior Data Engineer (AWS, Airflow, DBT & Cloud Data Pipelines)

Bengaluru - EC-2 Gateway campus, India

Synechron

Synechron is an innovative global consulting firm delivering industry-leading digital solutions to transform and empower businesses.

View all jobs at Synechron

Apply now Apply later

Job Summary:
Synechron is seeking an experienced Senior Data Engineer with expertise in AWS, Apache Airflow, and DBT to design and implement scalable, reliable data pipelines. The role involves collaborating with data teams and business stakeholders to develop data solutions that enable actionable insights and support organizational decision-making. The ideal candidate will bring data engineering experience, demonstrating strong technical skills, strategic thinking, and the ability to work in a fast-paced, evolving environment.

Software Requirements:

  • Required:
    • Strong proficiency in AWS services including S3, Redshift, Lambda, and Glue, with proven hands-on experience
    • Expertise in Apache Airflow for workflow orchestration and pipeline management
    • Extensive experience with DBT for data transformation and modeling
    • Solid knowledge of SQL for data querying and manipulation
  • Preferred:
    • Familiarity with Hadoop, Spark, or other big data technologies
    • Experience with NoSQL databases (e.g., DynamoDB, Cassandra)
    • Knowledge of data governance and security best practices within cloud environments

Overall Responsibilities:

  • Lead the design, development, and maintenance of scalable and efficient data pipelines and workflows utilizing AWS, Airflow, and DBT
  • Collaborate with data scientists, analysts, and business teams to gather requirements and translate them into technical solutions
  • Optimize Extract, Transform, Load (ETL) processes to enhance data quality, integrity, and timeliness
  • Monitor pipeline performance, troubleshoot issues, and implement improvements to ensure operational excellence
  • Enforce data management, governance, and security protocols across all data flows
  • Mentor junior data engineers and promote best practices within the team
  • Stay current with emerging data technologies and industry trends, recommending innovations for the data ecosystem

Technical Skills (By Category):

  • Programming Languages:
    • Essential: SQL, Python (preferred for scripting and automation)
    • Preferred: Spark, Scala, Java (for big data integration)
  • Databases/Data Management:
    • Extensive experience with data warehousing (Redshift, Snowflake, or similar) and relational databases (MySQL, PostgreSQL)
    • Familiarity with NoSQL databases such as DynamoDB or Cassandra is a plus
  • Cloud Technologies:
    • AWS cloud platform, leveraging services like S3, Lambda, Glue, Redshift, and IAM security features
  • Frameworks and Libraries:
    • Apache Airflow, dbt, and related data orchestration and transformation tools
  • Development Tools and Methodologies:
    • Git, Jenkins, CI/CD pipelines, Agile/Scrum environment experience
  • Security Protocols:
    • Knowledge of data encryption, access control, and compliance standards in cloud data engineering

Experience Requirements:

  • At least 8 years of professional experience in data engineering or related roles with a focus on cloud ecosystems and big data pipelines
  • Demonstrated experience designing and managing end-to-end data workflows in AWS environments
  • Proven success in collaborating with cross-functional teams and translating business requirements into technical solutions
  • Prior experience mentoring junior engineers and leading data projects is highly desirable

Day-to-Day Activities:

  • Develop, deploy, and monitor scalable data pipelines using AWS, Airflow, and DBT
  • Collaborate regularly with data scientists, analysts, and business stakeholders to refine data requirements and deliver impactful solutions
  • Troubleshoot production data pipeline issues to resolve data quality or performance bottlenecks
  • Conduct code reviews, optimize existing workflows, and implement automation to improve efficiency
  • Document data architecture, pipelines, and governance practices for knowledge sharing and compliance
  • Keep abreast of emerging data tools and industry best practices, proposing enhancements to existing systems

Qualifications:

  • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field; Master’s degree preferred
  • Professional certifications such as AWS Certified Data Analytics – Specialty or related credentials are advantageous
  • Commitment to continuous professional development and staying current with industry trends

Professional Competencies:

  • Strong analytical, problem-solving, and critical thinking skills
  • Excellent communication abilities to effectively liaise with technical and business teams
  • Proven leadership in mentoring team members and managing project deliverables
  • Ability to work independently, prioritize tasks, and adapt to changing business needs
  • Innovative mindset focused on scalable, efficient, and sustainable data solutions

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Agile Airflow Architecture AWS Big Data Cassandra CI/CD Computer Science Data Analytics Data governance Data management Data pipelines Data quality Data Warehousing dbt DynamoDB Engineering ETL Git Hadoop Java Jenkins Lambda MySQL NoSQL Pipelines PostgreSQL Python RDBMS Redshift Scala Scrum Security Snowflake Spark SQL

Perks/benefits: Career development

Region: Asia/Pacific
Country: India

More jobs like this