Technical Architect (AWS Glue)

Gurugram, Haryana, India

Srijan Technologies

Your trusted Drupal partner Srijan (now as Material) continues to help brands drive digital transformation through data, AI, Cloud and platform engineering.

View all jobs at Srijan Technologies

Apply now Apply later

Location: Gurugram,Haryana,India

Position- Technical Architect (AWS Glue) Job Description

 

·  Design, build, and maintain scalable and efficient data pipelines to move data between cloud-native databases (e.g., Snowflake) and SaaS providers      using AWS Glue and Python

· Implement and manage ETL/ELT processes to ensure seamless data integration and transformation

· Ensure information security and compliance with data governance standards

· Maintain and enhance data environments, including data lakes, warehouses, and distributed processing systems

· Utilize version control systems (e.g., GitHub) to manage code and collaborate effectively with the team

Primary Skills:

· Enhancements, new development, defect resolution, and production support of ETL development using AWS native services

· Integration of data sets using AWS services such as Glue and Lambda functions.

· Utilization of AWS SNS to send emails and alerts

· Authoring ETL processes using Python and PySpark

· ETL process monitoring using CloudWatch events

· Connecting with different data sources like S3 and validating data using Athena.

· Experience in CI/CD using GitHub Actions

· Proficiency in Agile methodology

· Extensive working experience with Advanced SQL and a complex understanding of SQL.

Secondary Skills:

· Experience working with Snowflake and understanding of Snowflake architecture, including concepts like internal and external tables, stages, and masking policies.

Competencies / Experience:

· Deep technical skills in AWS Glue (Crawler, Data Catalog): 10+ years.

· Hands-on experience with Python and PySpark: 5+ years.

· PL/SQL experience: 5+ years

· CloudFormation and Terraform: 5+ years

· CI/CD GitHub actions: 5+ year

· Experience with BI systems (PowerBI, Tableau): 5+ year

· Good understanding of AWS services like S3, SNS, Secret Manager, Athena, and Lambda: 5+ years

· Additionally, familiarity with any of the following is highly desirable: Jira, Gi

 

About US:-

We turn customer challenges into growth opportunities.

Material is a global strategy partner to the world’s most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.

We use deep human insights, design innovation and data to create experiences powered by modern technology. Our approaches speed engagement and growth for the companies we work with and transform relationships between businesses and the people they serve.

 

Srijan, a Material company, is a renowned global digital engineering firm with a reputation for solving complex technology problems using their deep technology expertise and leveraging strategic partnerships with top-tier technology partners. Be a part of an Awesome Tribe

 

Why work for Material

In addition to fulfilling, high-impact work, company culture and benefits are integral to determining if a job is a right fit for you. Here’s a bit about who we are and highlights around What we offer.

 

Who We Are & What We Care About:-

  • Material is a global company and we work with best-of-class brands worldwide. We also create and launch new brands and products, putting innovation and value creation at the center of our practice. Our clients are in the top of their class, across industry sectors from 
    technology to retail, transportation, finance and healthcare.
  • Material employees join a peer group of exceptionally talented colleagues across the company, the country, and even the world. We develop capabilities, craft and leading-edge market offerings across seven global practices including strategy and insights, design, data & analytics, technology and tracking. Our engagement management team makes it all hum for clients.
  • We prize inclusion and interconnectedness. We amplify our impact through the people, perspectives, and expertise we engage in our work. Our commitment to deep human understanding combined with a science & systems approach uniquely equips us to bring a 
    rich frame of reference to our work.
  • A community focused on learning and making an impact. Material is an outcomes focused company. We create experiences that matter, create new value and make a difference in people's lives.
     

What We Offer:-

  • Professional Development and Mentorship.
  • Hybrid work mode with remote friendly workplace. (6 times in a row Great Place To Work (Certified).
  • Health and Family Insurance.
  • 40+ Leaves per year along with maternity & paternity leaves.
  • Wellness, meditation and Counselling sessions.
Apply to this job
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0
Category: Architecture Jobs

Tags: Agile Architecture Athena AWS AWS Glue CI/CD CloudFormation Data governance Data pipelines ELT Engineering ETL Finance GitHub Jira Lambda Pipelines Power BI PySpark Python Security Snowflake SQL Tableau Terraform

Perks/benefits: Career development Health care Parental leave Startup environment Team events

Region: Asia/Pacific
Country: India

More jobs like this