Senior Data Engineer AWS
IN KA Bengaluru, India
Quantiphi
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Experience : 3-6 Years
Location : Mumbai/ Bangalore/ Trivandrum (Hybrid)
Job Title : Senior Data Engineer
Key Responsibilities:
Responsible to oversee the migration and modernization of the customer’s platform and database services from Google Cloud Platform (GCP) to Amazon Web Services (AWS)
Provide technical guidance and mentorship to the data engineering team
Design a robust AWS architecture for the database services, utilizing services such as Amazon RDS, Amazon Redshift, Amazon Aurora, Amazon Athena and Amazon DynamoDB
Implement migration strategies and modernization processes, ensuring compatibility, performance, and adherence to best practices
Collaborate closely with application and infrastructure teams to facilitate seamless integration of database services
Identifies and implements opportunities for optimization and performance improvements during the migration
Ensure compliance with data security, governance, and regulatory requirements during the migration
Must have skills:
Proven experience in cloud migration and modernization projects, with a strong understanding of AWS and GCP services.
Strong understanding of cloud architecture principles and best practices
Experience with data migration tools and strategies for AWS
Understanding of AWS services such as S3, Redshift, RDS, and Data Pipeline.
Skills in designing data models for both GCP and AWS environments.
Proficiency in ETL (Extract, Transform, Load) processes and tools, including AWS Glue and Apache Beam.
Knowledge of both SQL and NoSQL databases
Proficient in scripting and automation tools using Python, Bash, or similar languages to automate data transfer and to streamline migration processes
Strong ability to work effectively with cross-functional teams
Proficient in documenting migration processes and providing training/support to stakeholders
Experience in project planning, including defining timelines, milestones, and deliverables
Skilled in scoping, planning, and executing data-related projects while adhering to timelines and budgets
Ability to convey data requirements and migration benefits to non-technical stakeholders
Strong documentation skills for creating architectural documents and communicating complex concepts to non-technical stakeholders
Certifications:
For Lead Architects at least 2 Professional or Specialty level AWS certification
For Associate Architects at least 1 Professional or Specialty level AWS Certification
For Senior Data Engineers at least 1 Associate level AWS certification
Good to have skills:
Certifications: Relevant AWS Certifications (e.g., AWS Certified Solutions Architect) are advantageous
Knowledge of big data technologies like Hadoop, Spark and Kafka for handling large datasets
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Athena AWS AWS Glue Big Data DynamoDB Engineering ETL Excel GCP Google Cloud Hadoop Kafka NoSQL Python Redshift Security Spark SQL
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.