Senior Data Engineer - Databricks
IN KA Bengaluru
Quantiphi
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Must have skills:
3+ years’ of hands-on experience in delivering big data solutions
Experience with AWS - EMR, Redshift, Lambda, DynamoDB, S3, RDS, SQS, Glue
Experienced in using Airflow or Step Functions for orchestration
Experience using Pyspark APIs and Inbuild functions
Experience building and deploying cloud-based solutions at scale
Experience in SQL and Query optimisation
Good to have skills :
Prior experience in migrating (on-prem to cloud) and processing large amounts of data
Experience in implementing transactional data lake on the cloud using Hudi, Iceberg, or Delta Lake tables
Experience in Redshift optimization and implementing the industry's best practices
Experience in data loading to Redshift, heavy upserts, and WLM expertise
Experience in Databricks
Experience with Snowflake Data Warehouse
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs AWS Big Data Databricks Data warehouse DynamoDB Excel Lambda PySpark Redshift Snowflake SQL Step Functions
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.