Senior Data Engineer - Databricks
IN KA Bengaluru
Quantiphi
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Must have skills:
3+ years’ of hands-on experience in delivering data solutions
Experience with Databricks implementations - developing data pipelines using PySpark
Experience in Databricks Workspaces,Notebooks, Delta Lake, APIs
Experience in Python, Scala
Experience in advanced SQL and Query optimization
Experience in implementing data integration projects using ETL
Experience building and deploying cloud-based solutions at scale by ingesting data from sources like DB2
Good to have skills :
Experience with AWS services - S3,Redshift,Secrets Manager
Experience in implementing data integration projects using ETL (preferably Qlik Replicate & QlikCompose)
Experience in using Airflow or Step Functions for orchestration
Exposure to IaC tools like Terraform and to CI/CD tools
Prior experience in migrating (on-prem to cloud) and processing large amounts of data
Experience in implementing data lake and data warehouse on cloud
Experience in implementing the industry's best practices
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs AWS CI/CD Databricks Data pipelines Data warehouse DB2 ETL Excel Pipelines PySpark Python Qlik Redshift Scala SQL Step Functions Terraform
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.