Lead Data Engineer (Databricks/AWS)
Bangalore-Affluence, India
Nasdaq
Get the latest stock market news, stock information & quotes, data analysis reports, as well as a general overview of the market landscape from Nasdaq.Nasdaq is continuously revolutionizing markets and undergoing transformations while we adopt new technologies to develop innovative solutions, constantly aiming to rewrite tomorrow. As Data Engineering Lead, you will be primarily responsible for taking the defined business requirements and provides analytical, modelling, dimensional modeling and testing to provide best outcomes for design against these customer’s requirements.
You will also be doing analysis, concentrates on understanding the business needs for data and information. The data engineer translates business information needs into data structures that are adaptable, extensible and sustainable.
We are looking for candidates who share those values along with a genuine desire and drive to deliver top technology solutions to today's markets.
Description
- Mentors others in developing the technology platform on Databricks and AWS cloud and provides options to leadership on which platforms make most sense.
- Chip in to the architecture and design of different platforms as the Nasdaq’s new technologies influences future platform choices.
- Is the technical lead on project teams defining needs.
- Develops data/information quality metrics, researches new technology and develops cases to support enterprise-wide business intelligence solution.
- Uses data modeling techniques and tools in analyzing and specifying data structures to be implemented within an application system.
- Defines logical views and works with the database administrators to build physical data structures.
- Aware of technological trends and competitive landscape and incorporates into crafting solutions.
- Provides deep domain and industry expertise to craft and develop build solutions.
- Is the functional expert that mentors others in the team.
Expectations
- At least 10-12 years of experience working in Data Warehouse/Data Lake technologies (Databricks, AWS, or related tools)
- Proven experience in data engineering, with at least 5 years in leadership roles.
- Experienced knowledge of SQL, Python, Spark, and data modeling.
- Consistent track record of building and maintaining data pipelines and data warehousing solutions. (Informatica, Data Factory, AWS Glue, etc).
- Strong background in data governance and security.
- Bachelor's/Master's degree or equivalent experience in Computer Science or related field.
Valuable additional experience
- Terraform
- CI/CD
- Git
- Databricks certifications
Come as You Are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information, or any other status protected by applicable law.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture AWS AWS Glue Business Intelligence CI/CD Computer Science Databricks Data governance Data pipelines Data warehouse Data Warehousing Engineering Git Informatica Pipelines Python Security Spark SQL Terraform Testing
Perks/benefits: Equity / stock options
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.