Principal Data Engineer
Bangalore-Affluence, India
Nasdaq
Get the latest stock market news, stock information & quotes, data analysis reports, as well as a general overview of the market landscape from Nasdaq.Nasdaq is continuously revolutionizing markets and undergoing transformations while we adopt new technologies to develop innovative solutions, constantly aiming to rewrite tomorrow. As Principal Data Engineer, you will be primarily responsible for taking the defined business requirements and provides analytical, modelling, dimensional modeling and testing to provide best outcomes for design against these customer’s requirements.
With this position we offer
You will also be doing analysis, concentrates on understanding the business needs for data and information. The data engineer translates business information needs into data structures that are adaptable, extensible and sustainable.
Role Responsibilities -
Own the design and development of data architecture, data models, and data pipelines.
An equal opportunity to mentor and provide technical guidance in developing technology platform on Databricks.
We contribute to the architecture and design of different platforms as the Nasdaq’s new technologies influences future platform choices.
Provides technical leadership on project teams by identifying, defining, and communicating technical requirements and strategic direction.
Develops data/information quality metrics, researches new technology and develops cases to support enterprise-wide business intelligence solution.
Uses data modeling techniques and tools in analyzing and specifying data structures to be implemented within an application system.
Defines logical views and works with the database administrators to build physical data structures.
Aware of technological trends and competitive landscape and incorporates into crafting solutions.
Provides deep domain and industry expertise to craft and develop build solutions. Is the functional expert that mentors others in the team.
We expect you to have:
- At least 15 years of experience working in data related fields (data engineering, analytics engineering, data scientist)
- 7+ years of experience in data engineering.
- 3+ years of experience in a technical leadership role.
- Extensive experience with SQL and database design.
- Strong experience in Python and Spark.
Proven track record of building and maintaining data pipelines and data warehousing solutions. (Informatica, Data Factory, AWS Glue, etc).
Extensive experience with big data technologies (Spark, Hadoop ecosystem).
Strong background in data governance and security.
Experience with version control systems (Git) and CI/CD processes and tools (Terraform, Jenkins).
Bachelor's/Master's degree or equivalent experience in Computer Science or related field.
It would be great if you have:
- Experience in regulated industries (Finance).
- Experience with real-time streaming technologies.
- Experience with AI/ML tools.
- Databricks certifications.
Does it sound like you?
As the selection process is ongoing, please submit your application in English as soon as possible. We will get back to you in 2-3 weeks.
Come as you are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information or any other status protected by applicable law.
Nasdaq is a leading global provider of trading, clearing, exchange technology, listing, information, and public company services. As the creator of the world's first electronic stock market, its technology powers more than 100 marketplaces in 50 countries. Nasdaq is home to over 4,000 total listings with a market value of approximately $12 trillion.
To learn more, about our business visit business.nasdaq.com. Check out more about our Life at Nasdaq.
Come as You Are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information, or any other status protected by applicable law.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture AWS AWS Glue Big Data Business Intelligence CI/CD Computer Science Databricks Data governance Data pipelines Data Warehousing Engineering Finance Git Hadoop Informatica Jenkins Machine Learning Pipelines Python Security Spark SQL Streaming Terraform Testing
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.