Senior Software Engineer, Data Platform
Toronto-York St
Nasdaq
Get the latest stock market news, stock information & quotes, data analysis reports, as well as a general overview of the market landscape from Nasdaq.Reviews system requirements and business processes; codes, tests, debugs and implements software solutions.
Contribute to the evolution of Data Link from a self-curated Marketplace to a SaaS platform
- Design and implement self-service components for the data platform
- Scale the platform to handle various types and sizes of data using open-source software and managed SaaS solutions
- Ensure stability, robustness, and scalability of the data platform and delivery pipeline
- Monitor and optimize performance of business-critical queries and ETL processes
- Develop metrics for end-users to monitor their data flows
- Work with various data systems, write distributed data pipelines, and orchestrate real-time and batch processing
- Have 5-7 years professional experience in a software/data engineering role
- Be able to write high-quality, well-documented, high-performance code
- Proficiency in writing unit and integration tests and troubleshooting failures
- Eagerness to learn new technologies and best practices in data engineering
- Have experience with programming languages: Python, SQL
- Basic knowledge of Kubernetes and Docker
- Experience with Databricks platform: The role requires familiarity with the Databricks ecosystem, including understanding its architecture and components, proficiency in using Databricks notebooks for data processing and analysis, knowledge of Databricks Delta Lake for data storage and management
- Develop and maintain comprehensive data quality processes, monitoring systems, and improvement strategies to ensure the accuracy, consistency, and reliability of data throughout the platform's pipeline.
- Be entrepreneurial and enthusiastic about working in a fast-paced environment
- Have a Bachelor of Computer Science or Computer Engineering or equivalent degree, or equivalent qualifications / experience
Come as You Are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information, or any other status protected by applicable law.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Computer Science Databricks Data pipelines Data quality Docker Engineering ETL Kubernetes Open Source Pipelines Python SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.