Senior Staff/Staff Engineer, Data Governance Platform
Singapore, Singapore
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
OKX
OKX - Buy BTC, ETH, XRP and more on OKX, a leading crypto exchange – explore Web3, invest in DeFi and NFTs. Register now and experience the future of finance.About the team:
OKX data team is responsible for the whole data scope of OKG, from techincal selection, architecture design, data ingestion, data storage, ETL, data visualisation to business intelligence and data science. We are data engineers, data analysts and data scientists. The team has end-to-end ownership of most of the data at OKx throughout the whole data lifecycle including data ingestion, data ETL, data warehouse and data services. As a data engineer of the team, you will work with the team to leverage data technologies to empower evidence-based decision-making and improve the quality of the company's products and services.
Responsibilities:
- Responsible for the design and development of core modules of data governance platform, including but not limited to table lifecycle management, metadata management, data quality monitoring, CI/CD toolchain and other systems
- Deeply understand business requirements, be able to deeply participate in product requirement design discussions, independently complete technical solution design, and lead the technical implementation of key functions
- Coordinate cross-team resources and promote project lifecycle management (requirement analysis-development-testing-launch).
- Participate in the development of data governance standards and specifications, precipitate technical documents and best practices
Requirements:
- 8 + years Java server level development experience, proficient in Spring Boot/Spring Cloud, MyBatis and other frameworks
- Familiar with Big data ecosystem technologies (Hadoop/Hive/Spark/Flink, etc.), with experience in data governance platform development preferred
- Master distributed system design, familiar with Middleware such as microservices, message queue (Kafka/RabbitMQ), cache (Redis), etc.
- Capable of abstracting complex business systems and independently designing highly available and scalable technical solutions
- Able to quickly understand business requirements, translate them into feasible technical solutions, and provide product design optimization suggestions
- Excellent cross-team communication skills, able to coordinate multiple resources such as product and operation to promote projects
Good to have:
- Have experience in secondary development of data governance open source projects (Apache Atlas/DataHub, etc.)
- Led the construction of enterprise-level data governance platform from 0 to 1
Perks & Benefits:
- Competitive total compensation package
- L&D programs and Education subsidy for employees' growth and development
- Various team building programs and company events
- Wellness and meal allowances
- Comprehensive healthcare schemes for employees and dependants
- More that we love to tell you along the process!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Big Data Blockchain Business Intelligence CI/CD Crypto Data governance Data quality Data warehouse ETL Flink Hadoop Java Kafka Microservices Open Source RabbitMQ Spark Testing
Perks/benefits: Competitive pay Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.