Senior Data Engineer
Bangkok, Bangkok, Thailand
NocNoc
ตลาดซื้อขายวัสดุและของแต่งบ้านพร้อมบริการช่างติดตั้งครบวงจร พบกับ พื้นไม้ลามิเนต กระเบื้องปูพื้น กระเบื้องยาง วอลล์เปเปอร์ ผ้าม่าน จากแบรนด์ชั้นนำMission for this role
As the senior data engineer at NocNoc, you will play a crucial role in maintaining and improving the highly reliable and scalable data platform as the foundation of the company's data strategy. You must be self-directed and comfortable supporting the needs of multiple teams, systems, and products. You should be excited by the prospect of applying modern data stack and emerging technologies to drive our data platform and data initiatives.
Responsibilities:
- Design, create and maintain the new and existing optimal data pipelines to efficiently ingest, clean, transform, and aggregate data from various sources
- Design and implement dimensional data models in data warehouse and data mart
- Optimize data pipeline performance to maintain the speed,reliability and scalability
- Contribute to the development of in-house ETL framework
- Develop data platform tools for data quality, data observability and data management
- Maintain, optimize and improve an existing data platform features
- Design and implement additional data infrastructure upon product requests
- Research and introduce new data technologies to the team
- Collaborate with cross-functional teams including data analysts, data scientists, product managers and software engineers to identify data opportunities, involve in architecture design and support their data needs.
Qualifications:
- At least 4 years of experience in data engineer or related role
- Strong coding (Python, SQL) and testing skills and experience with common Python frameworks such as Poetry, pytest, and type hinters.
- Strong software development skill : Docker, Kubernetes, OOP, SOLID, TDD, CI/CD
- Experience with provisioning AWS services, infrastructure, network and security
- Experience with data orchestration tools e.g. Airflow
- Experience with distributed computing system e.g. Spark, Trino
- Knowledge of Infrastructure as a Code : Terraform
- Experience with relational databases and NoSQL e.g. MySQL, Postgres, MongoDB, Elasticsearch
- Knowledge of data lakehouse and open table format is a plus e.g. Iceberg, Hudi, Delta
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture AWS CI/CD Data management Data pipelines Data quality Data strategy Data warehouse Docker Elasticsearch ETL Kubernetes MongoDB MySQL NoSQL OOP Pipelines PostgreSQL Python RDBMS Research Security Spark SQL TDD Terraform Testing
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.