Data Engineer

Data Engineer

Summary

Data Platform team is looking for a data engineer with a solid technical background to build and support our cloud based data asset platform. The platform enables internal engineers and analysts to effectively create values from data. The team manages data ingestions from various data sources, builds and supports ETL pipelines, defines data consumption patterns, and continuously enhance the robustness and scalability of the data platform.

Job Duties

• Assist in designing, building and optimizing the data platform.
• Implement data integration and pipelines to support data projects across different business units.
• Ensure tools, processes, and services are well-designed, scalable, and reliable.
• Participate in architecture, coding, testing, project planning, deployment, operation and documentation.
• Realize data requirements, automate workflows, and streamline development processes.
• Communicate with stakeholders to gather requirements and discuss technical solutions.

The Person:

• 2+ years of experience in data engineering or a related field
• Must be proficient in Python and SQL. Knowledge of other programming language is a plus
• Understanding of modern data architecture and concepts
• Experience in building data lake, data warehouse, ETL pipelines, data models
• Hands-on experience with data stack on cloud (e.g. S3, Redshift, EMR, Kinesis, DynamoDB, BigQuery, Dataflow).
• Knowledge in big data framework (e.g. Spark) is a plus
• Knowledge in DevOps (e.g. git, CICD, IaC) is a plus
• Exposure to Agile/Scrum methodologies and SDLC practices.
• Ability to learn on-the-fly and take ownership
• Strong communication skill and ready to embrace ambiguity
• Passionate in problem solving and creating value from data
• Effective verbal and written communication in English and Chinese.
• Fresh graduate will also be considered.