Data Engineer (Data Lakehouse)

Join Trend ‧ Join New Generation

趨勢科技 - 全球雲端資安領航者 / 全亞洲最大軟體公司 / 企業版圖橫跨五大洲 / 趨勢全球研發基地在台灣 
===============================================================

Overview

The XDR capabilities of Trend Micro’s Vision One platform provide context-aware of the investigation, recording, and reporting of system-level activities. It collects detailed activity data from kernel mode, user mode, and/or native system events across multiple security layers, including endpoint, servers, cloud workloads, email, and networks.

Search Data Lake plays as one key component to process hundreds of billions of activity data collected from Trend Micro Endpoint products per day and collect detection logs from different TrendMicro products. We also provide solutions for internal applications to efficiently discover the potentially infected endpoints

Requirement

• Bachelor degree or above majored in computer science-related.
• 3+ years’ experience in data engineer
• Strong programming experience in scalable ETL pipeline using Apache Spark and Java with a focus on performance-critical systems.

Personality

• Good teamwork and problem-solving skills.
• Aggressive working attitude.
• Willing to take challenges and take actions with agility.
• Staying with the newest technologies.

Responsibility

• Work closely with stakeholders for requirement discussion, cross-team integration and troubleshooting.
• As a full-cycle developer responsible for delivery of features from planning, design, implement, test, deploy and operate.
• Automate and improve development and release processes.

Big Plus

• Familiar with public cloud technology in Azure and/or AWS
• Experience with open table format design, implementation and maintenance
• Experience with compute-storage decoupled architecture, MPP query engine is plus

===============================================================
連結智慧 守護世界 --- Connected Intelligence for Securing a Connected World