Core Data Engineer
Tasks
- Automate manual processing steps
- Build and maintain real-time data pipelines
- Collaborate on real time data architecture and design
- Create processing models for fast and slow paths
- Develop quality checks for data products
- Ingest and integrate market data and application logs
- Investigate and onboard new data sources
- Monitor and resolve pipeline issues
- Optimize data products for low latency analytics
Perks/Benefits
- Catered meals
- Conference access
- Continuous learning program
- Gym membership subsidy
- Health insurance
- Massage therapy
- Subsidized gym membership
Skills/Tech-stack
Airflow | Apache Beam | Apache NiFi | Apache Pinot | Apache Spark | BigQuery | ClickHouse | Cloud platform | Dataproc | GKE | Google Cloud | Google Cloud Platform | Kafka | Linux | OLAP | Pandas | Python | SQL | Starrocks
Education
N/A
Roles
Related jobs
-
Automation | DBT | Dagster | Data Architecture | Data EngineeringCommunity initiatives | Flexible benefits | Learning opportunities | Professional development | Wellbeing supportExecutive-level Full TimeHong Kong1d ago
-
API Integration | Agent systems | Agentic Workflows | Cloud Architecture | Cloud deploymentMid-level Full TimeTaipei, Taiwan; Hong Kong4d ago
-
DevOps Engineer HKD 312K-312KAutomation | Backtesting | C++ | Linux | MonitoringAnnual bonus | Annual leave | Certification opportunities | General practitioner coverage | Health insuranceMid-level Full TimeAll Cities, Hong Kong4d ago
-
IT - Infrastructure (Compute & Storage) – VP/AVP HKD 204K-250KAmazon Web Services | Ansible | Azure | CentOS | ChefExecutive-level Full TimeHong Kong5d ago
-
Access reviews | Ansible | Audit compliance | BigFix | Capacity monitoringCommunity initiatives | Flexible benefits | Health and wellbeing programs | Learning opportunities | Professional development opportunitiesExecutive-level Full TimeHong Kong6d ago
-
Senior Data Engineer HKD 119K-185KAI Agents | AI functions | Cortex AI | Data Governance | Data ModelingSenior-level Full TimeHong Kong7d ago
-
Senior GenAI Scientist (Global Marketing AI) HKD 115K-185KAI Foundry | AI Search | APIs | APIs integration | Agentic AIFlexible work environment | Hybrid work | Learning opportunities | Well-being and inclusionSenior-level Full TimeHong Kong, Manulife Tower7d ago
-
Principal Machine Learning Engineer USD 200K-250KAttention Mechanisms | C++ | CUDA | CUDNN | Data PipelinesInsurance benefits | Paid leaveSenior-level Full TimeAmsterdam, Netherlands; Chicago, United States; Hong …8d ago
-
Agile | Analytics engineering | Artificial Intelligence | Business Intelligence | Cloud ComputingMid-level Full TimeHongKong, Hong Kong9d ago
-
Confluence | Excel | Jira | Python | SQLMid-level Contract Full TimeHK-ONE ES 21/F, Hong Kong11d ago
-
API Integration | Cloud Platforms | Data Governance | GenAI | Language ModelsMid-level Full TimePHKL | Berkshire House 23/F, Hong …12d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly laid-back atmosphere | Remote-friendlyMid-level Full TimeHong Kong, Hong Kong13d ago
-
Deep learning | Inference Server | Linux | Machine Learning | NVIDIA GPUEntry-level Full Time InternshipHong Kong, STP13d ago
-
AI Engineer - HR Focus - Internship only HKD 300K-300KArtificial Intelligence | Data Management | Data collection | Data integration | Machine LearningCareer development prospects | Future career opportunity | Inclusive diversity | International Professional Experience | Internship duration 6 monthsEntry-level InternshipHong Kong, Hong Kong14d ago
-
C++ | Distributed Computing | Linear Algebra | Python | Software ArchitectureMid-level Full TimeHong Kong18d ago
-
AWS | Alicloud | Java | Kafka | LinuxEducation subsidy | Healthcare | Learning and development | Meal allowance | Wellness allowanceSenior-level Full TimeHong Kong, Hong Kong SAR; Singapore, …18d ago
-
Acceptance Testing | Case design | Confluence | Excel | JiraPossibility to convert to permanent staff | Renewable contractMid-level Contract Full TimeHK-ONE ES 21/F, Hong Kong19d ago
-
Senior-level Full TimeSingapore | Hong Kong21d ago
-
Entry-level Full Time深圳、上海、北京、中国香港22d ago
-
Curl | HTML | HTTP | JWT | JavaScriptFlexible working hours | In-person work option | Remote work optionEntry-level Full TimeSha Tin, New Territories23d ago
-
AWS | Agile | Apache Airflow | Apache Spark | Batch ProcessingCompany paid health benefits | Employee resource groups | Flexible time off | Free Coaching and Counseling | Free daily snacksExecutive-level Full TimeHong Kong25d ago
-
Associate - Automation Test Engineer (OTC), Post Trade Business Implementation & Analytics - 12-months Contract HKD 300K-300KCucumber | Git | HTML | HTTP | JavaLearning opportunities | TrainingMid-level Full TimeHK-ONE ES 21/F, Hong Kong25d ago
-
Agent Development | Embeddings | Fine Tuning | Generative AI | KubernetesSenior-level Full TimeHong Kong26d ago
-
None Full Time深圳、上海、北京、中国香港28d ago
-
Manager, AI Innovator HKD 300K-300KAI Document Intelligence | Artificial Intelligence | Asana | Axolotl | AzureMid-level Full TimeSun Life Hong Kong - Two …28d ago