Senior / Lead Data Engineer
Tasks
- Build and maintain production data pipelines with Apache Airflow
- Champion reliability practices
- Decompose ambiguous problems into data solutions
- Design scalable data pipelines
- Develop dbt models tests and documentation
- Drive dimensional modelling snapshots and SCDs
- Evaluate new streaming and real time patterns
- Improve pipeline observability alerting and SLA monitoring
- Mentor engineers with design reviews pairing and documentation
- Own medallion architecture bronze to silver to gold
- Partner with AI ML team for governed data products
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Flink | BigQuery | Change Data Capture | DBT | Data Capture | Data Modeling | Dbt Documentation | Dimensional Modeling | GCP | GCS | GKE | Helm | IAM | Kafka | Kubernetes | PubSub | Python | SCD | SQL | Streaming
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Senior / Lead Data Engineer HKD 119K-175KApache Airflow | BigQuery | Cloud Storage | DBT | Data GovernanceSenior-level Full TimeHong Kong22h ago
-
Mid-level Full TimeChina - Hong Kong1d ago
-
AI Models | Blockchain | Data Analysis | Decentralized applications | JavaSenior-level Full TimeHong Kong2d ago
-
(Senior) AML Manager, AI development HKD 600K-750KAML Monitoring | Data Analysis | Data Dictionary | Data Governance | Data PreprocessingSenior-level Full TimeHong Kong2d ago
-
Digital & Intelligent Specialist (Risk Management) HKD 312K-586KAPI Orchestration | Agent Frameworks | Algorithms | Chain-of-Thought | Chain-of-Thought promptingMid-level Full TimeHong Kong2d ago
-
Data Scientist | Capital Markets HKD 425K-586KActive Learning | Agentic Workflows | Data Governance | Data Modeling | Fine TuningMid-level Full TimeChina - Hong Kong3d ago
-
Machine Learning Engineer, Asia (Global Marketing AI) HKD 312K-550KAI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI SearchFlexible work environment | InclusionMid-level Full TimeHong Kong, Manulife Tower3d ago
-
Excel | Machine Learning | Power Automate | Power BI | PythonOnsite workEntry-level InternshipNew Territories, Hong Kong4d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous work culture | Career growth opportunities | Friendly work atmosphere | Impactful product work | Remote work environmentMid-level Full TimeHong Kong, Hong Kong4d ago
-
C++ | Data Versioning | Distributed Training | Docker | Experiment trackingMid-level Full TimeHong Kong6d ago
-
Campaign Management | Customer Segmentation | Data Governance | Data Visualization | Data analyticsSenior-level Full TimeHong Kong7d ago
-
APIs | Agent systems | Cloud platform | Cost Per Request | CrewAIMid-level Full TimeTaipei, Taiwan; Hong Kong8d ago
-
Apache HBase | Apache Hadoop | Apache Hive | Apache Kafka | Apache SparkRemote work | Work from homeSenior-level Full TimeHong Kong R8d ago
-
Async Programming | Data Ingestion | Data Validation | Data Warehouse | ELTEntry-level Full TimeHong Kong8d ago
-
Access Control | Audit compliance | Automation | Backup and Recovery | Capacity PlanningMid-level Full TimeSun Life Hong Kong - Two …8d ago
-
Mid-level Full TimeSun Life Hong Kong - Two …8d ago
-
Consultant - AI Engineer HKD 300K-300KAI Foundry | AWS Bedrock | AWS SageMaker | Anthropic API | Azure AICareer growth | Performance-driven culture | Training programsMid-level Full TimeWan Chai, Hong Kong Island, Hong …10d ago
-
AI Engineer HKD 312K-480KAI Governance | API Design | Agentic AI | Agile | Backend FrameworksAnnual leave | Medical benefits | Retirement benefits schemeMid-level Full TimeHong Kong11d ago
-
Airflow | Ansible | BGP | CI/CD | Cisco IOSMid-level Full TimeHong Kong14d ago
-
Computational Biologist (at the rank of Senior Technical Officer) (several posts) in Bioinformatics Core HKD 150K-200KBioinformatics | Cell analysis | Data analytics | Machine Learning | Multi-OmicsAnnual leave | Continuing professional development | Medical benefits | On campus library access | On-campus gym accessSenior-level Full TimeHong Kong14d ago
-
Agency Data Science, Principal HKD 132K-187KAgentic AI | Analytics | Compliance | Dashboarding | Data EnrichmentSenior-level Full TimeHK-AIA Airside, Hong Kong15d ago
-
Mid-level Full TimeHong Kong18d ago
-
Mid-level Full Time深圳、上海、北京、中国香港22d ago
-
Senior Data Engineer HKD 48K-120KAlibaba Cloud | Alibaba Cloud Hologres | Apache Doris | Apache Flink | Apache SparkSenior-level Full TimeHong Kong, Hong Kong SAR23d ago
-
API Development | AWS Bedrock | Agentic Architectures | Azure OpenAI | Data GovernanceSenior-level Full TimeHong Kong24d ago