Senior Data Engineer
Tasks
- Build ingestion pipelines from APIs S3 and SFTP into Snowflake
- Build transformation pipelines in Snowflake using dbt
- Contribute to system design backlog refinement and roadmap planning
- Create governed reusable data models to simplify consumption and reduce compute costs
- Curate and model internal portfolio market and web data
- Design build and maintain cloud data platform infrastructure
- Implement engineering best practices with CI CD testing documentation linting and maintainability
- Maintain data quality SLAs using automated testing validation and anomaly detection
- Partner with investment and risk teams to drive centralized data adoption
- Support day to day operations for data quality vendor SLAs and incidents
- Tune SQL queries for performance
Perks/Benefits
- N/A
Skills/Tech-stack
API | AWS | Airflow | Anomaly Detection | Automated Validation | BigQuery | CI/CD | DBT | Data Modeling | Data Quality | Data Quality Testing | Databricks | Quality testing | Query Optimization | S3 | SCD2 | SFTP | SQL | SQLMesh | Snowflake | Terraform
Education
N/A
Roles
Related jobs
-
Senior Manager, Machine Learning Engineer, Asia HKD 115K-185KApache Spark | Azure | Azure OpenAI | CI/CD | Data DriftCareer learning and growth | Flexible work environment | Inclusion and well-being supportSenior-level Full TimeHong Kong, Manulife Tower1d ago
-
Agile | Analytics engineering | BI Dashboards | Cloud Computing | Data EngineeringMid-level Full TimeHongKong, Hong Kong1d ago
-
Quantitative Developer (C++) HKD 300K-300KAlgorithms | Backtesting | C++ | Data Structures | FPGAFree meals | Hybrid working | Paid time off | Social events | Volunteer opportunitiesMid-level Full TimeHong Kong, Shanghai2d ago
-
APIs | AWS | Automation Testing | Azure | Best practicesAnniversary bonus | Annual leave | Annual performance bonus | Company activities and events | Health insuranceSenior-level Full TimeHong Kong, Hong Kong, Hong Kong … R3d ago
-
Senior Data Engineer, Compliance Data Platform SGD 139K-143KAuditability | Data Lineage | Data Modeling | Data Quality | Data immutabilityCompany events | Education subsidy | Healthcare | L and D programs | Meal allowanceSenior-level Full TimeHong Kong, Hong Kong SAR; Singapore, …3d ago
-
Staff Data Engineer, Finance Data Platform SGD 171K-206KAirflow | Anomaly Detection | Audit Trail | Data Lineage | Data ModelingEducation subsidy | Healthcare coverage | L and D programs | Meal allowances | Team building programsSenior-level Full TimeHong Kong, Hong Kong SAR; Singapore, …3d ago
-
Senior Data Management Professional - Data Engineering - Sustainable Fixed Income Data, Hong Kong HKD 165K-250KAlerting | CSV | Cause analysis | Data Architecture | Data ModelingSenior-level Full TimeHong Kong6d ago
-
Senior-level Full TimeWan Chai, Hong Kong Island, Hong …6d ago
-
TDA Transformation GenAI Solution, Principal HKD 119K-185KAI model | AI model development | API Development | AWS | AngularSenior-level Full TimeHK-AIA Financial Centre, Hong Kong7d ago
-
AI Engineer (F/M) HKD 120K-120KArtificial Intelligence | Data collection | Data integration | Machine Learning | Model DeploymentCareer development | Global work environment | Teamwork culture | Training programsEntry-level Full Time InternshipHong Kong, Hong Kong7d ago
-
Senior kdb+ Engineer HKD 110K-150KAWS | Azure | Cloud Platforms | Electronic Trading | GCPFlexible working hours | Global opportunities | Healthcare and wellbeing | Hybrid work | Increased holiday allowanceSenior-level Full TimeHong Kong, Hong Kong9d ago
-
Core Data Engineer HKD 119K-175KAirflow | Apache Beam | Apache NiFi | Apache Pinot | Apache SparkCatered meals | Conference access | Continuous learning program | Gym membership subsidy | Health insuranceSenior-level Full TimeHong Kong10d ago
-
Automation | DBT | Dagster | Data Architecture | Data EngineeringCommunity initiatives | Flexible benefits | Learning opportunities | Professional development | Wellbeing supportExecutive-level Full TimeHong Kong11d ago
-
Quantitative Analyst - Equities Cash, Vice President HKD 228K-264KAgile | Algorithmic trading | Automated testing | C# | CI/CDExecutive-level Full Time3 Garden Road - Champion Tower, …16d ago
-
Senior Data Engineer HKD 119K-185KAI Agents | AI functions | Cortex AI | Data Governance | Data ModelingSenior-level Full TimeHong Kong16d ago
-
Senior GenAI Scientist (Global Marketing AI) HKD 115K-185KAI Foundry | AI Search | APIs | APIs integration | Agentic AIFlexible work environment | Hybrid work | Learning opportunities | Well-being and inclusionSenior-level Full TimeHong Kong, Manulife Tower17d ago
-
Agile | Analytics engineering | Artificial Intelligence | Business Intelligence | Cloud ComputingMid-level Full TimeHongKong, Hong Kong18d ago
-
Confluence | Excel | Jira | Python | SQLMid-level Contract Full TimeHK-ONE ES 21/F, Hong Kong21d ago
-
API Integration | Cloud Platforms | Data Governance | GenAI | Language ModelsMid-level Full TimePHKL | Berkshire House 23/F, Hong …22d ago
-
AI Engineer - HR Focus - Internship only HKD 300K-300KArtificial Intelligence | Data Management | Data collection | Data integration | Machine LearningCareer development prospects | Future career opportunity | Inclusive diversity | International Professional Experience | Internship duration 6 monthsEntry-level InternshipHong Kong, Hong Kong23d ago
-
AWS | Alicloud | Java | Kafka | LinuxEducation subsidy | Healthcare | Learning and development | Meal allowance | Wellness allowanceSenior-level Full TimeHong Kong, Hong Kong SAR; Singapore, …27d ago
-
Senior-level Full TimeSingapore | Hong Kong30d ago
-
AWS | Agile | Apache Airflow | Apache Spark | Batch ProcessingCompany paid health benefits | Employee resource groups | Flexible time off | Free Coaching and Counseling | Free daily snacksExecutive-level Full TimeHong Kong1mo ago
-
Computer Vision | Data Modeling | Generative AI | High Availability | High-availability systemsSenior-level Full TimeHong Kong SAR1mo ago
-
AWS | Azure | Cloud Computing | Data Preprocessing | Entity recognitionAccident insurance | Annual leave | Dental coverage | Employee discount | Life insuranceSenior-level Full TimeHong Kong, Hong Kong, China1mo ago