Staff/Senior Staff Web3 Big Data Engineer
Hong Kong, Hong Kong SAR; Singapore, Singapore
SGD 191K-225K (estimate) Senior-level Full Time
Tasks
- Architect big data platform
- Build AI agent data supply pipelines
- Build RAG retrieval pipelines
- Build Text2SQL pipelines
- Build batch data pipelines
- Build data anomaly detection pipelines
- Build data warehouse
- Build embedding pipelines
- Build feature platforms
- Build fraud detection pipelines
- Build real-time data pipelines
- Build risk models pipelines
- Build user behavior prediction pipelines
- Build vector database infrastructure
- Collaborate with AI teams on feature engineering
- Collaborate with growth teams on data needs
- Collaborate with product teams on trading analytics
- Collaborate with risk teams on anti fraud
- Define data layering standards
- Develop big data platform
- Document data engineering architecture
- Ensure SLAs on core pipelines
- Ensure data consistency
- Ensure data quality
- Ensure data timeliness
- Ensure pipeline stability
- Maintain data lake
- Optimize big data job performance
- Optimize big data platform
- Process blockchain transactions
- Process smart contract events
- Process wallet address behavior
- Provide technology direction for data platforms
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Spark | Blockchain | ClickHouse | Deep learning | Doris | Dune Analytics | ETL | Embedding | Etherscan API | Feature Platform | HBase | Hadoop | Hive | Java | Kafka | LLM | Language Processing | Machine Learning | Milvus | Natural Language | Natural Language Processing | PGVector | Pinecone | Prompt engineering | Python | RAG | SQL | Scala | Smart contracts | Solidity | Text2SQL | The Graph | Vector Databases | Weaviate
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Big Data Engineer | Data Engineer | Engineer | Web3 Big Data Engineer
Related jobs
-
Bash | Cloud infrastructure | Cost Throughput Optimization | Data Ingestion | Data Ingestion PipelinesAsynchronous work culture | Career impact on large scale product | Friendly laid-back atmosphereMid-level Full TimeSingapore, Singapore8h ago
-
Mid-level Full TimeRemote - Singapore R9h ago
-
AI | APIs | Anomaly Detection | Data Governance | Data ModelingHybrid work | Mentoring | Training opportunitiesSenior-level Full TimeSingapore, Singapore23h ago
-
Apache Kafka | CI/CD | Docker | GraphQL | JavaScriptSenior-level Full TimeSingapore, Singapore1d ago
-
AI Intern SGD 44K-56KAPI Development | Cyber Security | Fine Tuning | Governance Risk | Governance risk complianceDiversity and inclusion | Flexible working arrangements | Training opportunitiesEntry-level InternshipSingapore, SG1d ago
-
Lead Data & Integration Engineer SGD 162K-225KBatch Processing | Branching | CI/CD | Cloudera | Code ReviewsSenior-level Full TimeSingapore1d ago
-
Data Governance | Data Modeling | Data Processing | Data Warehousing | ETLEntry-level Full TimeSingapore, Singapore1d ago
-
Audio Processing | Computer Vision | Deep learning | Language Models | Language ProcessingEntry-level InternshipSingapore, Singapore1d ago
-
Data Modeling | Data Processing | Data Quality | Data Warehousing | ETLEntry-level Full TimeSingapore, Singapore1d ago
-
BluePrism | Microsoft Access | Microsoft Excel | Microsoft Office | Power AutomateMid-level Contract Full TimeHong Kong1d ago
-
Associate Director, Data Analytics and AI HKD 312K-312KArtificial Intelligence | Computer Vision | Customer Analytics | Data Modeling | Data ScienceMid-level Full TimeHK-AIA Building (Group Office), Hong Kong1d ago
-
AI Engineer SGD 74K-74KAI Platform | Amazon SageMaker | Azure Machine Learning | CI/CD | Cloud AI PlatformSenior-level Full TimeSingapore, Raffles City Tower1d ago
-
Autoregressive models | CPU GPU | CPU/GPU acceleration | Deep Learning Systems | Deep learningSenior-level Full TimeSingapore-CapitaSky1d ago
-
Senior-level Full TimeIOI Central Boulevard Towers, Singapore1d ago
-
Control Theory | Domain Randomization | Dynamics | Imitation Learning | IsaacGymMid-level Full TimeSingapore2d ago
-
C++ | Dynamic Obstacle Avoidance | Footstep planning | Localization | Localization and mappingEquitySenior-level Full TimeSingapore2d ago
-
C++ | Contact Rich Control | Control Theory | Data collection | Deep learningEquity | Open source contributionsMid-level Full TimeSingapore2d ago
-
Senior-level Full TimeSingapore2d ago
-
Data Engineer SGD 105K-141KAzure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure SynapseSenior-level Contract Full TimeSingapore, Singapore, Singapore3d ago
-
APIs | Amazon Web Services | Azure Data | Azure Data Explorer | Azure Data FactoryMonday to Friday schedule | Onsite workMid-level Full TimeSingapore, Singapore4d ago
-
.NET | Agent Orchestration | Agent systems | App Service | Azure AppSenior-level Full TimeSingapore, Singapore4d ago
-
Fullstack AI Engineer SGD 162K-220KAWS | Azure | CI/CD | Django | DockerEmployee wellness programs | Flexible work arrangements | Paid leaveSenior-level Full TimeSingapore, Singapore, Singapore4d ago
-
AI Engineer (Managed Services) SGD 85K-138KARES | AWQ | Agent Orchestration | Agent systems | Attention MechanismsMid-level Full TimeSingapore4d ago
-
Data Engineer SGD 96K-133KCloudera Data Platform | Data Analysis | Data Modeling | Data platform | Data virtualizationMid-level Full TimeSingapore4d ago
-
Data Engineer SGD 136K-190KAgile | Cloudera Data Platform | Data Modeling | Data Warehousing | Data platformSenior-level Full TimeSingapore4d ago