Big Data Engineer - Data Lake / Feature Store
Tasks
- Develop and optimize in-house Feature Store based on Iceberg
- Handle platform infrastructure development
- Optimize Iceberg integration with computing engines
Perks/Benefits
- N/A
Skills/Tech-stack
Big Data | Data Architecture | Data Engineering | Data Processing | Data Storage | Distributed Systems | Distributed Training | ETL | Feature Store | Hudi | Iceberg | Machine Learning | Performance optimization | Ray | Spark
Education
Roles
Related jobs
-
Data Science Internship SGD 57K-57KAnti-Money Laundering | Data Engineering | Data Pipelines | Data cleaning | Fraud DetectionFlexible remote work options | Focus Fridays | Generous PTO | Hybrid work options | Learning and development opportunitiesEntry-level InternshipSingapore - Singapore1d ago
-
API | Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore1d ago
-
Capacity Planning | Computer Vision | Deep reinforcement learning | LLM | Language ModelsMid-level Full TimeSingapore, Singapore1d ago
-
Algorithm Implementation | Automatic Parameter Optimization | Capacity Scheduling | Data Modeling | Dynamic Route PlanningMid-level Full TimeSingapore, Singapore1d ago
-
Backend Software Engineer, Manus SGD 170K-203KAPI Design | AWS | Architecture | Azure | Best practicesSenior-level Full TimeSingapore1d ago
-
Backend Software Engineer, Manus SGD 140K-143KAPI Design | AWS | Azure | Best practices | Bias MitigationMid-level Full TimeSingapore1d ago
-
Senior Machine Learning Engineer, Compliance SGD 106K-106KAML | Anomaly Detection | Automation workflows | Batch Data Processing | Batch dataCandidate Support Programs | Company events | Education subsidy | Healthcare schemes | L and D programsSenior-level Full TimeSingapore, Singapore1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Career growth opportunities | Friendly work environment | Remote/distributed teamMid-level Full TimeSingapore, Singapore1d ago
-
AI Engineer (Data and Analytics Department) SGD 140K-200KCI/CD | Continuous Training | Data Drift | Data Drift Detection | Deep learningSenior-level Full TimeEMA HQ, Singapore1d ago
-
Data Engineer (Data and Analytics Department) SGD 18K-27KAWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3None Full TimeEMA HQ, Singapore1d ago
-
Manager/Assistant Director (Data Platform Engineer) SGD 245K-375KAWS | Access Management | Agile | Azure | Azure SynapseExecutive-level Full TimeSFA - JEM, Singapore1d ago
-
CLIP | Computer Vision | Distributed Training | Language Models | Language ProcessingEntry-level Full TimeSingapore, Singapore2d ago
-
Software Engineering, Machine Learning (Singapore) SGD 60K-108KAgent Orchestration | Artificial Intelligence | Bias Mitigation | Data Mining | JavaScriptEntry-level Full TimeSingapore2d ago
-
Data Engineer SGD 57K-70KApache Hive | Apache Spark | Azure DevOps | Azure Machine Learning | CI/CDEntry-level Full TimeSingapore, Singapore, Singapore2d ago
-
Staff Data Engineer SGD 108K-180KApache Airflow | Apache Flink | Apache Kafka | Data Governance | Data ManagementEquity | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeSG - Singapore2d ago
-
Director, Compliance Data Science & AI SGD 160K-250KAML detection | Anomaly Detection | Blockchain data | Customer Risk Rating | Graph analyticsCompany events | Education subsidy | Healthcare coverage | L and D programs | Meal allowancesExecutive-level Full TimeSingapore, Singapore2d ago
-
Senior Engineer Team Lead (Data Science) SGD 96K-132KData Exploration | Data Pipelines | Data Validation | Data Visualization | Data dashboardsSenior-level Full TimeSingapore, SG2d ago
-
AWS | Azure | CI/CD | Cloud platform | Computer VisionCollaborative work culture | MentorshipEntry-level Full TimeNTU Main Campus, Singapore2d ago
-
Entry-level Full TimeNTU Main Campus, Singapore2d ago
-
Computational Neuroscience | Data Analysis | Deep learning | Deep reinforcement learning | Experiment designMid-level Full TimeNTU Main Campus, Singapore2d ago
-
AWS | Ansible | Azure | Bash | CI/CDContinuous learning | Mentorship opportunities | Professional developmentMid-level Full TimeNTU Main Campus, Singapore2d ago
-
AWS | Ansible | Azure | Bash | CI/CDContinuous learning | Professional developmentMid-level Full TimeNTU Main Campus, Singapore2d ago
-
AWS | Agile | Ansible | Azure | BashContinuous learning | Flexible experimentation culture | Mentorship opportunities | Professional developmentMid-level Full TimeNTU Main Campus, Singapore2d ago
-
AWS | Ansible | Azure | Bash | CI/CDContinuous learning | Professional developmentMid-level Full TimeNTU Main Campus, Singapore2d ago
-
Senior-level Contract Full TimeSingapore, Singapore, Singapore2d ago