Data Engineer Graduate (TikTok Recommendation Ecosystem Architecture) - 2027 Start (PhD)
Tasks
- Build Lakehouse feature pipelines
- Build data formats and access patterns for ML samples and features
- Collaborate with ML platform teams on PyTorch training workflows
- Design real-time and offline data architecture
- Implement distributed storage components
- Implement file format stream compaction and metadata management
- Implement stream processing with Apache Flink
- Manage Flink state and connectors
- Optimize data lakes caching and distributed computing
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Hudi | Apache Iceberg | Apache Paimon | C++ | Compaction | Connectors | Data Versioning | Delta Lake | Feature Engineering | Feature Store | HBase | Incremental ingestion | Java | Kudu | Lakehouse | Lance | Metadata Management | ORC | Parquet | PyTorch | Scala | Schema evolution | Snapshot Isolation | State management | Stream compaction | Streaming | UDF
Education
Related jobs
-
AWS | Anomaly Detection | Azure | Classification | ClusteringSenior-level Full TimeSingapore, Singapore15h ago
-
Senior-level Full TimeSingapore, Singapore15h ago
-
Backend Software Engineer Project Intern (Data Platform, Data Management Suite) - 2026 Start SGD 57K-65KApache Kafka | Apache Spark | Distributed Systems | Java | KubernetesEntry-level InternshipSingapore, Singapore16h ago
-
Senior Machine Learning Engineer - Perception SGD 149K-220KBuild systems | Code review | Computer Vision | Control Management | Deep learningSenior-level Full TimeSingapore, Central, Singapore21h ago
-
Data Engineer SGD 100K-132KAWS Glue | AWS Lambda | AWS S3 | Amazon Athena | Apache AirflowFlexible work arrangements | Hybrid work environment | Innovation opportunities | Professional development | Wellbeing supportSenior-level Full TimeNLB National Library Building, Singapore2d ago
-
Big Data Development Engineer Intern SGD 72K-91KApache Flink | Apache Spark | C plus plus | ClickHouse | GoEntry-level Full Time InternshipSingapore-CapitaSky2d ago
-
AI Solution Specialist SGD 95KAPI Design | AWS | Anthropic | Azure | Data PreprocessingHybrid work schedule | Inclusive work culture | Professional development opportunities | Supportive leadersMid-level Full TimeSingapore - Marina View R2d ago
-
Domain Randomization | Imitation Learning | IsaacGym | IsaacLab | JAXMid-level Full TimeSingapore2d ago
-
C plus plus | Contact Rich Control | Control Theory | Data collection | Grasp PlanningCompetitive compensation | Equipment access | Equity | Open source contributionsMid-level Full TimeSingapore R2d ago
-
C++ | Dynamic Obstacle Avoidance | Embedded Systems | Footstep planning | Global planningCompetitive compensation | Equity | Open source contributionsSenior-level Full TimeSingapore2d ago
-
AI Agents | API Gateway | AWS | Azure | CI/CDEntry-level InternshipSingapore, Singapore2d ago
-
Forward Deployed Engineer, Data, GenAI, Google Cloud SGD 112K-200KBatch Processing | BigQuery | DBT | Data Lakes | Data ModelingMid-level Full TimeSingapore2d ago
-
AI/ML Customer Engineer SGD 175K-225KAgentic Workflows | Air-gapped | Air-gapped networks | C# | C++Access to emerging hardware technologies | Open Source contribution | Remote work flexibility | Technical career growthSenior-level Full TimeSingapore R3d ago
-
Artificial Intelligence | Cloud Computing | Data Analysis | Data Mining | Data VisualizationEntry-level Full TimeFab 10A, Singapore3d ago
-
Actuator integration | BACnet | Block programming | C# | C++Cross-disciplinary collaboration | Industry consultancy experience | Professional development trainingSenior-level Full TimeNgee Ann Polytechnic, Clementi Campus, Singapore3d ago
-
BERT | Corpus Construction | Data Preprocessing | Data cleaning | Database IntegrationEntry-level Full TimeNTU Main Campus, Singapore3d ago
-
Embedded Software/ Firmware Engineer SGD 60K-108KC# | C++ | Debugging | Embedded Systems | FirmwareMid-level Full TimeSGP25 - Singapore - Depot 2 …3d ago
-
Senior Embedded Software Engineer SGD 147K-180KARM | Agile | C Secure Coding Standard | C# | C++Digital course library | Employee assistance program | Mindfulness programs | Paid volunteer time off | Personalized wellbeing programsSenior-level Full TimeSingapore Singapore (Corporation Road)3d ago
-
Assistant Algorithm Engineer SGD 40K-50KArtificial Intelligence | Computer Vision | Deep learning | PyTorch | TensorFlowEntry-level InternshipSingapore3d ago
-
Apache Flink | Data Processing | Data integration | Distributed Systems | Real TimeEntry-level InternshipSingapore, Singapore3d ago
-
Data Catalog | Data Governance | Data Security | Distributed Systems | JavaEntry-level Full TimeSingapore, Singapore3d ago
-
Apache Flink | Computing architecture | Data integration | Data pipeline | Open SourceEntry-level Full TimeSingapore, Singapore3d ago
-
Machine Learning Engineer Graduate (Global E-Commerce, Platform Governance) - 2027 Start (PhD) SGD 70K-70KData Modeling | Feature Engineering | Graph Databases | Graph Learning | Machine LearningEntry-level Full TimeSingapore, Singapore3d ago
-
Feature Engineering | Fraud Detection | Graph Neural Networks | Language Models | Large Language ModelsMid-level Full TimeSingapore, Singapore3d ago
-
Apache Flink | Apache Hive | Apache Spark | Big Data | C#Entry-level Full TimeSingapore3d ago