Machine Learning Engineer Intern (FeatureStore) - 2025 Summer (PhD)
San Jose, California, United States
Team Introduction:
The TikTok Data Ecosystem Team plays a critical role in supporting TikTok’s personalized recommendation system, which serves over 1 billion users. We are responsible for building scalable, reliable, and high-performance infrastructure for storing and serving machine learning features — especially user behavior sequences and contextual embeddings used in large-scale recommendation and pretraining models.
Our work sits at the intersection of systems and machine learning: ensuring training-serving consistency, low-latency access to temporal features, and scalable ingestion pipelines across online and offline environments.
We explore and integrate with various underlying storage engines, including RocksDB, HBase, and time-series databases, depending on the access pattern, feature type, and serving latency required by ML models.
Responsibilities:
- Build and optimize the core infrastructure of TikTok’s feature store, powering both training data pipelines and real-time inference systems.
- Design efficient storage strategies for user behavior sequences, long-range contextual features, and sparse embeddings — ensuring freshness, consistency, and high availability.
- Work with underlying storage engines such as RocksDB, HBase, and time-series databases to support feature retention, versioning, compaction, and fast lookup.
- Collaborate with recommendation algorithm teams to design schemas and access patterns tailored to evolving model needs.
- Integrate online and offline data pipelines to reduce training-serving skew and support continuous training and A/B testing scenarios.
- Investigate techniques such as temporal sampling, embedding quantization, caching, and hybrid tiered storage to improve cost-efficiency and latency.
The TikTok Data Ecosystem Team plays a critical role in supporting TikTok’s personalized recommendation system, which serves over 1 billion users. We are responsible for building scalable, reliable, and high-performance infrastructure for storing and serving machine learning features — especially user behavior sequences and contextual embeddings used in large-scale recommendation and pretraining models.
Our work sits at the intersection of systems and machine learning: ensuring training-serving consistency, low-latency access to temporal features, and scalable ingestion pipelines across online and offline environments.
We explore and integrate with various underlying storage engines, including RocksDB, HBase, and time-series databases, depending on the access pattern, feature type, and serving latency required by ML models.
Responsibilities:
- Build and optimize the core infrastructure of TikTok’s feature store, powering both training data pipelines and real-time inference systems.
- Design efficient storage strategies for user behavior sequences, long-range contextual features, and sparse embeddings — ensuring freshness, consistency, and high availability.
- Work with underlying storage engines such as RocksDB, HBase, and time-series databases to support feature retention, versioning, compaction, and fast lookup.
- Collaborate with recommendation algorithm teams to design schemas and access patterns tailored to evolving model needs.
- Integrate online and offline data pipelines to reduce training-serving skew and support continuous training and A/B testing scenarios.
- Investigate techniques such as temporal sampling, embedding quantization, caching, and hybrid tiered storage to improve cost-efficiency and latency.
Job stats:
0
0
0
Categories:
Engineering Jobs
Machine Learning Jobs
Tags: A/B testing Data pipelines HBase Machine Learning ML models PhD Pipelines Testing
Region:
North America
Country:
United States
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Scientist II jobsData Engineer II jobsSr. Data Engineer jobsStaff Data Scientist jobsPrincipal Data Engineer jobsBusiness Intelligence Analyst jobsStaff Machine Learning Engineer jobsData Science Manager jobsData Manager jobsData Science Intern jobsPrincipal Software Engineer jobsJunior Data Analyst jobsBusiness Data Analyst jobsSoftware Engineer II jobsDevOps Engineer jobsData Specialist jobsData Analyst Intern jobsLead Data Analyst jobsSr. Data Scientist jobsStaff Software Engineer jobsResearch Scientist jobsAI/ML Engineer jobsData Engineer III jobsSenior Backend Engineer jobsBI Analyst jobs
NLP jobsAirflow jobsOpen Source jobsEconomics jobsKafka jobsLinux jobsMLOps jobsKPIs jobsTerraform jobsNoSQL jobsJavaScript jobsComputer Vision jobsGoogle Cloud jobsPhysics jobsData Warehousing jobsRDBMS jobsPostgreSQL jobsScikit-learn jobsBanking jobsGitHub jobsScala jobsHadoop jobsData warehouse jobsStreaming jobsPandas jobs
R&D jobsOracle jobsBigQuery jobsdbt jobsClassification jobsCX jobsDistributed Systems jobsLooker jobsPySpark jobsReact jobsScrum jobsRAG jobsRobotics jobsRedshift jobsELT jobsJira jobsMicroservices jobsIndustrial jobsGPT jobsPrompt engineering jobsSAS jobsData Mining jobsData strategy jobsNumPy jobsMySQL jobs