预训练数据 Pipeline 工程师
Tasks
- Build data quality evaluation systems
- Design and implement data pipelines
- Develop data processing and sampling operators
- Explore data augmentation and high quality data filtering
- Implement parsing cleaning filtering deduplication and classification
- Manage data assets and ensure traceability
- Optimize task scheduling and resource usage
- Process large-scale data using Spark
Perks/Benefits
- N/A
Skills/Tech-stack
AI coding | Agent workflow | Apache Arrow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Asset Management | C++ | Command Line | Command-line Interface | Data Asset | Data Asset Management | Data Classification | Data Deduplication | Data Filtering | Data Parsing | Data Quality | Data Quality Evaluation | Data Sampling | Data cleaning | Data pipeline | Distributed Systems | Go | Java | Parquet | Python | Quality evaluation | Ray
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Regions
Countries
States
Related jobs
-
Entry-level Full Time上海8h ago
-
2026校招-Ai院-开源模型适配 & 技术布道 CNY 180K-264KGitHub | Hugging Face | Hugging Face Transformers | Inference Optimization | Model ArchitectureCareer development | Open source community impact | Team collaborationNone Full Time北京8h ago
-
具身世界模型数据工程师 - XiaomiRobotics CNY 180K-264KComputer Vision | Data Engineering | Data Pipelines | Data Quality | Data Quality EvaluationMid-level Full Time北京9h ago
-
【27届校招】云原生Ai平台研发工程师-杭州 CNY 180K-360KArgo Workflow | Argo Workflows | Ceph | Computer Vision | ContainerizationNone Full Time杭州9h ago
-
【27届校招】数据挖掘工程师 CNY 180K-360KData Structures | Deep learning | Distributed machine learning | Go | JavaNone Temporary上海9h ago
-
【27届校招】算法研究员-视觉方向 CNY 180K-300KAB Testing | AI Agent | Anomaly Detection | Chain-of-Thought | Computer VisionNone Full Time上海、杭州9h ago
-
None Full Time上海9h ago
-
None Full Time上海9h ago
-
None Full Time上海9h ago
-
【日常实习】数据开发实习生 CNY 25K-37KData Modeling | Data Pipelines | Data Testing | Data Visualization | Data integrationEntry-level Internship深圳9h ago
-
Ai算法工程师 CNY 144K-240KApache Hadoop | Apache Hive | Automation workflows | Data Analysis | Deep learningEntry-level Full Time深圳9h ago
-
【2027秋招】算法工程师 CNY 180K-360KAgent Harness | Agent architecture | Agent collaboration | Asynchronous programming | CachingEntry-level Full Time上海10h ago
-
Entry-level Internship北京10h ago
-
【27届校招】嵌入式camera系统培训生 CNY 25K-37KC# | C++ | Color Space Conversion | Color correction | Color spaceEntry-level Full Time广州10h ago
-
None Full Time北京、上海10h ago
-
【27届校招】AI Infra工程师（深度学习优化方向） CNY 180K-300KKnowledge Distillation | Model Pruning | Model Quantization | Model Sparsity | ONNXNone Full Time广州、北京、上海10h ago
-
【27届校招】数据运维工程师 CNY 180K-300KBig Data | Cloud platform | Container | Function Calling | GoMentorship program | On-the-job trainingNone Full Time广州10h ago
-
Robotaxi VLA 大模型算法实习生 CNY 25K-37KAutonomous Driving | C++ | Case Development | Data Processing | Data cleaningEntry-level Internship广州10h ago
-
【27届校招】Omni模型算法工程师/研究员 CNY 500K-500KData Engineering | Data Quality | Data quality assessment | Distributed Training | Edge DeploymentNone Full Time深圳、上海、北京10h ago
-
Mid-level Full Time深圳、北京10h ago
-
Entry-level Full Time深圳10h ago
-
None Full Time深圳10h ago
-
【27届校招】具身数据infra工程师 CNY 144K-240KAI Coding Agents | AI coding | API Design | Access Control | Coding AgentsEntry-level Full Time深圳、上海、北京10h ago
-
Entry-level Full Time深圳、上海、广州10h ago
-
Entry-level Internship北京10h ago