大模型数据工程专家/工程师
Tasks
- Build automated ETL pipelines
- Build automatic sampling and error case mining
- Collaborate with model training and platform teams
- Conduct data sanitization and labeling
- Construct and optimize data infrastructure
- Create data quality evaluation and validation systems
- Design large language model data engineering architecture
- Develop data closed loop systems
- Enable data model attribution analysis
- Implement data cleaning and deduplication
- Lead data engineering team and set technical standards
- Maintain distributed file systems and databases
- Optimize storage and compute performance
- Orchestrate data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Hadoop | Apache Spark | Ceph | Data Augmentation | Data Deduplication | Data Quality | Data cleaning | Data labeling | Distributed Computing | ETL | HDFS | Java | Kubeflow | LSH | Linux | Milvus | MinHash | MongoDB | PostgreSQL | Python | RAG | RLHF | SFT | Scala | Shell | Vector Database
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
ARM | Android | Communication Protocols | Core Architecture | DebuggingSenior-level Full TimeShanghai, China5h ago
-
Senior-level Full TimeShanghai, China5h ago
-
Automation & Robotics Engineer CNY 360K-600KActuator integration | Analog Signal | Artificial Intelligence | C++ | CADSenior-level Full TimeHangzhou, China17h ago
-
Data Integration & Systems Senior Engineer CNY 360K-600KAgile | Cybersecurity | Data Architecture | Data Governance | Data Lifecycle ManagementSenior-level Full TimeCHN - DL - IMB new …17h ago
-
Data Analytics & Management, AVP CNY 300K-420KAgentic AI | Alteryx | Anomaly Detection | Classification | Code DevelopmentFlexible work/life support | Inclusive development opportunities | Paid volunteer days | Vibrant employee networksExecutive-level Full TimeHangzhou, China17h ago
-
Senior-level Full Time上海、北京20h ago
-
Entry-level Internship上海21h ago
-
Mid-level Full Time上海21h ago
-
Mid-level Full Time上海21h ago
-
Senior-level Full Time上海21h ago
-
Mid-level Full Time北京、上海21h ago
-
Entry-level Full Time上海21h ago
-
Entry-level Full Time北京、上海21h ago
-
Mid-level Full Time上海21h ago
-
Mid-level Full Time上海、北京21h ago
-
Mid-level Full Time上海21h ago
-
Senior-level Full Time上海21h ago
-
Senior-level Full Time上海 R21h ago
-
Mid-level Full Time上海 R21h ago
-
Senior-level Full Time上海 R21h ago
-
loco-manipulation（高动态物体交互方向） CNY 180K-360KBody Dynamics | C++ | Contact dynamics | Curriculum learning | Domain RandomizationMid-level Full Time上海21h ago
-
Data Infra高级研发工程师（AI与具身智能数据平台方向） CNY 144K-240KAsynchronous processing | Automated testing | CI/CD | CRD | Cloud NativeSenior-level Full Time上海 R21h ago
-
Mid-level Full Time北京、上海21h ago
-
Ego-Centric视觉感知算法工程师 CNY 180K-300K2D Segmentation | 3D Gaussian Splatting | 3D Hand Pose | 3D Reconstruction | 6D PoseMid-level Full Time上海、北京 R21h ago
-
Vr算法专家 CNY 144K-240KAHRS | Algorithm Deployment Optimization | Algorithm deployment | C++ | Deployment optimizationSenior-level Full Time上海21h ago