Ai数据平台工程师
Tasks
- Build and maintain monitoring alerting system
- Build optimize user context data collection system
- Design data platform architecture and improve scalability maintainability
- Design multi source data collection方案
- Develop data platform pipelines for audio video and structured data
- Ensure data security and compliance
- Handle receive parse transcode store and route media data
- Implement data filtering anonymization and labeling workflows
- Maintain high availability and reliability data platform
- Monitor key metrics and troubleshoot data loss transmission issues
- Optimize data processing pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Flume | Apache Hadoop | Apache Kafka | Apache Spark | Data Governance | Data masking | Docker | Grafana | HBase | HDFS | Java | Kubernetes | Logstash | MongoDB | MySQL | Prometheus | Python | Scala | Shell Scripting | Transcoding
Education
Related jobs
-
None Full Time深圳3h ago
-
Mid-level Full Time深圳4h ago
-
Apache Spark | Batch Processing | Big Data | Cloud Architecture | Cloud DataSenior-level Full TimeShenzhen, Guangdong Province, China12h ago
-
Senior-level Full TimeShanghai, China22h ago
-
数据平台工程师 CNY 180K-300KAWS | Azure | CI/CD | CloudFormation | Data GovernanceFlexible work arrangements | In-person collaborationMid-level Full TimeSHC01 - DXC Shanghai Campus Phase …23h ago
-
Sr. Consultant - Data Scientist CNY 360K-540KAgile | Computer Vision | Containerization | Data Governance | Data ScienceEmployee assistance program | Mindfulness programs | On demand digital course library | Personalized wellbeing programs | Volunteer matching programSenior-level Full TimeChina Shanghai (Hongmei)23h ago
-
Mid-level Full Time北京 R1d ago
-
Mid-level Full Time武汉1d ago
-
Entry-level Full Time北京 R1d ago
-
Entry-level Full Time北京 R1d ago
-
Mid-level Full Time北京 R1d ago
-
具身世界模型训练INFRA工程师 - XiaomiRobotics CNY 180K-360KDeep learning | DeepSpeed | Distributed Training | Fault Tolerance | KubernetesMid-level Full Time北京1d ago
-
具身智能算法工程师-模型 CNY 500K-500KActor-critic | Deep learning | Distributed Training | Implicit Q Learning | Inference accelerationMid-level Full Time北京 R1d ago
-
Entry-level Full Time北京1d ago
-
AI基础设施研发工程师（Sandbox / 容器化)-MiMo CNY 180K-420KAppArmor | Argo Workflows | CPU resource scheduling | Cgroup | ContainerdMid-level Full Time北京 R1d ago
-
大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37KAsynchronous programming | Concurrency | Distributed Systems | Docker | GitEntry-level Internship深圳1d ago
-
Ai应用工程师（提效方向 0-1） CNY 50K-50KAI Programming | AI Programming Tools | API Integration | JavaScript | Language ProcessingEngineering resource support | Hands-on product development | Model and compute support | Real world usageEntry-level Internship深圳1d ago
-
大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37KAlerting | Asynchronous programming | Concurrency | Data Retrieval | Data StorageEntry-level Internship深圳1d ago
-
Entry-level Full Time北京1d ago
-
Entry-level Internship北京1d ago
-
大语言模型后训练/Agentic算法工程师 CNY 180K-360KAgentic RL | DAPO | Distributed Training | Function Calling | GRPOEntry-level Full Time上海、北京1d ago
-
大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37KAlerting | Asynchronous programming | Concurrency | Data pipeline | Distributed SystemsEntry-level Internship深圳1d ago
-
大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37KAsynchronous programming | Concurrency | Distributed Systems | Docker | GitFlexible work schedule | Internship opportunity | MentorshipEntry-level Internship深圳1d ago
-
Entry-level Full Time北京、上海1d ago
-
AGI 服务端资深工程师-Talkie&星野 CNY 180K-300KData Engineering | Dify | Distributed Systems | Go | Inference OptimizationMid-level Full Time北京、上海1d ago