Ai数据平台工程师
Tasks
- Build and maintain monitoring alerting system
- Build optimize user context data collection system
- Design data platform architecture and improve scalability maintainability
- Design multi source data collection方案
- Develop data platform pipelines for audio video and structured data
- Ensure data security and compliance
- Handle receive parse transcode store and route media data
- Implement data filtering anonymization and labeling workflows
- Maintain high availability and reliability data platform
- Monitor key metrics and troubleshoot data loss transmission issues
- Optimize data processing pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Flume | Apache Hadoop | Apache Kafka | Apache Spark | Data Governance | Data masking | Docker | Grafana | HBase | HDFS | Java | Kubernetes | Logstash | MongoDB | MySQL | Prometheus | Python | Scala | Shell Scripting | Transcoding
Education
Related jobs
-
Executive-level Full TimeHangzhou, China16h ago
-
AI Governance | APIs | AWS | Adversarial Testing | Automated EvaluationExecutive-level Full TimeHangzhou, China16h ago
-
Executive-level Full TimeHangzhou, China16h ago
-
Mid-level Full TimeChina2d ago
-
智能软件- AI Agent 开发工程师-南京 CNY 180K-420KAnthropic Claude | Anthropic Claude API | Autogen | Claude API | CrewAINone Full Time南京2d ago
-
C++ | Compliant Control | Contact mechanics | Dexterous Manipulation | Force/torque sensingMid-level Full TimeChina3d ago
-
Docker | Kubernetes | Langsmith | MLflow | MicroservicesMid-level Full TimeChina3d ago
-
Apache Airflow | Apache Spark | Bias Mitigation | Dataset Distillation | Prompt engineeringMid-level Full TimeChina3d ago
-
C++ | CUDA | Data parallelism | DeepSpeed | InfinibandEntry-level Full TimeChina3d ago
-
C++ | Edge Deployment | GPU | Hardware compilation | Language ModelsMid-level Full TimeChina3d ago
-
Asynchronous programming | Asyncio | Deep learning | DeepSpeed | Distributed TrainingSenior-level Full TimeChina, Shanghai3d ago
-
3D Perception | Bimanual manipulation | C++ | Deep learning | Foundation ModelsMid-level Full TimeChina, Shanghai3d ago
-
C# | C++ | CUDA | Data analytics | Deep learningComprehensive benefits packageMid-level Full TimeChina, Shanghai3d ago
-
Python&BI&AI开发工程师 CNY 180K-360KAsynchronous programming | C++ | DPO | Data Annotation | Data ProcessingIn person collaboration flexibility | Work/life balance focusMid-level Full TimeCN004 - Shanghai, China (CN004)3d ago
-
Mid-level Full Time深圳3d ago
-
Mid-level Full TimeChina - Hong Kong4d ago
-
Senior-level Full TimeBeijing Yizhuang, China4d ago
-
Nlp算法工程师 CNY 240K-360KC++ | Deep learning | Information Retrieval | Intent Recognition | Language ModelsMid-level Full Time深圳4d ago
-
Dba工程师 CNY 240K-420KBackup and Recovery | Change Management | Database Backup | Database Change Management | Database backup and recoveryMid-level Full Time深圳4d ago
-
Data Infra Tech Lead CNY 240K-480K3D processing | C++ | Cloud processing | Data Governance | Data LineageSenior-level Full Time北京4d ago
-
Recommendation Algorithm Engineer CNY 25K-37KCold Start | Deep learning | Java | Ranking algorithms | Recommendation SystemsTeam collaborationEntry-level InternshipGuangzhou4d ago
-
AI Algorithms | Blockchain | Data Analysis | Decentralized applications | Deep learningSenior-level Full TimeChina5d ago
-
Blockchain | Data Analysis | Deep learning | Java | Language ProcessingSenior-level Full TimeShenzhen5d ago
-
Lead / Staff Engineer, AI Agent Platform CNY 240K-480KAgent Orchestration | Asynchronous Concurrency | Budget Governance | Checkpointing | Context AssemblySenior-level Full TimeSuzhou5d ago
-
Entry-level Internship深圳、上海5d ago