Ai数据平台工程师
Tasks
- Build and maintain monitoring alerting system
- Build optimize user context data collection system
- Design data platform architecture and improve scalability maintainability
- Design multi source data collection方案
- Develop data platform pipelines for audio video and structured data
- Ensure data security and compliance
- Handle receive parse transcode store and route media data
- Implement data filtering anonymization and labeling workflows
- Maintain high availability and reliability data platform
- Monitor key metrics and troubleshoot data loss transmission issues
- Optimize data processing pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Flume | Apache Hadoop | Apache Kafka | Apache Spark | Data Governance | Data masking | Docker | Grafana | HBase | HDFS | Java | Kubernetes | Logstash | MongoDB | MySQL | Prometheus | Python | Scala | Shell Scripting | Transcoding
Education
Related jobs
-
校招-机器人感知算法开发工程师（目标检测方向） CNY 240K-360K3D Reconstruction | C++ | Camera Calibration | Cloud processing | Computer VisionNone Full Time上海、合肥、北京6h ago
-
Java数据平台开发 CNY 180K-420KAliyun DataWorks | Apache Flink | Apache Hadoop | Apache Hadoop HDFS | Apache HiveMid-level Full Time上海7h ago
-
Internship: Data Engineer CNY 38K-50KAPI Integration | Cloud platform | Data Pipelines | Data Preprocessing | Data RetrievalEntry-level InternshipMin Hang Qu, Shang Hai Shi, …17h ago
-
Internship: Data Engineer CNY 38K-50KData Validation | Data Warehousing | Data pipeline | ETL | PythonEntry-level InternshipSu Zhou Shi, Jiang Su Sheng, …18h ago
-
Data Analysis Engineer (数据分析工程师) CNY 25K-37KAnomaly Detection | Classification | Clustering | Data Visualization | MatplotlibEntry-level Full TimeGuangzhou, China1d ago
-
Data Analysis Engineer (数据分析工程师--生产) CNY 25K-37KCMMS | Data Analysis | Data Security | Data Visualization | EAMEntry-level Full TimeGuangzhou, China1d ago
-
Full Stack Engineer, AI systems CNY 360K-500KAlerting | Amazon DynamoDB | Distributed Systems | Docker | EmbeddingsSenior-level Full TimeChina1d ago
-
数据后端工程师 CNY 25K-37KAWS | Alerting | Alibaba Cloud | Arrow | CI/CDCost optimization support | InternshipEntry-level Internship深圳2d ago
-
Entry-level Internship深圳2d ago
-
Practice Customer Engineer, Data Analytics, Google Cloud CNY 435K-540KApache Spark | Batch Processing | BigQuery | Cloud platform | Customer Technical SupportSenior-level Full TimeShenzhen, Guangdong Province, China2d ago
-
Entry-level Internship上海3d ago
-
Audit Logging | CI Pipeline | CI/CD | Compliance | Data PrivacySenior-level Full TimeShanghai, Shanghai, China3d ago
-
Entry-level Full TimeChina Shanghai4d ago
-
运动健康算法工程师实习生 CNY 25K-37KAgent systems | Langchain | Langgraph | Language Models | Large Language ModelsEntry-level Internship北京4d ago
-
Entry-level Internship北京4d ago
-
Miclaw-AI agent开发实习生 CNY 25K-37KAI Agent | Algorithms | Chain of thought reasoning | Chain-of-Thought | Data StructuresEntry-level Internship南京4d ago
-
Java开发工程师（大数据方向） CNY 180K-420KAB Testing | Apache Flink | Apache Spark | Data Mining | Distributed SystemsMid-level Full Time武汉4d ago
-
Senior-level Full Time北京4d ago
-
高级Ai运维工程师 CNY 240K-480KCompute resource management | Docker | Elasticsearch | Grafana | Incident ResponseSenior-level Full Time北京4d ago
-
AI Engineer CNY 216K-264KAPI Integration | Chroma | Document processing | ERP integration | EmbeddingsMid-level Full TimeShenzhen4d ago
-
AI Test Engineer CNY 240K-480KAgent-based | Agent-based systems | Artificial Intelligence | Automated testing | Boundary testingHybrid work environment | Medical insurance | Remote work | Work-life balanceSenior-level Full TimeXi'an, Shaanxi, China5d ago
-
AI Test Engineer CNY 240K-480KAgent systems | Automated testing | Cause analysis | Deep learning | Defect TrackingInclusive environment | Medical insurance | Remote work hybrid | Safe working environment | Work-life balanceSenior-level Full TimeXi'an, Shaanxi, China5d ago
-
AI Test Engineer CNY 240K-480KAgent systems | Automated testing | Azure | CPU | Cause analysisComprehensive medical coverage | Hybrid work setup | Insurance coverage | Remote work | Work-life balanceSenior-level Full TimeXi'an, Shaanxi, China5d ago
-
Lead Software Engineer - AI/LLM for Virtuoso CNY 300K-480KC++ | Chunking | Code review | Context engineering | Continuous integrationSenior-level Full TimeBEIJING 04, China5d ago
-
AI framework Engineering CNY 240K-480KAlgorithms | Bayesian analysis | C++ | CPU Optimization | Code optimizationSenior-level Full TimeCHN - Minhang, China5d ago