Ai数据平台工程师
Tasks
- Build data monitoring and alerting
- Build user context data collection system
- Coordinate business and algorithm teams data requirements
- Design multi source data collection方案
- Develop data ingestion parsing transcoding storage streaming
- Ensure data security and compliance
- Implement data filtering de identification and labeling
- Iterate data platform architecture for scalability and maintainability
- Operate data platform end to end
- Optimize audio video data processing pipeline
- Troubleshoot data loss transmission issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Flume | Apache Hadoop | Apache Kafka | Apache Spark | Data Deidentification | Data Governance | Docker | Grafana | HBase | HDFS | Java | Kubernetes | Logstash | MongoDB | MySQL | Prometheus | Python | Scala | Shell Scripting
Education
Related jobs
-
Senior-level Full TimeShanghai, CN, 2012039h ago
-
Data Engineer CNY 360K-600KAPIs | Airflow | Alerting | Anonymization | CI/CDFlexible working models | Health and wellbeing benefits | Professional learning and developmentSenior-level Full TimeShanghai, CN, 2012039h ago
-
Ai研发工程师（云服务与大模型部署） CNY 180K-300KC++ | CI/CD | Cloud Computing | Distributed Systems | Edge ComputingMid-level Full Time深圳15h ago
-
大模型算法工程师（Memory/RAG/意图识别） CNY 180K-360KComputer Vision | Data Processing | Data cleaning | Data labeling | Dataset developmentEntry-level Full Time深圳15h ago
-
AI应用研发工程师（架构设计/RAG/Agent） CNY 180K-300KCI/CD | Context Management | Data pipeline | Deep learning | DockerMid-level Full Time深圳15h ago
-
Entry-level Full Time深圳15h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work environment | Competitive salary | Laid-back atmosphere | Remote-friendly cultureMid-level Full TimeShenzhen, China1d ago
-
Data Analysis | Machine Learning | Python | Quantitative Finance | Statistical modelingCollaborative environment | Health insurance | InsuranceMid-level Full TimeBeijing, Beijing, China2d ago
-
AVP - Data and Analytics CNY 300K-420KAI Governance | Algorithmic Compliance | Audit evidence | Behavioral analytics | Cause analysisFlexible working | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China2d ago
-
ANSYS APDL | C Programming | Design of Experiments | Durability analysis | Element analysisMid-level Full TimeWuhan, Hubei, China2d ago
-
Ai算法工程师 CNY 144K-240KBig Data | Big data processing | Data Processing | Deep learning | Feature EngineeringEntry-level Full Time深圳2d ago
-
【校招实习】Ai算法工程师 CNY 25K-37KComputer Vision | Data Analysis | Deep learning | Feature Engineering | HadoopInternship opportunityEntry-level Internship深圳2d ago
-
Entry-level Internship深圳2d ago
-
Mid-level Full Time北京 R2d ago
-
大模型算法研究员-MiMo CNY 500K-500KAI Feedback | Active Learning | C plus plus | Curriculum learning | Deep learningMid-level Full Time北京2d ago
-
Mid-level Full Time武汉2d ago
-
Entry-level Full Time北京 R2d ago
-
Ai数据闭环研发工程师 CNY 240K-360KData Distribution | Data Distribution Strategy | Data Flywheel | Data Mining | Data evaluationSenior-level Full Time上海、北京2d ago
-
Mid-level Full Time上海2d ago
-
Senior-level Full Time上海、武汉、北京2d ago
-
算法工程师-大模型数据方向 CNY 240K-360KAnnotation Automation | Apache Spark | Clustering | Data Annotation | Data GovernanceSenior-level Full Time上海2d ago
-
Mid-level Full Time上海2d ago
-
Mid-level Full Time上海2d ago
-
数据智能团队负责人 CNY 240K-360KAnomaly Detection | ClickHouse | Data Governance | Data Modeling | Data QualitySenior-level Full Time上海2d ago
-
Senior-level Full Time上海2d ago