资深数据开发工程师（自动驾驶数据平台） _Xc
Tasks
- Audit write operations and enforce role authorization
- Build asynchronous task scheduling platform
- Build unified data access layer
- Build vector similarity recall using Lance
- Conduct code reviews and technical knowledge sharing
- Define task orchestration retry and rate limiting
- Design Kubernetes based high availability deployments
- Design data ingestion pipeline
- Design data platform architecture
- Harden SQL injection prevention
- Implement column level data masking
- Implement data security compliance rules
- Manage object storage data flow
- Monitor and govern long running data jobs
- Optimize Trino queries
- Perform slow query governance
- Process and clean large scale vehicle data
- Select data platform technologies
- Sync data with MongoDB and MySQL
Perks/Benefits
- N/A
Skills/Tech-stack
ANN Index | COS Object Storage | Celery | ClickHouse | Cosine similarity | Data Modeling | Django | Django REST | Django REST Framework | Docker | Doris | Hudi | Iceberg | KNN | KNN Similarity | Kafka | Kubernetes | Lance | LevelDB | MQ | MongoDB | MySQL | Object storage | Parquet | Presto | Python | Query Optimization | REST Framework | Rate Limiting | Redis | RocksDB | SQL | Spark SQL | Trino | Vector Search
Education
Related jobs
-
None Full Time上海21h ago
-
Entry-level Full Time北京22h ago
-
机器人VLA算法研究员 - XiaomiRobotics CNY 500K-500KAction Generation | Data Modeling | Deep learning | Diffusion Models | Machine LearningMid-level Full Time北京22h ago
-
Mid-level Full Time北京22h ago
-
大数据开发工程师 CNY 180K-300KAnomaly Detection | Apache Flink | Apache Spark | Data Governance | Data LakeMid-level Full Time北京22h ago
-
Entry-level Full Time InternshipBeijing22h ago
-
Mid-level Full Time北京22h ago
-
Mid-level Full Time北京22h ago
-
Senior-level Full Time北京、上海22h ago
-
Senior-level Full Time上海、北京22h ago
-
Senior-level Full Time北京、上海22h ago
-
自动驾驶数据挖掘算法开发实习生（Llm/Vlm方向）-2027届 CNY 25K-37KAccuracy | Algorithm Reproducibility | Computer Vision | Coverage | Data PreprocessingEntry-level Internship武汉23h ago
-
技术中心 - 数据开发工程师 CNY 180K-300KData Lineage | Data Modeling | Data Monitoring | Data Observability | Data QualityMid-level Full Time广州23h ago
-
技术中心 - 数据开发工程师 （游戏业务方向） CNY 120K-180KData Modeling | Data Quality | Data Warehouse | Data pipeline | FlinkMid-level Full Time广州23h ago
-
Entry-level Full Time上海23h ago
-
Alerting | Benchmarking | Data Pipelines | Distributed Systems | GPU ComputingMid-level Full TimeChina R1d ago
-
AI Lead Engineer CNY 120K-180KAWS | Ansible | Azure | CI/CD | DockerDevelopment courses | Employee assistance program | Flexible working | Learning opportunities | Medical and life insuranceSenior-level Full TimeTianjin, CN1d ago
-
Mid-level Full TimeChina R1d ago
-
Mid-level Full TimeShanghai, China1d ago
-
Senior Data Platform & Annotation Engineer CNY 360K-600KArtificial Intelligence | Big Data | C++ | CI/CD | Camera image processingSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …1d ago
-
Entry-level Full Time上海1d ago
-
2026校招-Ai院-开源模型适配 & 技术布道 CNY 180K-264KGitHub | Hugging Face | Hugging Face Transformers | Inference Optimization | Model ArchitectureCareer development | Open source community impact | Team collaborationNone Full Time北京1d ago
-
预训练数据 Pipeline 工程师 CNY 96K-180KAI coding | Agent workflow | Apache Arrow | Apache Flink | Apache HudiEntry-level Full Time北京、上海1d ago
-
具身世界模型数据工程师 - XiaomiRobotics CNY 180K-264KComputer Vision | Data Engineering | Data Pipelines | Data Quality | Data Quality EvaluationMid-level Full Time北京1d ago
-
【27届校招】云原生Ai平台研发工程师-杭州 CNY 180K-360KArgo Workflow | Argo Workflows | Ceph | Computer Vision | ContainerizationNone Full Time杭州1d ago