资深数据开发工程师(自动驾驶数据平台) _Xc
Tasks
- Audit write operations and enforce role authorization
- Build asynchronous task scheduling platform
- Build unified data access layer
- Build vector similarity recall using Lance
- Conduct code reviews and technical knowledge sharing
- Define task orchestration retry and rate limiting
- Design Kubernetes based high availability deployments
- Design data ingestion pipeline
- Design data platform architecture
- Harden SQL injection prevention
- Implement column level data masking
- Implement data security compliance rules
- Manage object storage data flow
- Monitor and govern long running data jobs
- Optimize Trino queries
- Perform slow query governance
- Process and clean large scale vehicle data
- Select data platform technologies
- Sync data with MongoDB and MySQL
Perks/Benefits
- N/A
Skills/Tech-stack
ANN Index | COS Object Storage | Celery | ClickHouse | Cosine similarity | Data Modeling | Django | Django REST | Django REST Framework | Docker | Doris | Hudi | Iceberg | KNN | KNN Similarity | Kafka | Kubernetes | Lance | LevelDB | MQ | MongoDB | MySQL | Object storage | Parquet | Presto | Python | Query Optimization | REST Framework | Rate Limiting | Redis | RocksDB | SQL | Spark SQL | Trino | Vector Search
Education
Related jobs
-
AI Compiler and Library Engineer CNY 45K-52KAssembly | C# | C++ | Computer Vision | Deep learningCollaborative environment | Hands-on project experience | On-site workEntry-level Full TimeCHN - Minhang, China13h ago
-
大数据开发工程师 CNY 180K-300KAI Agent | Anomaly Attribution | Apache Flink | Apache Spark | Data GovernanceMid-level Full Time北京17h ago
-
Omni模型算法工程师/研究员 CNY 500K-500KAgent planning | Audio Processing | Audio to Audio | C++ | Context understandingMid-level Full Time北京、深圳17h ago
-
AI院-GLM团队-AI-Native 全栈工程师(偏后端) CNY 180K-264KAPI Design | CSS | Cloud Native | Database operations | Distributed ComputingMid-level Full Time北京18h ago
-
Mid-level Full Time杭州18h ago
-
AI院--训练Infra工程师 CNY 180K-300KComputer Vision | Distributed Training | Language Models | Language Processing | Large Language ModelsEntry-level Full Time北京18h ago
-
Mid-level Full Time北京18h ago
-
MaaS-SRE/DBA CNY 240K-360KCapacity Planning | Cluster | Docker | Go | GrafanaOn-call duty | Performance optimization goalsSenior-level Full Time北京18h ago
-
Mid-level Full Time北京18h ago
-
Ai算法工程师实习 CNY 25K-37KComputer Vision | Deep learning | Hugging Face | Language Processing | Machine LearningFull-time internship | Long term internship preferred | One to one mentorshipEntry-level Internship合肥、上海19h ago
-
Entry-level Internship上海、北京19h ago
-
数据开发实习生 CNY 25K-37KAI tools | Apache Superset | Data Modeling | Data Quality | Data quality monitoringEntry-level Internship Part Time上海19h ago
-
多模态大模型数据工程师 CNY 25K-37KCorpus Processing | Data Augmentation | Data Automation | Data Quality | Data ValidationEntry-level Internship北京19h ago
-
Entry-level Internship Part Time上海19h ago
-
Senior Machine Learning Engineer USD 20KData Analysis | Data Visualization | Deep learning | Experimentation | Fraud DetectionCareer growth | Competitive compensation | Open, collaborative cultureSenior-level Full TimeShenzhen, China1d ago
-
Senior Data Engineer / AI Engineer CNY 360K-600KAI Agents | Apache Spark | Azure | Data Modeling | DatabricksSenior-level Full TimeShanghai, Shanghai, China1d ago
-
Operations / IE Special II HKD 360K-550KAPI | C# | Data Loss Prevention | Data Modeling | Data VisualizationMid-level Full TimeHK - Hong Kong (HKCHU), Hong …1d ago
-
Android | C# | C++ | Computer Architecture | Data StructuresMid-level Full TimeShanghai, China1d ago
-
C++ | Caffe2 | Computer Vision | Convolutional Neural Network | Deep learningMid-level Full TimeShanghai, China1d ago
-
Machine Learning Engineer CNY 240K-480KAI Deployment | AI Inference | AI acceleration | Android | C++Senior-level Full TimeGuangdong, China1d ago
-
Senior Tools Development Engineer – Machine Learning CNY 360K-600KArtificial Intelligence | Automated testing | Convolutional Neural Networks | Data Augmentation | Deep learningSenior-level Full TimeChina, Shanghai1d ago
-
Senior Data Engineer, Amazon Global Selling -AIT CNY 144K-240KAI Agents | API Integration | Agent Orchestration | Amazon EMR | Apache SparkSenior-level Full TimeShanghai, CHN1d ago
-
Senior AI Engineer CNY 144K-240KAmazon Web Services | Azure | Azure Pipelines | Bias detection | ComplianceSenior-level Full TimeShen Zhen, CN1d ago
-
ARM | Android | C++ | Communication Protocols | Digital CommunicationSenior-level Full TimeShanghai, China2d ago
-
AVP - Data and Analytics CNY 300K-420KA/B | A/B Testing | Automation | B testing | Data CleansingFlexible working | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China2d ago