Data Engineer, IS&T Ai & Data Platforms
Tasks
- Build distributed streaming and processing pipelines
- Build real time near real time and batch data pipelines
- Design data pipelines for structured and semi structured data
- Design reporting solutions
- Develop advanced SQL for relational data warehouses and data lakes
- Develop data engineering solutions in Python
- Migrate data to China cluster
- Monitor and adapt software for new platform requirements
- Set up test and validate clusters pipelines applications frameworks
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Kafka | Apache Spark | Apache Superset | Java | PySpark | Python | SQL | Scala | Snowflake | SparkSQL | Streamlit | Tableau
Education
Roles
Related jobs
-
Apache Flink | Apache Kafka | Apache Spark | CI/CD | Data PipelinesMid-level Full TimeShanghai6h ago
-
Algorithms | Concurrency | Containerization | Data Structures | DebuggingSenior-level Full TimeShanghai6h ago
-
CI/CD | Cassandra | Concurrency | Distributed Systems | ElasticsearchSenior-level Full TimeShanghai8h ago
-
AWS | Access Control | Authentication | Azure | CI/CDEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysMid-level Full TimeHangzhou, China14h ago
-
Senior Software Engineer (GenAI Agent platform) CNY 510K-510KBest practices | Engineering Best Practices | Go | Integration Patterns | JavaSenior-level Full TimeGuangzhou, GD, CN, 5106202d ago
-
【2026届春招】AI Infra工程师-算法研发方向 CNY 144K-240KC++ | CUDA | Data parallelism | Distributed Training | HuggingfaceEntry-level Full Time北京、上海 R2d ago
-
Mid-level Full Time北京2d ago
-
Entry-level Internship北京、上海2d ago
-
【校招实习生】AI Infra 工程师-算法研究方向 CNY 25K-37KC++ | CI/CD | CUDA | NCCL | OpenMPIFull-time internship | Open source project opportunitiesEntry-level Internship北京、上海 R2d ago
-
【校招实习生】感知算法工程师 CNY 25K-37KBEV | C plus plus | CenterNet | Computer Vision | DETRInternship opportunityEntry-level Internship北京、上海2d ago
-
【27届校招】Omni模型算法工程师/研究员 CNY 500K-500KData Engineering | Distributed Training | Inference acceleration | Instruction Tuning | Knowledge DistillationEntry-level Full Time深圳、上海、北京2d ago
-
Mid-level Full Time深圳、北京2d ago
-
Entry-level Full Time深圳2d ago
-
None Full Time深圳 R2d ago
-
【27届校招】具身数据infra工程师 CNY 144K-240KAI Coding Agent | AI coding | API Design | Access Control | Code reviewMid-level Full Time深圳、上海、北京2d ago
-
None Full Time深圳、上海、广州2d ago
-
Omni模型算法实习生 CNY 25K-37KAblation Study | Cross-modal alignment | Data Analysis | Data Annotation | Dataset cleaningEntry-level Internship北京、深圳2d ago
-
【27届校招】Omni模型算法工程师/研究员 CNY 500K-500KContext modeling | Data Engineering | Distributed Training | End to End | End to End GenerationEntry-level Full Time深圳、上海、北京2d ago
-
Mid-level Full Time深圳、北京2d ago
-
Entry-level Full Time深圳2d ago
-
None Full Time深圳 R2d ago
-
【27届校招】具身数据infra工程师 CNY 144K-240KAPI Design | Access Control | Code review | Data Cleansing | Data ProcessingMid-level Full Time深圳、上海、北京2d ago
-
【27届校招】具身智能数据算法工程师 - 人类数据 CNY 144K-240K3D Gaussian Splatting | C++ | COLMAP | DPO | Data AnnotationEntry-level Full Time深圳、上海、广州2d ago
-
大模型规划算法工程师- 北京 CNY 240K-480KAgent planning | Context modeling | Deep learning | Dialogue Understanding | Direct Preference OptimizationMid-level Full Time北京2d ago
-
机器人真机强化学习算法实习生 CNY 25K-37KActor-critic | Data Analysis | GRPO | Multimodal Learning | Offline Reinforcement LearningEntry-level Internship上海2d ago