数据Infra 后端开发工程师
Tasks
- Build data lineage
- Build data pipeline
- Collaborate with cross-functional teams
- Design data service APIs
- Design operator orchestration
- Enable observability
- Ensure data quality
- Implement access control
- Implement data processing framework
- Implement failure retry
- Manage data versioning
- Manage metadata platform
- Monitor pipeline runtime
- Perform resource scheduling
- Schedule data tasks
- Set up CI CD release system
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alerting | Argo | Arrow | Batch Processing | C++ | CI/CD | Data orchestration | Data pipeline | DolphinScheduler | Fault Diagnosis | Flink | Go | Hive Metastore | Iceberg | Java | Kafka | Logging | Monitoring | Object storage | Paimon | Parquet | Performance optimization | Python | Ray | Spark | Streaming Data | Task Scheduling
Education
Roles
Backend | Backend & Data Engineer | Data Engineer | Engineer
Regions
Countries
States
Related jobs
-
None Full Time上海7h ago
-
Entry-level Full Time北京8h ago
-
Mid-level Full Time北京8h ago
-
大数据开发工程师 CNY 180K-300KAnomaly Detection | Apache Flink | Apache Spark | Data Governance | Data LakeMid-level Full Time北京8h ago
-
Entry-level Full Time InternshipBeijing8h ago
-
Mid-level Full Time北京8h ago
-
Mid-level Full Time北京8h ago
-
Senior-level Full Time北京、上海8h ago
-
Senior-level Full Time上海、北京8h ago
-
Senior-level Full Time北京、上海9h ago
-
自动驾驶数据挖掘算法开发实习生（Llm/Vlm方向）-2027届 CNY 25K-37KAccuracy | Algorithm Reproducibility | Computer Vision | Coverage | Data PreprocessingEntry-level Internship武汉9h ago
-
技术中心 - 数据开发工程师 CNY 180K-300KData Lineage | Data Modeling | Data Monitoring | Data Observability | Data QualityMid-level Full Time广州9h ago
-
技术中心 - 数据开发工程师 （游戏业务方向） CNY 120K-180KData Modeling | Data Quality | Data Warehouse | Data pipeline | FlinkMid-level Full Time广州9h ago
-
Entry-level Full Time上海9h ago
-
Alerting | Benchmarking | Data Pipelines | Distributed Systems | GPU ComputingMid-level Full TimeChina R21h ago
-
AI Lead Engineer CNY 120K-180KAWS | Ansible | Azure | CI/CD | DockerDevelopment courses | Employee assistance program | Flexible working | Learning opportunities | Medical and life insuranceSenior-level Full TimeTianjin, CN21h ago
-
Mid-level Full TimeChina R22h ago
-
Mid-level Full TimeShanghai, China1d ago
-
Senior-level Full TimeWuxi, Jiangsu, China1d ago
-
Senior Data Platform & Annotation Engineer CNY 360K-600KArtificial Intelligence | Big Data | C++ | CI/CD | Camera image processingSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …1d ago
-
Entry-level Full Time上海1d ago
-
2026校招-Ai院-开源模型适配 & 技术布道 CNY 180K-264KGitHub | Hugging Face | Hugging Face Transformers | Inference Optimization | Model ArchitectureCareer development | Open source community impact | Team collaborationNone Full Time北京1d ago
-
预训练数据 Pipeline 工程师 CNY 96K-180KAI coding | Agent workflow | Apache Arrow | Apache Flink | Apache HudiEntry-level Full Time北京、上海1d ago
-
具身世界模型数据工程师 - XiaomiRobotics CNY 180K-264KComputer Vision | Data Engineering | Data Pipelines | Data Quality | Data Quality EvaluationMid-level Full Time北京1d ago
-
【27届校招】云原生Ai平台研发工程师-杭州 CNY 180K-360KArgo Workflow | Argo Workflows | Ceph | Computer Vision | ContainerizationNone Full Time杭州1d ago