数据Infra 后端开发工程师
Tasks
- Build data lineage
- Build data pipeline
- Collaborate with cross-functional teams
- Design data service APIs
- Design operator orchestration
- Enable observability
- Ensure data quality
- Implement access control
- Implement data processing framework
- Implement failure retry
- Manage data versioning
- Manage metadata platform
- Monitor pipeline runtime
- Perform resource scheduling
- Schedule data tasks
- Set up CI CD release system
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alerting | Argo | Arrow | Batch Processing | C++ | CI/CD | Data orchestration | Data pipeline | DolphinScheduler | Fault Diagnosis | Flink | Go | Hive Metastore | Iceberg | Java | Kafka | Logging | Monitoring | Object storage | Paimon | Parquet | Performance optimization | Python | Ray | Spark | Streaming Data | Task Scheduling
Education
Roles
Backend | Backend & Data Engineer | Data Engineer | Engineer
Regions
Countries
States
Related jobs
-
Mid-level Full Time深圳、长沙2h ago
-
具身数据 Infra Engineer CNY 144K-240KData Lineage | Data Quality | Data Validation | Data Versioning | Data pipelineEntry-level Full Time深圳3h ago
-
None Full Time深圳3h ago
-
视觉算法工程师（标定方向）-2027校招 CNY 180K-300KC++ | Camera Calibration | Camera Model | Computer Vision | Coordinate TransformationNone Full Time深圳3h ago
-
Mid-level Full TimeShanghai, Shanghai, China12h ago
-
资深数据开发工程师（自动驾驶数据平台） _Xc CNY 180K-300KANN Index | COS Object Storage | Celery | ClickHouse | Cosine similarityMid-level Full TimeSuzhou, Jiangsu, China16h ago
-
Data Engineer - UCA CNY 144K-240KCloud Data | Cloud Data Platforms | Data Pipeline Monitoring | Data Warehousing | Data orchestrationSenior-level Full TimeShanghai19h ago
-
AI Compiler and Library Engineer CNY 45K-52KAssembly | C# | C++ | Computer Vision | Deep learningCollaborative environment | Hands-on project experience | On-site workEntry-level Full TimeCHN - Minhang, China22h ago
-
Senior Machine Learning Engineer CNY 457K-540KAPIs | Agentic AI | Bias Mitigation | Calibration | Class imbalanceSenior-level Full TimeShenzhen, Guangdong Province, China22h ago
-
Mid-level Full TimeShanghai, China22h ago
-
Mid-level Full TimeShanghai, China22h ago
-
ADAS | AI Agent | AI coding | AI coding assistant | Autonomous DrivingEmployee discounts | Employee events | Flexible working hours | Health measures | Hybrid workMid-level Full TimeShanghai, CN22h ago
-
大数据开发工程师 CNY 180K-300KAI Agent | Anomaly Attribution | Apache Flink | Apache Spark | Data GovernanceMid-level Full Time北京1d ago
-
Omni模型算法工程师/研究员 CNY 500K-500KAgent planning | Audio Processing | Audio to Audio | C++ | Context understandingMid-level Full Time北京、深圳1d ago
-
AI院-GLM团队-AI-Native 全栈工程师（偏后端） CNY 180K-264KAPI Design | CSS | Cloud Native | Database operations | Distributed ComputingMid-level Full Time北京1d ago
-
Mid-level Full Time杭州1d ago
-
AI院--训练Infra工程师 CNY 180K-300KComputer Vision | Distributed Training | Language Models | Language Processing | Large Language ModelsEntry-level Full Time北京1d ago
-
Mid-level Full Time北京1d ago
-
MaaS-SRE/DBA CNY 240K-360KCapacity Planning | Cluster | Docker | Go | GrafanaOn-call duty | Performance optimization goalsSenior-level Full Time北京1d ago
-
Mid-level Full Time北京1d ago
-
Ai算法工程师实习 CNY 25K-37KComputer Vision | Deep learning | Hugging Face | Language Processing | Machine LearningFull-time internship | Long term internship preferred | One to one mentorshipEntry-level Internship合肥、上海1d ago
-
Entry-level Internship上海、北京1d ago
-
数据开发实习生 CNY 25K-37KAI tools | Apache Superset | Data Modeling | Data Quality | Data quality monitoringEntry-level Internship Part Time上海1d ago
-
多模态大模型数据工程师 CNY 25K-37KCorpus Processing | Data Augmentation | Data Automation | Data Quality | Data ValidationEntry-level Internship北京1d ago
-
Entry-level Internship Part Time上海1d ago