数据Infra 后端开发工程师
Tasks
- Build data lineage
- Build data pipeline
- Collaborate with cross-functional teams
- Design data service APIs
- Design operator orchestration
- Enable observability
- Ensure data quality
- Implement access control
- Implement data processing framework
- Implement failure retry
- Manage data versioning
- Manage metadata platform
- Monitor pipeline runtime
- Perform resource scheduling
- Schedule data tasks
- Set up CI CD release system
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alerting | Argo | Arrow | Batch Processing | C++ | CI/CD | Data orchestration | Data pipeline | DolphinScheduler | Fault Diagnosis | Flink | Go | Hive Metastore | Iceberg | Java | Kafka | Logging | Monitoring | Object storage | Paimon | Parquet | Performance optimization | Python | Ray | Spark | Streaming Data | Task Scheduling
Education
Roles
Backend | Backend & Data Engineer | Data Engineer | Engineer
Regions
Countries
States
Related jobs
-
Senior-level Full Time深圳、北京3h ago
-
中/高级后端开发工程师（Ai算力平台） CNY 144K-240KAPI Gateway | Blue-Green Deployment | Blue/green | CI/CD | Circuit BreakerSenior-level Full Time深圳、北京3h ago
-
大模型算法研究员 CNY 500K-500KAI Feedback | Autoregressive Generation | Data Quality | Data Sampling | Data cleaningEntry-level Full Time深圳、北京、上海5h ago
-
Senior-level Full Time上海、武汉、北京7h ago
-
大语言模型后训练/Agentic算法工程师 CNY 180K-360KAgentic RL | DAPO | Distributed Training | Evaluation Frameworks | Function CallingEntry-level Full Time上海、北京8h ago
-
Senior-level Full Time北京、上海8h ago
-
大模型编排调度工程师（训练&推理方向） CNY 240K-480KAI coding | AI coding tools | Algorithms | Asynchronous programming | C++AI coding tool usage | Fast learning | Team collaborationMid-level Full Time北京、上海8h ago
-
Mid-level Full Time北京、上海8h ago
-
Senior-level Full Time北京、上海8h ago
-
AGI 服务端工程师 （AI Agent / AI App） CNY 144K-240KC++ | Containerization | Dify | Distributed Storage | GolangSenior-level Full Time北京、上海8h ago
-
AI Data 研发工程师（大模型数据方向） CNY 180K-264KAirflow | Airflow Workflows | Arrow | Caption Generation | ClusteringMid-level Full Time上海、北京8h ago
-
Agi 后端工程师-下一代Ai数据链路 CNY 144K-240KCache | Data Processing | Data Storage | Data cleaning | Data pipelineEntry-level Full Time北京、上海8h ago
-
AGI 研发 Leader（AI Agent / AI App） CNY 144K-240KBackend Development | Benchmarking | Data Processing | Dify | Distributed SystemsSenior-level Full Time北京、上海8h ago
-
Senior-level Full Time北京、上海8h ago
-
MaaS 平台开发工程师 CNY 180K-420KAPI Development | Backend Development | C++ | Containerization | Distributed SystemsEntry-level Full Time北京、上海8h ago
-
AGI 服务端工程师-Talkie&星野 CNY 144K-240KC++ | Containerization | Dify | Disaster Recovery | Distributed SystemsSenior-level Full Time北京、上海8h ago
-
AI Agent 平台研发工程师 CNY 240K-360KCI/CD | Code generation | Container Orchestration | Container Sandbox | DAGMid-level Full Time北京、上海8h ago
-
预训练数据 Pipeline 工程师 CNY 96K-180KApache Arrow | Apache Flink | Apache Hudi | Apache Iceberg | Apache KafkaEntry-level Full Time北京、上海8h ago
-
大模型预训练数据算法工程师 CNY 216K-360KData Deduplication | Data Engineering | Data Filtering | Data Parsing | Data ProcessingMid-level Full Time北京、上海8h ago
-
AI Engineer | Financial Services HKD 425K-586KAWS | Agent-based | Agent-based systems | Azure | CCPAMid-level Full TimeChina - Hong Kong20h ago
-
Principal Data Engineer, Data Technology CNY 300K-420KAPI Development | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimeGuangzhou, Guangdong, China R1d ago
-
Data Analysis | Incident Management | Infrastructure Technology | Infrastructure technology analysis | MonitoringFlexible work model | In-person collaboration | Inclusive work environment | Productivity support | Wellbeing supportMid-level Full TimeCN004 - Shanghai, China (CN004)1d ago
-
Lead Robotics Software Engineer CNY 360K-600KArtificial Intelligence | C++ | CI/CD | Code Quality | Computer VisionSenior-level Full TimeChina - Shenzhen Office1d ago
-
Senior-level Full Time北京、广州、上海3d ago
-
Data Processing | Deep learning | Distributed Training | Generative Models | LLMFamily leave | Free food and snacks | Health care plan | Life insurance | Long-term disabilitySenior-level Full Time费利蒙3d ago