高级大数据架构开发（架构优化方向）
Tasks
- Build feature engineering capabilities
- Build high-availability data infrastructure
- Build job orchestration capabilities
- Build metrics platform
- Conduct technical R and D
- Design data platform architecture
- Develop and tune distributed compute components
- Develop and tune distributed storage components
- Drive Kubernetes based platform evolution
- Integrate and adapt open source components
- Optimize offline data warehouse
- Optimize real time computing
- Optimize resource scheduling system
Perks/Benefits
- N/A
Skills/Tech-stack
Concurrency programming | Data Structures | Flink | Go | HDFS | Hadoop | Helm | Hive | JVM Tuning | Java | Kafka | Karpenter | Kubernetes | Operator | Python | Scala | Spark | Volcano | YARN | Yunikorn
Education
N/A
Roles
Architect | Big Data Engineer | Data Architect | Data Engineer | Engineer
Related jobs
-
Ai算法工程师-汽车专项-实习 CNY 25K-37KAutoml | C# | C++ | Computer Vision | Data ProcessingInternship | Mentorship | Real-world projectsEntry-level Internship南京19h ago
-
Machine Learning Engineer (Training Optimization) CNY 144K-240KCUDA | DeepSpeed | Diffusion Models | Distributed Training | FSDPEntry-level Full TimeBeijing, Beijing, China22h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Entrepreneurial team | Friendly work environment | Hands-off managementMid-level Full TimeShenzhen, China23h ago
-
Mid-level Full Time北京1d ago
-
None Full Time深圳1d ago
-
Mid-level Full Time深圳1d ago
-
Senior-level Full TimeShanghai, China2d ago
-
数据平台工程师 CNY 180K-300KAWS | Azure | CI/CD | CloudFormation | Data GovernanceFlexible work arrangements | In-person collaborationMid-level Full TimeSHC01 - DXC Shanghai Campus Phase …2d ago
-
Sr. Consultant - Data Scientist CNY 360K-540KAgile | Computer Vision | Containerization | Data Governance | Data ScienceEmployee assistance program | Mindfulness programs | On demand digital course library | Personalized wellbeing programs | Volunteer matching programSenior-level Full TimeChina Shanghai (Hongmei)2d ago
-
Sr. Application Engineer CNY 360K-600KAutomated Workflows | C# | Cross-Functional Collaboration | Cross-functional | Data AnalysisSenior-level Full TimeChina - Beijing - Building 102, …2d ago
-
Mid-level Full Time北京 R2d ago
-
Mid-level Full Time武汉2d ago
-
Entry-level Full Time北京 R2d ago
-
Entry-level Full Time北京 R2d ago
-
Mid-level Full Time北京 R2d ago
-
具身世界模型训练INFRA工程师 - XiaomiRobotics CNY 180K-360KDeep learning | DeepSpeed | Distributed Training | Fault Tolerance | KubernetesMid-level Full Time北京2d ago
-
具身智能算法工程师-模型 CNY 500K-500KActor-critic | Deep learning | Distributed Training | Implicit Q Learning | Inference accelerationMid-level Full Time北京 R2d ago
-
Entry-level Full Time北京2d ago
-
AI基础设施研发工程师（Sandbox / 容器化)-MiMo CNY 180K-420KAppArmor | Argo Workflows | CPU resource scheduling | Cgroup | ContainerdMid-level Full Time北京 R2d ago
-
大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37KAsynchronous programming | Concurrency | Distributed Systems | Docker | GitEntry-level Internship深圳2d ago
-
Ai应用工程师（提效方向 0-1） CNY 50K-50KAI Programming | AI Programming Tools | API Integration | JavaScript | Language ProcessingEngineering resource support | Hands-on product development | Model and compute support | Real world usageEntry-level Internship深圳2d ago
-
大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37KAlerting | Asynchronous programming | Concurrency | Data Retrieval | Data StorageEntry-level Internship深圳2d ago
-
Entry-level Full Time北京2d ago
-
Entry-level Internship北京2d ago
-
大语言模型后训练/Agentic算法工程师 CNY 180K-360KAgentic RL | DAPO | Distributed Training | Function Calling | GRPOEntry-level Full Time上海、北京2d ago