高级大数据架构开发(架构优化方向)
Tasks
- Build feature engineering capabilities
- Build high-availability data infrastructure
- Build job orchestration capabilities
- Build metrics platform
- Conduct technical R and D
- Design data platform architecture
- Develop and tune distributed compute components
- Develop and tune distributed storage components
- Drive Kubernetes based platform evolution
- Integrate and adapt open source components
- Optimize offline data warehouse
- Optimize real time computing
- Optimize resource scheduling system
Perks/Benefits
- N/A
Skills/Tech-stack
Concurrency programming | Data Structures | Flink | Go | HDFS | Hadoop | Helm | Hive | JVM Tuning | Java | Kafka | Karpenter | Kubernetes | Operator | Python | Scala | Spark | Volcano | YARN | Yunikorn
Education
N/A
Roles
Architect | Big Data Engineer | Data Architect | Data Engineer | Engineer
Related jobs
-
Senior-level Full Time上海11h ago
-
Mid-level Full Time深圳、上海18h ago
-
实习-AI模型使用(Safety服务方向) CNY 25K-37KAdversarial Attacks | CI/CD | CNN | Data poisoning | Deep learningEntry-level Internship上海18h ago
-
实习-Ai研究员-大语言模型/视觉语言模型算法与后训练(博士优先) CNY 25K-37KAI Feedback | Direct Preference Optimization | Efficient Fine Tuning | Fine Tuning | FlaxEntry-level Internship上海18h ago
-
Ai算法暑期实习生(Llm/强化学习) CNY 36K-37KDPO | Deep learning | Language Models | Large Language Models | Machine LearningFull-time internship | Onsite internshipEntry-level Internship北京19h ago
-
Executive-level Full TimeHangzhou, China1d ago
-
AI Governance | APIs | AWS | Adversarial Testing | Automated EvaluationExecutive-level Full TimeHangzhou, China1d ago
-
Executive-level Full TimeHangzhou, China1d ago
-
Algorithm Developer IV CNY 400K-540KActive Learning | Bayesian optimization | CI/CD | CUDA | Code ReviewsCareer development support | Health and wellbeing programs | Relocation assistance | Travel opportunities | Work-life supportSenior-level Full TimeHangzhou,CHN, China1d ago
-
Executive-level Full TimeHangzhou, China1d ago
-
AI Governance | C++ | CI/CD | Computer Vision | Continuous DeliveryExecutive-level Full TimeHangzhou, China1d ago
-
Executive-level Full TimeHangzhou, China1d ago
-
Mid-level Full TimeChina3d ago
-
智能软件- AI Agent 开发工程师-南京 CNY 180K-420KAnthropic Claude | Anthropic Claude API | Autogen | Claude API | CrewAINone Full Time南京3d ago
-
C++ | Compliant Control | Contact mechanics | Dexterous Manipulation | Force/torque sensingMid-level Full TimeChina3d ago
-
Docker | Kubernetes | Langsmith | MLflow | MicroservicesMid-level Full TimeChina3d ago
-
C++ | CUDA | Data parallelism | DeepSpeed | InfinibandEntry-level Full TimeChina3d ago
-
C++ | Edge Deployment | GPU | Hardware compilation | Language ModelsMid-level Full TimeChina3d ago
-
Asynchronous programming | Asyncio | Deep learning | DeepSpeed | Distributed TrainingSenior-level Full TimeChina, Shanghai4d ago
-
3D Perception | Bimanual manipulation | C++ | Deep learning | Foundation ModelsMid-level Full TimeChina, Shanghai4d ago
-
C# | C++ | CUDA | Data analytics | Deep learningComprehensive benefits packageMid-level Full TimeChina, Shanghai4d ago
-
Python&BI&AI开发工程师 CNY 180K-360KAsynchronous programming | C++ | DPO | Data Annotation | Data ProcessingIn person collaboration flexibility | Work/life balance focusMid-level Full TimeCN004 - Shanghai, China (CN004)4d ago
-
Mid-level Full TimeChina - Hong Kong5d ago
-
Senior-level Full TimeBeijing Yizhuang, China5d ago
-
Nlp算法工程师 CNY 240K-360KC++ | Deep learning | Information Retrieval | Intent Recognition | Language ModelsMid-level Full Time深圳5d ago