【集团】-大数据开源组件研发工程师
Tasks
- Analyze source code and troubleshoot open source components
- Conduct technical research and implement data platform solutions
- Customize real time and batch computing and storage capabilities
- Design big data platform architecture in cloud environments
- Develop and optimize big data infrastructure core components
- Optimize task scheduling and conduct failure diagnosis
- Perform performance tuning and stability governance for streaming systems
- Reduce cloud costs and manage resources and stability
- Track open source community and cloud vendor products and document best practices
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | C++ | CDC | Checkpointing | Cloud Native | Data Warehouse | Distributed Systems | Fault Tolerance | Flink | Flink Streaming | Go | Google Cloud | Hadoop | Java | Kafka | Real Time | Real Time Data Warehouse | Real-time Data | Resource Management | Scala | Shuffle | Spark | Spark Streaming | Starrocks | State management | Storage Consistency | Task Scheduling
Education
Roles
Related jobs
-
Entry-level Full Time北京5h ago
-
Mid-level Full TimeBeijing, China19h ago
-
数据开发主任 CNY 300K-420KAWS Lambda | AWS Redshift | AWS S3 | Amazon EMR | Apache AirflowCareer growth | Mentorship | Multi cloud platform experienceExecutive-level Full TimeGuangzhou, GD, CN23h ago
-
Senior Specialist, AI Application CNY 144K-240KAPI Integration | AWS | Azure | CI/CD | Cloud platformSenior-level Full TimeCN-OCG International Center, Cheng Du, China23h ago
-
Senior Specialist, AI Application CNY 144K-240KAPI Integration | AWS | Azure | CI/CD | Cloud platformSenior-level Full TimeCN-OCG International Center, Cheng Du, China23h ago
-
Sre CNY 144K-240KAWS | Azure | CI/CD | CloudFormation | ContainerizationFlexible work arrangementsMid-level Full TimeSHC01 - DXC Shanghai Campus Phase …23h ago
-
Entry-level Internship上海1d ago
-
Mid-level Full Time上海1d ago
-
AVP, AI Solution Lead CNY 144K-240KArtificial Intelligence | Cloud Native | DataOps | DevOps | FlutterContinuous professional development | Flexible workingSenior-level Full TimeGuangzhou, Guangdong, China R1d ago
-
Active Directory | Amazon Web Services | Ansible | Apache Airflow | Apache KafkaMid-level Full TimeShanghai, SH, CN1d ago
-
AVP, AI Solution Lead CNY 144K-240KCloud Native | Cloud deployment | DataOps | DevOps | FlutterContinuous professional development | Flexible working | Inclusive work environmentSenior-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
AWS | Access Control | Alerting | Authentication | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysMid-level Full TimeHangzhou, China1d ago
-
Entry-level Full Time深圳2d ago
-
None Full Time北京、上海2d ago
-
None Full Time上海、北京、深圳2d ago
-
Senior-level Full Time上海、北京、深圳2d ago
-
None Full Time上海2d ago
-
Senior-level Full Time上海2d ago
-
Entry-level Full Time广州、上海2d ago
-
Entry-level Internship苏州2d ago
-
AI Foundation Model方向实习生 CNY 25K-37KC++ | Caffe | Computer Vision | Data Structures | Data Structures and AlgorithmsEntry-level Internship北京、上海2d ago
-
Mid-level Full Time深圳 R2d ago
-
【27届校招提前批】算法工程师 CNY 180K-360KAgent collaboration | Asynchronous programming | Caching | Concurrency | Context engineeringNone Full Time上海2d ago
-
Entry-level Full Time北京2d ago
-
Mid-level Full TimeBeijing, China2d ago