【集团】-大数据开源组件研发工程师
Tasks
- Analyze source code and troubleshoot open source components
- Conduct technical research and implement data platform solutions
- Customize real time and batch computing and storage capabilities
- Design big data platform architecture in cloud environments
- Develop and optimize big data infrastructure core components
- Optimize task scheduling and conduct failure diagnosis
- Perform performance tuning and stability governance for streaming systems
- Reduce cloud costs and manage resources and stability
- Track open source community and cloud vendor products and document best practices
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | C++ | CDC | Checkpointing | Cloud Native | Data Warehouse | Distributed Systems | Fault Tolerance | Flink | Flink Streaming | Go | Google Cloud | Hadoop | Java | Kafka | Real Time | Real Time Data Warehouse | Real-time Data | Resource Management | Scala | Shuffle | Spark | Spark Streaming | Starrocks | State management | Storage Consistency | Task Scheduling
Education
Roles
Related jobs
-
Lead AI Data Engineer CNY 144K-240KAmazon S3 | Apache Iceberg | Apache Spark | Azure Data | Azure Data LakeAnnual leave | Continuous learning culture | Digital wellbeing platform | Employee assistance program | Flexible working optionsSenior-level Full TimeGuangzhou, CN7h ago
-
AI平台与MLOps工程师(27届校招)_BCSC CNY 70KAccess Control | Alerting | Alibaba Cloud | Amazon Web Services | Argo CDEntry-level Full TimeWuxi, Jiangsu, China10h ago
-
Robotics & Automation Engineer CNY 360K-600K3D Software | AutoCAD | C++ | CAD | Lean ManufacturingRelocation assistanceSenior-level Full TimeSuZhou, China13h ago
-
Lead Robotics & Automation Engineer CNY 360K-600KAutoCAD | C++ | Lean Manufacturing | PLC programming | PTC CreoRelocation assistanceSenior-level Full TimeSuZhou, China13h ago
-
Data Platform Engineer CNY 277K-370KAWS | Apache Airflow | CI/CD | Data Modeling | Data PrivacyEmployee assistance programme | Flexible working | Learning and development | Life insurance | Medical insuranceSenior-level Full TimeGuangzhou, CN2d ago
-
AI Data Engineer- CNY 300K-420KAmazon S3 | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake StorageAnnual leave | Continuous learning culture | Digital wellbeing platform | Employee assistance programme | Flexible benefitsMid-level Full TimeGuangzhou, CN2d ago
-
Amazon CloudWatch | Amazon EKS | Ansible | Apache Airflow | Apache SparkSenior-level Full TimeShanghai2d ago
-
Apache Doris | Automation | Backup | CSI | Cloud ComputingSenior-level Full TimeShanghai2d ago
-
Apache Doris | Backup and Restore | CSI | CockroachDB | CouchbaseSenior-level Full TimeShanghai2d ago
-
Apache Flink | Apache Kafka | Apache Spark | CI/CD | JavaSenior-level Full TimeShanghai2d ago
-
Apache Doris | Backup and Restore | CSI | Cloud automation | CockroachDBSenior-level Full TimeShanghai2d ago
-
Apache Doris | Automation | Backup and Restore | CSI | CockroachDBSenior-level Full TimeShanghai2d ago
-
AWS | Alibaba Cloud | Automation | Backup and Restore | CSISenior-level Full TimeShanghai2d ago
-
Backup and Restore | CSI | CockroachDB | Disaster Recovery | GoSenior-level Full TimeShanghai2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive compensation | Friendly work environment | Remote-friendlyMid-level Full TimeShanghai, China2d ago
-
Entry-level Full Time北京2d ago
-
Mid-level Full Time北京2d ago
-
Senior-level Full Time北京2d ago
-
Mid-level Full Time北京2d ago
-
Senior-level Full Time InternshipGuangzhou2d ago
-
大数据Ai测试工程师 CNY 144K-240KAPI Testing | Apache Airflow | Data Drift | Data Drift Detection | Data GovernanceMid-level Full Time上海2d ago
-
Senior AI Engineer CNY 120K-180KAPI Integration | AWS SageMaker | Java | JavaScript | LLM integrationSenior-level Full TimeChengdu, China3d ago
-
Senior Data Engineer, Retail Business Intelligence CNY 360K-510KAWS | Alibaba Cloud | CSS | Cloud Computing | Data ModelingSenior-level Full TimeShanghai3d ago
-
Quantitative Developer (C++) HKD 300K-300KAlgorithms | C++ | Data Structures | High Frequency | High-Frequency TradingFree meals | Hybrid work | Paid time off | Social events | Volunteer opportunitiesMid-level Full TimeHong Kong, Shanghai R3d ago
-
Senior Data Engineer, Retail Business Intelligence CNY 336K-510KAWS | Alibaba Cloud | CSS | Cloud Computing | Data LakeSenior-level Full TimeShanghai3d ago