大数据开发工程师
Tasks
- Build real time streaming jobs
- Create data warehouse architecture design principles
- Design data warehouse models
- Develop data extraction tasks with Sqoop
- Develop offline data pipelines
- Generate data service interfaces
- Implement data quality validation programs
- Maintain data assets metadata
- Monitor data output timeliness
- Optimize scheduling and SQL performance
- Write ETL with Hive and Spark SQL
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Hive | Apache Spark | Data Warehouse | DataWorks | Dimensional Modeling | Distributed Computing | Distributed Storage | Dolphin Scheduler | ETL | Java | Kettle | Performance Tuning | Python | SQL | SQL Performance | SQL Performance Tuning | Shell
Education
Roles
Related jobs
-
Entry-level Full Time广州6h ago
-
Entry-level Internship北京7h ago
-
Entry-level Internship上海8h ago
-
Mid-level Full Time上海1d ago
-
SAP China iXP Intern - Generative AI Developer CNY 28K-50KAgentic Workflows | Agile | Data analytics | Generative AI | JavaEntry-level InternshipShanghai, CN, 2012032d ago
-
Mid-level Full Time武汉8d ago
-
Entry-level Full Time北京8d ago
-
Entry-level Full Time北京、上海8d ago
-
Data Analyst(Power BI Data Visualization Specialist) CNY 272K-370KData Cleansing | Data Modeling | Data Transformation | Data Visualization | Performance optimizationCareer growth in AI initiatives | Collaborative team environment | Hybrid work environment | Work with business stakeholdersMid-level Full TimeChengdu, Manulife Information and Technology Center, …12d ago
-
Data Analyst(Power BI Data Visualization Specialist) CNY 272K-370KData Cleansing | Data Modeling | Data Transformation | Data Visualization | Power BIHybrid work environmentMid-level Full TimeChengdu, Manulife Information and Technology Center, …12d ago
-
Software Engineering & Development, AVP CNY 300K-420KAI Governance | API Development | AWS | Adversarial Robustness | AlertingExecutive-level Full TimeHangzhou, China14d ago
-
Executive-level Full TimeHangzhou, China14d ago
-
.Net Core | Agile | Anaconda | Automated testing | C#Mid-level Full TimeShanghai, Shanghai, China14d ago
-
Agent 服务端开发实习生（AI Agent / AI App） CNY 37K-37KContainerization | Cpluspluplus | Dify | Distributed Systems | GoEntry-level Internship北京、上海15d ago
-
Entry-level Full Time北京、上海15d ago
-
None Full Time南京19d ago
-
Data Engineer CNY 180K-300KBigQuery | Data Modeling | Data Quality | Data Visualization | Data WarehousingMid-level Full TimeShenzhen, Guangdong Province, China20d ago
-
Mid-level Full Time北京25d ago
-
Senior-level Full Time上海29d ago
-
Technical Engineer Chatbot CNY 240K-360KAI Services | AI orchestration | API Integration | Access Control | Agentic AISenior-level Full TimeShanghai, CN29d ago
-
Executive-level Full TimeHangzhou, China30d ago
-
AI Governance | APIs | AWS | Adversarial Testing | Automated EvaluationExecutive-level Full TimeHangzhou, China30d ago
-
Executive-level Full TimeHangzhou, China30d ago
-
Algorithm Developer IV CNY 400K-540KActive Learning | Bayesian optimization | CI/CD | CUDA | Code ReviewsCareer development support | Health and wellbeing programs | Relocation assistance | Travel opportunities | Work-life supportSenior-level Full TimeHangzhou,CHN, China30d ago
-
Executive-level Full TimeHangzhou, China30d ago