大数据开发工程师
Tasks
- Build daily batch data pipelines
- Create data development coding standards
- Create data warehouse architecture standards
- Define warehouse layers for write and query performance
- Design data warehouse dimensional models
- Develop data service interfaces for BI and applications
- Develop real time stream processing jobs
- Implement data validation rules and automated checks
- Ingest data from files databases logs and message queues
- Maintain data assets directory with business and technical metadata
- Monitor data production timeliness
- Optimize job scheduling pipelines and SQL performance
- Write ETL with Hive and Spark SQL
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Hive | Apache Spark | DataWorks | Dimensional Modeling | DolphinScheduler | ETL | Java | Kettle | Python | SQL | Shell | Sqoop
Education
Roles
Related jobs
-
Dba 数据库工程师-2027届 CNY 180K-300KDatabase high availability | Database performance | Database performance tuning | Go | High AvailabilityNone Full Time北京、上海5h ago
-
Mid-level Full Time北京 R7h ago
-
Entry-level Full Time北京 R8h ago
-
高级算法工程师（Nlp方向） CNY 240K-480KAgent memory | CUDA | Chroma | Client-Server | Client-Server ArchitectureSenior-level Full Time北京8h ago
-
Nlp / Llm 应用工程师 CNY 180K-360KAnthropic API | Chroma | Embedding | Genspark | Genspark RAG ArchitectureEntry-level Full Time北京 R8h ago
-
Mid-level Full Time北京 R8h ago
-
Entry-level Full Time北京 R8h ago
-
Mid-level Full Time北京8h ago
-
Mid-level Full Time深圳11h ago
-
大数据平台Java开发实习生 CNY 50K-50KData integration | Flink | Hadoop | Java | KafkaInternship certificate | MentorshipEntry-level Internship上海12h ago
-
Apache Spark | Batch Processing | BigQuery | Cloud platform | Data GovernanceSenior-level Full TimeShenzhen, Guangdong Province, China18h ago
-
Senior-level Full TimeLOC3254: No.3239 Shenjiang Road, Shanghai, Pudong …1d ago
-
Senior-level Full TimeLOC3254: No.3239 Shenjiang Road, Shanghai, Pudong …1d ago
-
Ego-Centric 视觉感知算法工程师- Genie业务部 CNY 144K-240K3D Gaussian Splatting | 3D Pose Estimation | 3D point cloud | 6D Pose Estimation | Bundle adjustmentMid-level Full Time上海 R1d ago
-
None Full Time上海1d ago
-
2026届秋招-大数据开发工程师 CNY 144K-240KApache Spark | Java | Linux | Python | SQLCareer mentorship | Technical trainingNone Full Time上海1d ago
-
2027届实习-算法数据开发工程师 CNY 96K-144KData Validation | Data Warehousing | Database fundamentals | Distributed Systems | ETLGlobal exposure | Hands-on projects | Learning opportunities | Technical mentorshipEntry-level Internship上海 R1d ago
-
Entry-level Internship合肥1d ago
-
Forward Deployed AI Engineer CNY 96K-144KAmazon Web Services | Artificial Intelligence | BigQuery | Cloud platform | Google CloudTravel up to 50 percentEntry-level Full Time Internship北京1d ago
-
Mid-level Full Time北京 R1d ago
-
Mid-level Full Time Temporary北京1d ago
-
Mid-level Full Time北京 R1d ago
-
Research MLE (Training Optimization）大模型训练优化工程师 CNY 144K-240KC++ | CUDA | DeepSpeed | Distributed Training | FSDPSenior-level Full TimeBeijing, Beijing, China2d ago
-
Senior-level Full TimeCN-OCG International Center, Cheng Du, China2d ago
-
Data Engineering - AI Platform Engineer CNY 300K-399KAWS | Access Control | Alerting | Authentication | Automated testingEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysMid-level Full TimeHangzhou, China2d ago