湖仓开发工程师
Tasks
- Analyze data lineage
- Build data models
- Design and develop permission system
- Design data Lakehouse platform
- Develop and maintain data lakehouse
- Develop data ingestion and collection
- Ensure data quality and consistency
- Implement data processing and ETL
- Maintain Flink jobs
- Maintain Spark jobs
- Manage metadata
- Monitor data quality
- Perform end to end data pipeline development
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Apache Doris | Apache Flink | Apache Hive | Apache Iceberg | Apache Kafka | Apache Spark | Data Ingestion | Data Lineage | Data Modeling | Data Processing | Data Quality | ETL | Go | Java | Metadata Management | Python | Real Time | Real-time Data | Real-time Data Processing | Schema evolution | Time Travel
Education
Roles
Related jobs
-
机器学习平台研发工程师/专家 CNY 240K-360KDebugging | Distributed Training | Docker | Elastic scaling | Fault ToleranceSenior-level Full Time北京、上海10h ago
-
机器人 Vln 大模型导航-实习生 CNY 25K-37KArtificial Intelligence | C++ | CUDA | Computer Vision | Data PipelinesOnsite workEntry-level Internship北京10h ago
-
Entry-level Internship南京10h ago
-
Entry-level Internship南京10h ago
-
Entry-level Internship南京10h ago
-
nlp算法工程师-2027届 CNY 25K-37KDeep learning | DeepSpeed | Information Retrieval | Intent Recognition | Language ProcessingInternshipEntry-level Internship武汉10h ago
-
Entry-level Full Time上海11h ago
-
数据开发实习生 CNY 25K-37KApache Superset | Data Modeling | Data Quality | Data Visualization | Data quality monitoringEntry-level Internship Part Time上海11h ago
-
Entry-level Internship深圳、上海12h ago
-
Entry-level Internship北京12h ago
-
大模型 Infra 研发实习生(Agentic RL 方向) CNY 25K-37KAsynchronous programming | Concurrency | Distributed Systems | Docker | GRPOEntry-level Internship深圳12h ago
-
AI Agent 开发实习生(通用智能仿真方向) CNY 25K-37KAPI | API Integration | Agent architecture | Agent systems | Asynchronous programmingEntry-level Internship广州12h ago
-
Apache Airflow | Apache Spark | Automated testing | Data Lakes | Data WarehousesCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipSenior-level Full TimeShanghai, China23h ago
-
Embedded Base Software Testing Engineer- Intern CNY 74K-100KC# | CAN | Excel | Hardware-in-the-loop | I2CEntry-level Full Time InternshipWuhan, Hubei, China23h ago
-
Senior Software Engineer (RAG Backend Developer) CNY 120K-180KA/B | A/B Testing | ABAC | Audit Logging | B testingSenior-level Full TimeGuangzhou, Guangdong, China R1d ago
-
Embedded Base Software Testing Engineer- Intern CNY 74K-100KC# | CAN | Excel | Hardware-in-the-loop | I2CEntry-level Full Time InternshipWuhan, Hubei, China1d ago
-
Magnetic Recording Algorithm Development Engineer CNY 150K-240KAlgorithm Development | Automated Test | Automated Test Equipment | C# | C++Senior-level Full TimeShenzhen, Guangdong Province, China1d ago
-
Assistant Manager, Data Platform Delivery CNY 300K-406KARMA | Amazon SageMaker | Association rule | Association rule learning | AzureMid-level Full TimeChina - Guangzhou1d ago
-
Mid-level Full TimeShanghai, Shanghai, China1d ago
-
Senior-level Full TimeShenyang - PIC, China1d ago
-
Mid-level Full Time深圳2d ago
-
Mid-level Full Time深圳2d ago
-
Embedded Linux | Extended Kalman | Extended Kalman Filter | GPIO | I2CSenior-level Full TimeShanghai, China2d ago
-
Senior-level Full TimeShanghai, CN, 2012033d ago
-
Data Engineer CNY 360K-600KAPIs | Airflow | Alerting | Anonymization | CI/CDFlexible working models | Health and wellbeing benefits | Professional learning and developmentSenior-level Full TimeShanghai, CN, 2012033d ago