Data Engineer
Tasks
- Build data storage solutions
- Deploy and manage data services in cloud
- Design data models and schemas
- Design scalable data pipelines
- Develop ETL processes
- Ensure data governance and security compliance
- Ensure data quality and integrity
- Integrate Kafka and RabbitMQ
- Monitor and troubleshoot data pipelines
- Optimize data retrieval in ClickHouse
- Optimize pipeline performance
- Orchestrate workflows with Airflow
- Process data with Spark
Perks/Benefits
- Career advancement opportunities
- Collaborative work environment
- Flexible dress code
- Professional development
Skills/Tech-stack
Apache Airflow | Apache Spark | ClickHouse | Cloud Security | Data Governance | Data Modeling | ETL | Kafka | Python | RabbitMQ | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Machine Learning Engineer CNY 300K-380KArtifact tracking | Data Lineage | Data Pipelines | Distributed Systems | DockerFitness Events | Free meals | Hybrid working | Paid time off | Volunteer opportunitiesMid-level Full TimeShanghai, China14h ago
-
Principal Feature Engineer CNY 360K-600KARM | C++ | Camera Calibration | Case Development | Computer VisionSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …16h ago
-
Senior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, … R16h ago
-
机器学习平台研发工程师/专家 CNY 240K-360KDebugging | Distributed Training | Docker | Elastic scaling | Fault ToleranceSenior-level Full Time北京、上海21h ago
-
机器人 Vln 大模型导航-实习生 CNY 25K-37KArtificial Intelligence | C++ | CUDA | Computer Vision | Data PipelinesOnsite workEntry-level Internship北京21h ago
-
Entry-level Internship南京21h ago
-
Entry-level Internship南京21h ago
-
Entry-level Internship南京21h ago
-
nlp算法工程师-2027届 CNY 25K-37KDeep learning | DeepSpeed | Information Retrieval | Intent Recognition | Language ProcessingInternshipEntry-level Internship武汉22h ago
-
Entry-level Full Time上海22h ago
-
数据开发实习生 CNY 25K-37KApache Superset | Data Modeling | Data Quality | Data Visualization | Data quality monitoringEntry-level Internship Part Time上海22h ago
-
Entry-level Internship北京23h ago
-
大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37KAsynchronous programming | Concurrency | Distributed Systems | Docker | GRPOEntry-level Internship深圳23h ago
-
AI Agent 开发实习生（通用智能仿真方向） CNY 25K-37KAPI | API Integration | Agent architecture | Agent systems | Asynchronous programmingEntry-level Internship广州23h ago
-
Apache Airflow | Apache Spark | Automated testing | Data Lakes | Data WarehousesCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipSenior-level Full TimeShanghai, China1d ago
-
Embedded Base Software Testing Engineer- Intern CNY 74K-100KC# | CAN | Excel | Hardware-in-the-loop | I2CEntry-level Full Time InternshipWuhan, Hubei, China1d ago
-
Senior Software Engineer (RAG Backend Developer) CNY 120K-180KA/B | A/B Testing | ABAC | Audit Logging | B testingSenior-level Full TimeGuangzhou, Guangdong, China R1d ago
-
Embedded Base Software Testing Engineer- Intern CNY 74K-100KC# | CAN | Excel | Hardware-in-the-loop | I2CEntry-level Full Time InternshipWuhan, Hubei, China1d ago
-
Magnetic Recording Algorithm Development Engineer CNY 150K-240KAlgorithm Development | Automated Test | Automated Test Equipment | C# | C++Senior-level Full TimeShenzhen, Guangdong Province, China1d ago
-
Assistant Manager, Data Platform Delivery CNY 300K-406KARMA | Amazon SageMaker | Association rule | Association rule learning | AzureMid-level Full TimeChina - Guangzhou1d ago
-
Mid-level Full TimeShanghai, Shanghai, China1d ago
-
Senior-level Full TimeShenyang - PIC, China1d ago
-
Mid-level Full Time深圳2d ago
-
Mid-level Full Time深圳2d ago
-
Senior-level Full TimeShanghai, CN, 2012033d ago