Data Engineer, IS&T Ai & Data Platforms
Tasks
- Build real time near real time and batch data pipelines
- Design data pipelines for structured and semi structured data
- Design reporting solutions
- Develop advanced SQL for data warehouses and data lakes
- Develop data engineering solutions in Python
- Develop self service data engineering applications for business users
- Migrate China datasets to China cluster
- Modify applications and frameworks for China cluster
- Set up and test data platform clusters
- Validate pipelines and applications
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Kafka | Apache Spark | Apache Superset | Data Governance | Data Migration | Data Pipelines | Java | PySpark | Python | SQL | Scala | Snowflake | Spark SQL | Streamlit | Tableau
Education
Roles
Related jobs
-
Mid-level Full Time北京18h ago
-
AI基础设施研发工程师（Sandbox / 容器化)-MiMo CNY 144K-240KAlerting | AppArmor | Argo Workflows | CI/CD | CPU SchedulingMid-level Full Time北京18h ago
-
Senior-level Full Time北京18h ago
-
Algorithms | Artificial Intelligence | Concurrency | Containerization | Data StructuresMid-level Full TimeShanghai1d ago
-
Apache Cassandra | Apache Solr | CI/CD | Elasticsearch | JavaSenior-level Full TimeShanghai1d ago
-
Machine Learning Engineer CNY 180K-360KAndroid | C# | C++ | Convolutional Neural Network | Deep learningEntry-level Full TimeShanghai, China1d ago
-
Senior-level Full TimeShanghai, Shanghai, China1d ago
-
None Full Time上海1d ago
-
Entry-level Full Time北京1d ago
-
Mid-level Full Time北京1d ago
-
大数据开发工程师 CNY 180K-300KAnomaly Detection | Apache Flink | Apache Spark | Data Governance | Data LakeMid-level Full Time北京1d ago
-
Entry-level Full Time InternshipBeijing1d ago
-
Mid-level Full Time北京1d ago
-
Mid-level Full Time北京1d ago
-
Senior-level Full Time北京、上海1d ago
-
Senior-level Full Time上海、北京1d ago
-
Senior-level Full Time北京、上海1d ago
-
自动驾驶数据挖掘算法开发实习生（Llm/Vlm方向）-2027届 CNY 25K-37KAccuracy | Algorithm Reproducibility | Computer Vision | Coverage | Data PreprocessingEntry-level Internship武汉1d ago
-
技术中心 - 数据开发工程师 CNY 180K-300KData Lineage | Data Modeling | Data Monitoring | Data Observability | Data QualityMid-level Full Time广州1d ago
-
技术中心 - 数据开发工程师 （游戏业务方向） CNY 120K-180KData Modeling | Data Quality | Data Warehouse | Data pipeline | FlinkMid-level Full Time广州1d ago
-
Entry-level Full Time上海1d ago
-
Alerting | Benchmarking | Data Pipelines | Distributed Systems | GPU ComputingMid-level Full TimeChina R2d ago
-
AI Lead Engineer CNY 120K-180KAWS | Ansible | Azure | CI/CD | DockerDevelopment courses | Employee assistance program | Flexible working | Learning opportunities | Medical and life insuranceSenior-level Full TimeTianjin, CN2d ago
-
Mid-level Full TimeChina R2d ago
-
Mid-level Full TimeShanghai, China2d ago