Data Engineer大数据工程师
Tasks
- Build automated data quality diagnosis
- Build multi source batch and streaming pipelines
- Create observability for data pipelines
- Develop layered data models
- Implement data quality tests and alerting
- Implement dbt models for analytics
- Improve CI workflows and documentation
- Optimize AWS Glue performance and cost
- Optimize ClickHouse performance and cost
- Optimize Spark performance and cost
- Perform anomaly root cause analysis
- Scale lakehouse architecture
- Search and answer data asset questions using AI
- Standardize unified business metrics
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Amazon S3 | Anomaly Detection | Apache Iceberg | Apache Spark | Athena | Backfilling | CI/CD | ClickHouse | DBT | Dagster | Data Observability | Data Quality | DuckDB | Go | Idempotency | Incremental loading | Java | Logging | OLAP | Python | SQL | Trino | Unit Testing
Education
N/A
Roles
Related jobs
-
Ai 软件工程平台工程师 CNY 180K-300KAgent SDK | Automated testing | CI/CD | Code review | GitIn house deployment | Integration with internal toolchain | Vendor independent architectureMid-level Full TimeShanghai, Shanghai, China10h ago
-
Principal AI Engineer CNY 144K-240KAKS | AWS | Azure | C++ | CI/CDDevelopment courses | Digital wellbeing platform | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeGuangzhou, CN14h ago
-
Agent Frameworks | Boundary testing | Case design | Data Privacy | Data anonymizationEntry-level Full Time InternshipBeijing, Beijing, China14h ago
-
AI Data Engineer CNY 144K-240KADLS | Apache Spark | Data Lake | Data Partitioning | Data ProcessingEmployee assistance programme | Flexible working | Learning and development courses | Life insurance | Medical insuranceSenior-level Full TimeGuangzhou, CN14h ago
-
Embedded Software Engr. CNY 360K-600KARM Cortex | ARM Cortex-M | Abstraction layer | Agile | Board SupportFlexible work environmentEntry-level Full TimeSuzhou Jiangsu, P.R., Suzou, China14h ago
-
API | Access Control | Auditability | Automated testing | ConcurrencyFlexible working | Inclusive work culture | Professional developmentMid-level Full TimeGuangzhou, Guangdong, China19h ago
-
Entry-level Full TimeBeijing1d ago
-
Mid-level Full Time惠州 R1d ago
-
Entry-level Full Time上海1d ago
-
机器人多模态算法专家 CNY 240K-480KCLIP | CUDA | Calibration Algorithms | Contrastive Learning | Data collectionSenior-level Full Time上海1d ago
-
Senior-level Full Time上海1d ago
-
Entry-level Internship北京1d ago
-
视频几何算法工程师 CNY 180K-264KCamera modeling | Coordinate transformations | Depth Estimation | Distributed Training | Multi-view GeometryEntry-level Full Time深圳1d ago
-
People Analytics Developer and Software Engineer CNY 300K-420KBash | Caching | Data Modeling | Docker | DockerfileSenior-level Full TimeShanghai1d ago
-
Senior-level Full TimeChina, Shanghai1d ago
-
Senior-level Full TimeChina, Shanghai1d ago
-
Android Automotive | Audio Video Routing | Audio codecs | Audio/Video | C#Senior-level Full TimeBeijing1d ago
-
Senior Web Software Engineer, AI Infrastructure CNY 144K-240KAWS Lambda | Algorithms | Amazon S3 | Amazon SNS | Amazon SQSSenior-level Full TimeChina, Shanghai1d ago
-
Entry-level Full Time上海2d ago
-
自动驾驶系统开发高级/资深工程师（L4 Robotaxi） CNY 180K-300KActive Safety | Autonomous Driving | C++ | Control | End to EndMid-level Full Time广州 R2d ago
-
高级影像高级算法工程师（博士） CNY 240K-480KC++ | Computer Vision | Deep learning | Face Recognition | Image RecognitionSenior-level Full TimeShenzhen2d ago
-
Mid-level Full Time深圳、长沙2d ago
-
Entry-level Full Time深圳、杭州2d ago
-
Mid-level Full Time深圳、上海、杭州2d ago
-
Entry-level Full Time深圳2d ago