Senior Data Engineer, Off
Tasks
- Build and operate batch and streaming pipelines
- Build and publish semantic layer data models
- Capture data lineage
- Define and manage data product interfaces
- Define data semantics and consumption contracts
- Design implement and optimize Iceberg tables partitions and metadata
- Expose models via governed BI endpoints and consumption APIs
- Implement automated data validation and data quality rules
- Integrate source feeds into curated datasets
- Manage production incidents and perform backfills
- Optimize pipeline and query performance
- Process store and deliver reference and application data
- Standardize deployment with CI CD and observability
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
AWS | Apache Iceberg | Apache Spark | Batch Processing | CI/CD | Data Lineage | Data Modeling | Data Quality | Data Validation | Databricks | GCP | Informatica ETL | Java | Microsoft Azure | Observability | Performance Tuning | Python | Reconciliation | SQL | Schema evolution | Snowflake | Streaming processing
Education
N/A
Roles
Related jobs
-
Entry-level Full Time北京、上海4h ago
-
Mid-level Full Time北京 R4h ago
-
数据开发工程师（AI Agent方向） CNY 216K-360KAPI Development | AST | Data Dictionary | Data Governance | Data ModelingMid-level Full TimeBeijing5h ago
-
Ai数据工程实习生（训练数据 & 清洗方向） CNY 25K-37KData Deidentification | Data Pipelines | Data Quality | Data Quality Management | Data StandardizationInternship experience | MentorshipEntry-level Internship上海5h ago
-
Data Analysist / Digital Consultant CNY 304K-399KAPI Integration | AWS Data | AWS Data Lake | Amazon Web Services | Apache SparkFlexible working hours | Inclusive work environment | Work-life balanceMid-level Full TimeShanghai, Asia, China11h ago
-
Principal Perception Engineer CNY 380K-540K3D Geometry | BEV Transformation | C++ | CNN | Camera CalibrationSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …23h ago
-
Senior Perception Engineer CNY 360K-540K3D Geometry | BEV Transformation | C++ | Camera Calibration | Computer VisionSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …23h ago
-
AWS | Apache Iceberg | Apache Spark | Automated testing | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
Senior Data Engineer, Off CNY 260K-366KAPIs | AWS | Apache Iceberg | Apache Spark | BIEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
Data Platform Achitecture - Senior Lead, AVP CNY 397K-520KAWS | Access Control | Apache Iceberg | Audit Logging | CI/CDEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
Senior Data Platform Infrastructure Engineer, Off CNY 397K-540KAWS | AWS CloudFormation | Access Management | Alerting | Audit LoggingEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
AWS | Access Control | Apache Iceberg | Authentication | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
Senior-level Full TimeChina, Shanghai23h ago
-
Senior-level Full Time北京、苏州1d ago
-
Senior-level Full Time上海、苏州、北京、广州、深圳1d ago
-
Mid-level Full Time北京、上海、苏州1d ago
-
Senior-level Full Time上海、苏州、北京、深圳1d ago
-
Deep Learning Planning R&D Engineer CNY 180K-300KAlgorithms | Autonomous Driving | C++ | Computer Vision | Data StructuresMid-level Full Time上海、苏州、北京、深圳1d ago
-
Mid-level Full Time北京、深圳、苏州、上海1d ago
-
Senior-level Full Time北京、上海1d ago
-
Mid-level Full Time北京、上海、苏州1d ago
-
Mid-level Full Time北京、深圳、苏州、上海1d ago
-
Entry-level Full Time深圳1d ago
-
Senior-level Full Time上海1d ago
-
Applied AI Engineer - Silicon Co-Design Group CNY 300K-480KAgent Framework | Autogen | C# | C++ | CrewAISenior-level Full TimeChina, Shanghai1d ago