Senior Data Platform Engineer, Off
Tasks
- Build logging metrics and tracing
- Build streaming and batch ingestion frameworks
- Conduct code reviews and automated testing
- Create reusable platform components
- Deliver production readiness with CICD
- Design backend services and shared libraries
- Develop metadata-driven pipelines
- Ensure security and compliance requirements
- Implement role-based access control and authentication
- Implement transformation engine and MDM engine
- Integrate API and consumption layers
- Integrate enterprise entitlements
- Participate in on-call and incident management
- Set up alerting and operational dashboards
- Troubleshoot production issues
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
AWS | Access Control | Apache Iceberg | Authentication | Azure | CI/CD | Data Catalog | Data Modeling | Databricks | Distributed tracing | Docker | GCP | Java | Kafka | Kubernetes | Logging | Metadata Management | Metrics | Parquet | Python | Role-Based Access | Role-Based Access Control | Rust | SQL | Snowflake | Spark | Trino
Education
N/A
Related jobs
-
Entry-level Full Time北京、上海4h ago
-
Mid-level Full Time北京 R4h ago
-
数据开发工程师（AI Agent方向） CNY 216K-360KAPI Development | AST | Data Dictionary | Data Governance | Data ModelingMid-level Full TimeBeijing5h ago
-
Data Analysist / Digital Consultant CNY 304K-399KAPI Integration | AWS Data | AWS Data Lake | Amazon Web Services | Apache SparkFlexible working hours | Inclusive work environment | Work-life balanceMid-level Full TimeShanghai, Asia, China11h ago
-
Principal Perception Engineer CNY 380K-540K3D Geometry | BEV Transformation | C++ | CNN | Camera CalibrationSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …23h ago
-
Senior Perception Engineer CNY 360K-540K3D Geometry | BEV Transformation | C++ | Camera Calibration | Computer VisionSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …23h ago
-
Senior Data Engineer, Off CNY 260K-366KAWS | Apache Iceberg | Apache Spark | Batch Processing | CI/CDEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
AWS | Apache Iceberg | Apache Spark | Automated testing | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
Senior Data Engineer, Off CNY 260K-366KAPIs | AWS | Apache Iceberg | Apache Spark | BIEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
Data Platform Achitecture - Senior Lead, AVP CNY 397K-520KAWS | Access Control | Apache Iceberg | Audit Logging | CI/CDEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
Senior Data Platform Infrastructure Engineer, Off CNY 397K-540KAWS | AWS CloudFormation | Access Management | Alerting | Audit LoggingEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China23h ago
-
Senior-level Full TimeChina, Shanghai23h ago
-
Senior-level Full Time北京、苏州1d ago
-
Senior-level Full Time上海、苏州、北京、广州、深圳1d ago
-
Mid-level Full Time北京、上海、苏州1d ago
-
Senior-level Full Time上海、苏州、北京、深圳1d ago
-
Deep Learning Planning R&D Engineer CNY 180K-300KAlgorithms | Autonomous Driving | C++ | Computer Vision | Data StructuresMid-level Full Time上海、苏州、北京、深圳1d ago
-
Mid-level Full Time北京、深圳、苏州、上海1d ago
-
Senior-level Full Time北京、上海1d ago
-
Mid-level Full Time北京、上海、苏州1d ago
-
Mid-level Full Time北京、深圳、苏州、上海1d ago
-
Entry-level Full Time深圳1d ago
-
Senior-level Full Time上海1d ago
-
Applied AI Engineer - Silicon Co-Design Group CNY 300K-480KAgent Framework | Autogen | C# | C++ | CrewAISenior-level Full TimeChina, Shanghai1d ago
-
Data Analysis Engineer CNY 25K-37KArtificial Intelligence | Dashboard Development | Data Analysis | Data Visualization | Data cleaningEntry-level Full TimeGuangzhou, China1d ago