Data Platform Engineer officer
Tasks
- Build observability logging metrics and tracing
- Build shared libraries for data platform
- Build transformation and MDM engines
- Design and build backend services
- Develop metadata-driven pipelines
- Develop platform security controls
- Ensure security and compliance requirements
- Implement authentication and entitlements integration
- Implement role-based access control
- Implement streaming and batch ingestion frameworks
- Integrate API and data consumption layer
- Participate in on-call and incident management
- Perform code reviews and automated testing
- Set up CI CD and production readiness
- Set up alerting and operational dashboards
- Support scalable extensible platform designs
- Troubleshoot production issues
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
AWS | Apache Iceberg | Apache Spark | Azure | CI/CD | Data Modeling | Databricks | Databricks Unity | Databricks Unity Catalog | Distributed Computing | Docker | GCP | Horizon | Java | Kafka | Kubernetes | Metadata Management | Parquet | Polaris | Python | Rust | SQL | Snowflake | Trino | Unity Catalog
Education
N/A
Related jobs
-
Senior AI Engineer CNY 120K-180KAPI Integration | AWS SageMaker | Java | JavaScript | LLM integrationSenior-level Full TimeChengdu, China7h ago
-
Senior Data Engineer, Retail Business Intelligence CNY 360K-510KAWS | Alibaba Cloud | CSS | Cloud Computing | Data ModelingSenior-level Full TimeShanghai10h ago
-
Senior Data Engineer, Retail Business Intelligence CNY 336K-510KAWS | Alibaba Cloud | CSS | Cloud Computing | Data LakeSenior-level Full TimeShanghai11h ago
-
Automation Excellence Senior Specialist CNY 360K-600K.NET | AI Document Intelligence | AI Governance | Access Management | Azure AISenior-level Full TimeCNCGD02 - Chengdu - 1-4 Floor, …17h ago
-
Data Analytics & Management, SrAssc CNY 510K-510KAPIs | AWS | Apache Iceberg | Apache Spark | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysMid-level Full TimeHangzhou, China17h ago
-
Data Analytics & Management, SrAssc CNY 510K-510KAWS | Apache Iceberg | Apache Spark | CI/CD | Data LineageEmployee networks | Flexible work/life support | Paid volunteer daysMid-level Full TimeHangzhou, China17h ago
-
Data Engineer-AVP CNY 300K-420KAWS | Access Control | Apache Spark | Authentication | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysExecutive-level Full TimeHangzhou, China17h ago
-
Data Platform Engineer officer CNY 336K-510KAWS | Apache Iceberg | Azure | CI/CD | Data CatalogEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China17h ago
-
Data Engineer大数据工程师 CNY 144K-240KAWS Glue | Amazon S3 | Anomaly Detection | Apache Iceberg | Apache SparkSenior-level Full TimeHangzhou22h ago
-
API Integration | Agent Design | Agent evaluation | Context engineering | Data PipelinesEntry-level Full Time深圳23h ago
-
Entry-level Full Time InternshipShenzhen, Changsha23h ago
-
Entry-level Full Time InternshipChangsha, Shenzhen23h ago
-
Agent Design | Agent evaluation | Context engineering | Data Pipelines | LLM APIEntry-level Full Time InternshipShenzhen23h ago
-
Data Infra Agent工程师(Mstar) CNY 240K-480KAlgorithms | C++ | Caching | Cloud Native | Code maintainabilityEntry-level Full Time北京23h ago
-
数据平台研发实习生 CNY 25K-37KArchitecture | Artificial Intelligence | Backend Development | C++ | CachingInternship opportunity | Team collaborationEntry-level Internship上海23h ago
-
【27 届实习】一段式端到端模型算法实习生 CNY 25K-37KCUDA | Computer Vision | Data Augmentation | Data cleaning | Deep learningFlexible team collaboration | Potential full-time conversionEntry-level Internship北京、上海、苏州23h ago
-
Ai 软件工程平台工程师 CNY 180K-300KAgent SDK | Automated testing | CI/CD | Code review | GitIn house deployment | Integration with internal toolchain | Vendor independent architectureMid-level Full TimeShanghai, Shanghai, China1d ago
-
Principal AI Engineer CNY 144K-240KAKS | AWS | Azure | C++ | CI/CDDevelopment courses | Digital wellbeing platform | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeGuangzhou, CN1d ago
-
Agent Frameworks | Boundary testing | Case design | Data Privacy | Data anonymizationEntry-level Full Time InternshipBeijing, Beijing, China1d ago
-
AI Data Engineer CNY 144K-240KADLS | Apache Spark | Data Lake | Data Partitioning | Data ProcessingEmployee assistance programme | Flexible working | Learning and development courses | Life insurance | Medical insuranceSenior-level Full TimeGuangzhou, CN1d ago
-
API | Access Control | Auditability | Automated testing | ConcurrencyFlexible working | Inclusive work culture | Professional developmentMid-level Full TimeGuangzhou, Guangdong, China1d ago
-
Entry-level Full TimeBeijing1d ago
-
Mid-level Full Time惠州 R1d ago
-
Entry-level Full Time上海1d ago
-
机器人多模态算法专家 CNY 240K-480KCLIP | CUDA | Calibration Algorithms | Contrastive Learning | Data collectionSenior-level Full Time上海1d ago