Data Platform Engineer officer
Tasks
- Build shared libraries for ingestion metadata pipelines
- Collaborate on scalable extensible designs
- Design backend services for data platform
- Develop transformation and MDM engine
- Ensure platform security compliance governance
- Implement role based access control security
- Integrate API and consumption layer
- Optimize streaming and batch ingestion frameworks
- Perform code reviews automated testing CI CD
- Provide observability logging metrics traces
- Set up alerting and operational dashboards
- Support on call incident management and troubleshooting
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
AWS | Access Control | Apache Iceberg | Authentication | Azure | CI/CD | Data Catalogs | Data Modeling | Data product | Data product design | Databricks | Distributed Computing | Docker | Enterprise Entitlements | GCP | Java | Kafka | Kubernetes | Metadata Driven | Metadata Management | Metadata driven pipelines | Parquet | Product Design | Python | Role-Based Access | Role-Based Access Control | Rust | SQL | Snowflake | Spark | Trino
Education
N/A
Roles
Data Platform | Data Platform Engineer | Engineer | Platform Engineer
Related jobs
-
Asynchronous Communication | C plus plus | Continuous batching | Data parallelism | Deep learningOn-site workEntry-level Full TimeCHN - Minhang, China14h ago
-
Mid-level Full Time北京19h ago
-
None Full Time上海19h ago
-
Entry-level Internship上海20h ago
-
AI software application developers (CG) CNY 84K-120KAI | Algorithms | Benchmarking | C# | C++Career growth | Continuous learning | Onsite workEntry-level Full TimeCHN - Minhang, China1d ago
-
AI Framework Software Engineer - vLLM CNY 300K-420KAsynchronous Communication | C++ | Data parallelism | Deep learning | Distributed SystemsEntry-level Full TimeCHN - Minhang, China1d ago
-
Mid-level Full TimeXian, Shaanxi, China1d ago
-
Mid-level Full TimeShanghai, China1d ago
-
AI Frameworks Engineer - Model and Kernel Optimization CNY 160K-240KC++ | Deep learning | GPU Programming | Kernel development | PyTorchOn-site workSenior-level Full TimeCHN - Minhang, China1d ago
-
AI Framework Software Engineer – PyTorch CNY 74K-100KC++ | Debugging | Deep learning | Distributed Computing | GPU OptimizationOn-site workEntry-level Full TimeCHN - Minhang, China1d ago
-
AI Compiler and Library Engineer CNY 60K-60KAssembly | C# | C++ | Deep learning | JavaCollaborative environment | Hands-on projects | On-site workEntry-level Full TimeCHN - Minhang, China1d ago
-
Data Analyst Engineer A1 CNY 360K-510KAgile | Bash | CI/CD | CSS | CloudEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China1d ago
-
Senior-level Full TimeCHN - ZJ - Hangzhou, Innovation …1d ago
-
Mid-level Full Time北京1d ago
-
AI基础设施研发工程师（Sandbox / 容器化)-MiMo CNY 144K-240KAlerting | AppArmor | Argo Workflows | CI/CD | CPU SchedulingMid-level Full Time北京1d ago
-
Senior-level Full Time北京1d ago
-
Algorithms | Artificial Intelligence | Concurrency | Containerization | Data StructuresMid-level Full TimeShanghai2d ago
-
Apache Cassandra | Apache Solr | CI/CD | Elasticsearch | JavaSenior-level Full TimeShanghai2d ago
-
Apache Flink | Apache Kafka | Apache Spark | Apache Superset | Data GovernanceMid-level Full TimeShanghai2d ago
-
Machine Learning Engineer CNY 180K-360KAndroid | C# | C++ | Convolutional Neural Network | Deep learningEntry-level Full TimeShanghai, China2d ago
-
.NET 6 | .Net 8 | .Net Framework | Asynchronous programming | C#Mid-level Full TimeChina-Shanghai2d ago
-
Senior-level Full TimeShanghai, Shanghai, China2d ago
-
Senior-level Full TimeShanghai Jing'An Office, China2d ago
-
None Full Time上海2d ago
-
Entry-level Full Time北京2d ago