数据湖开发工程师
Tasks
- Build data lake platform
- Deploy data masking and access control
- Develop data lake and warehouse architecture
- Implement data encryption and field level security
- Implement real time data processing architecture
- Integrate data lake with AI and analytics
- Optimize storage and compute performance
- Perform data governance for quality lineage lifecycle
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Amundsen | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Ranger | Apache Sentry | Apache Spark | Approximate Nearest Neighbor | Atlas | Data masking | Datahub | DiskANN | Distributed Storage | Docker | Embedding Generation | Field level encryption | HNSW | Hybrid search | IVF-PQ | Java | KMS | Kubernetes | Nearest neighbor | Object storage | Python | ScaNN | Scala | TDE | Tokenization | Vector Database
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Big Data Engineer | Data Engineer | Data Lake Engineer | Engineer
Related jobs
-
自动驾驶系统开发高级/资深工程师（L4 Robotaxi） CNY 180K-300KActive Safety | Autonomous Driving | C++ | Control | End to EndMid-level Full Time广州 R8h ago
-
AWQ | AWS | Accelerate | Azure | BatchingSenior-level Full TimeGuangzhou, Guangdong, China R1d ago
-
Senior-level Full Time上海 R1d ago
-
Mid-level Full Time上海 R1d ago
-
Senior-level Full Time上海 R1d ago
-
Data Infra高级研发工程师（AI与具身智能数据平台方向） CNY 144K-240KAsynchronous processing | Automated testing | CI/CD | CRD | Cloud NativeSenior-level Full Time上海 R1d ago
-
Ego-Centric视觉感知算法工程师 CNY 180K-300K2D Segmentation | 3D Gaussian Splatting | 3D Hand Pose | 3D Reconstruction | 6D PoseMid-level Full Time上海、北京 R1d ago
-
数据算法开发工程师/专家 CNY 240K-480K2D Computer Vision | 3D Computer Vision | ASR | Ablation Study | Active LearningSenior-level Full Time上海 R1d ago
-
Consultant Specialist (GenAI Agent Platform) CNY 300K-420KAWS | Access Control | Agent Orchestration | Audit Logging | AzureEntry-level Full TimeGuangzhou, Guangdong, China R1d ago
-
APIs | AWS | Agent Orchestration | Agent systems | AzureMid-level Full TimeShenzhen, Guangdong, China R1d ago
-
Senior Consultant Specialist（GenAI Agent platform） CNY 160K-240KAWS | Access Management | Agent Orchestration | Audit Logging | AzureSenior-level Full TimeGuangzhou, Guangdong, China R5d ago
-
Senior Software Engineer (GenAI Agent platform) CNY 160K-240KGo | Java | Langchain | Langgraph | PythonSenior-level Full TimeGuangzhou, Guangdong, China R5d ago
-
Entry-level Full Time上海 R7d ago
-
【2026届春招】AI Infra工程师-算法研发方向 CNY 144K-240KC++ | CUDA | Data parallelism | Distributed Training | HuggingfaceEntry-level Full Time北京、上海 R11d ago
-
【校招实习生】AI Infra 工程师-算法研究方向 CNY 25K-37KC++ | CI/CD | CUDA | NCCL | OpenMPIFull-time internship | Open source project opportunitiesEntry-level Internship北京、上海 R11d ago
-
None Full Time深圳 R11d ago
-
None Full Time深圳 R11d ago
-
Avp - Data And Analytics CNY 300K-420KAWS | BigQuery | Business Analytics | Cloud Computing | Cloud platformFlexible workingExecutive-level Full TimeGuangzhou, Guangdong, China R12d ago
-
Entry-level Full Time北京 R19d ago
-
AVP, AI Solution Lead CNY 144K-240KArtificial Intelligence | Cloud Native | DataOps | DevOps | FlutterContinuous professional development | Flexible workingSenior-level Full TimeGuangzhou, Guangdong, China R19d ago
-
Mid-level Full Time北京 R21d ago
-
Entry-level Full Time北京 R21d ago
-
Nlp / Llm 应用工程师 CNY 180K-360KAnthropic API | Chroma | Embedding | Genspark | Genspark RAG ArchitectureEntry-level Full Time北京 R21d ago
-
Entry-level Full Time北京 R21d ago
-
Senior-level Full Time北京 R21d ago