AI Data Engineer
Tasks
- Build and operate production data pipelines at scale
- Design and optimize lakehouse tables and storage layouts
- Implement ETL and ELT ingestion into Delta Lake or Iceberg
- Monitor production pipelines and trace issues
- Parse and normalize unstructured documents for AI consumption
- Perform data quality checks and route failures
- Prepare feature ready datasets for machine learning and embedding pipelines
- Tune Spark jobs for performance and resource utilization
Perks/Benefits
- Employee assistance programme
- Flexible working
- Learning and development courses
- Life insurance
- Medical insurance
- Parental leave
- Retirement savings
- Sabbatical
- Volunteering leave
- Wellbeing support
Skills/Tech-stack
ADLS | Apache Spark | Data Lake | Data Partitioning | Data Processing | Data Quality | Data Warehouse | Databricks | Delta Lake | ELT | ETL | Feature Engineering | Iceberg | Idempotency | Lakehouse | Minio | Parquet | Python | S3 | SQL | Unity Catalog | Unstructured Data | Unstructured Data Processing
Education
Roles
AI | AI Data Engineer | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Principal AI Engineer CNY 144K-240KAKS | AWS | Azure | C++ | CI/CDDevelopment courses | Digital wellbeing platform | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeGuangzhou, CN6h ago
-
Entry-level Full TimeBeijing19h ago
-
Mid-level Full Time惠州 R20h ago
-
Entry-level Full Time上海20h ago
-
机器人多模态算法专家 CNY 240K-480KCLIP | CUDA | Calibration Algorithms | Contrastive Learning | Data collectionSenior-level Full Time上海20h ago
-
Senior-level Full Time上海20h ago
-
Entry-level Internship北京21h ago
-
视频几何算法工程师 CNY 180K-264KCamera modeling | Coordinate transformations | Depth Estimation | Distributed Training | Multi-view GeometryEntry-level Full Time深圳21h ago
-
Senior-level Full TimeChina, Shanghai1d ago
-
Senior-level Full TimeChina, Shanghai1d ago
-
Senior Web Software Engineer, AI Infrastructure CNY 144K-240KAWS Lambda | Algorithms | Amazon S3 | Amazon SNS | Amazon SQSSenior-level Full TimeChina, Shanghai1d ago
-
Entry-level Full Time上海1d ago
-
自动驾驶系统开发高级/资深工程师（L4 Robotaxi） CNY 180K-300KActive Safety | Autonomous Driving | C++ | Control | End to EndMid-level Full Time广州 R1d ago
-
高级影像高级算法工程师（博士） CNY 240K-480KC++ | Computer Vision | Deep learning | Face Recognition | Image RecognitionSenior-level Full TimeShenzhen1d ago
-
Mid-level Full Time深圳、长沙1d ago
-
Entry-level Full Time深圳、杭州1d ago
-
Mid-level Full Time深圳、上海、杭州1d ago
-
Entry-level Full Time深圳1d ago
-
Ai/Ml系统工程师 CNY 180K-300KData Quality | Data Quality Management | Edge Computing | Functional Safety | Gap QuantificationMid-level Full Time深圳1d ago
-
Senior-level Full TimeShanghai, China2d ago
-
Member of Technical Staff, Machine Learning CNY 144K-240KData Pipelines | Fine Tuning | GPU Computing | Inference Systems | JAXSenior-level Full TimeChina2d ago
-
Technical Lead, Machine Learning CNY 144K-240KDPO | Data Pipelines | Distillation | GPU Optimization | InferenceSenior-level Full TimeChina2d ago
-
Backend Engineer, AI (Agent Systems) CNY 300K-420KAlerting | Anthropic | Batching | Caching | Distributed SystemsMid-level Full TimeChina2d ago
-
Staff Machine Learning Engineer CNY 144K-240KBias Evaluation | DPO | Data Pipelines | GPU Optimization | Inference architectureSenior-level Full TimeChina2d ago
-
Full Stack Engineer, AI systems CNY 160K-240KAlerting | Batching | Caching | Distributed Systems | DockerSenior-level Full TimeChina2d ago