AI Data Engineer
Tasks
- Build data pipelines for AI/ML
- Collaborate with data science and AI platform teams
- Contribute to model validation and improvements
- Design data ingestion and retrieval ready datasets
- Design distributed systems for data consistency and throughput
- Develop ETL and ELT workflows
- Drive delivery of AI ML use cases
- Implement data quality checks
- Maintain Delta Lake and Iceberg tables
- Manage lakehouse data partitioning and file formats
- Monitor production data pipelines
- Participate in governance and risk management
- Process unstructured data for AI consumption
- Support data warehouse and data lake environments
- Troubleshoot and trace pipeline failures
- Tune Apache Spark jobs
Perks/Benefits
- Annual leave
- Continuous learning culture
- Development courses
- Digital wellbeing platform
- Employee assistance programme
- Flexible working
- Life insurance
- Medical insurance
- Parental leave
- Retirement savings
- Sabbatical
- Volunteering leave
Skills/Tech-stack
ADLS | Apache Kafka | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Consistency | Data Lake Storage | Data Modeling | Data Quality | Data integration | Databricks | Delta Lake | Distributed Systems | ELT | ETL | Feature Engineering | Feature Store | Flink | Iceberg | Idempotency | Kinesis | Lakehouse | Latency | Minio | Parquet | Pulsar | PySpark | Python | S3 | SQL | Streaming | System design | Throughput | Unity Catalog | Vector
Education
Roles
Related jobs
-
Machine Learning Engineer, Infra (MLOps) CNY 435K-540KAirflow | Apache Spark | Automated testing | CI/CD | Dataset ManagementMid-level Full TimeBeijing, China [Hybrid] R7h ago
-
Senior-level Full Time深圳、北京9h ago
-
中/高级后端开发工程师（Ai算力平台） CNY 144K-240KAPI Gateway | Blue-Green Deployment | Blue/green | CI/CD | Circuit BreakerSenior-level Full Time深圳、北京9h ago
-
大模型算法研究员 CNY 500K-500KAI Feedback | Autoregressive Generation | Data Quality | Data Sampling | Data cleaningEntry-level Full Time深圳、北京、上海10h ago
-
Senior-level Full Time上海、武汉、北京13h ago
-
大语言模型后训练/Agentic算法工程师 CNY 180K-360KAgentic RL | DAPO | Distributed Training | Evaluation Frameworks | Function CallingEntry-level Full Time上海、北京13h ago
-
大模型编排调度工程师（训练&推理方向） CNY 240K-480KAI coding | AI coding tools | Algorithms | Asynchronous programming | C++AI coding tool usage | Fast learning | Team collaborationMid-level Full Time北京、上海14h ago
-
Mid-level Full Time北京、上海14h ago
-
AGI 服务端资深工程师 （AI Agent / AI App） CNY 144K-240KArtificial Intelligence | Backend Development | Benchmarking | Data Engineering | DifySenior-level Full Time北京、上海14h ago
-
Senior-level Full Time北京、上海14h ago
-
AGI 服务端工程师 （AI Agent / AI App） CNY 144K-240KC++ | Containerization | Dify | Distributed Storage | GolangSenior-level Full Time北京、上海14h ago
-
AI Data 研发工程师（大模型数据方向） CNY 180K-264KAirflow | Airflow Workflows | Arrow | Caption Generation | ClusteringMid-level Full Time上海、北京14h ago
-
Agi 后端工程师-下一代Ai数据链路 CNY 144K-240KCache | Data Processing | Data Storage | Data cleaning | Data pipelineEntry-level Full Time北京、上海14h ago
-
AGI 研发 Leader（AI Agent / AI App） CNY 144K-240KBackend Development | Benchmarking | Data Processing | Dify | Distributed SystemsSenior-level Full Time北京、上海14h ago
-
Senior-level Full Time北京、上海14h ago
-
MaaS 平台开发工程师 CNY 180K-420KAPI Development | Backend Development | C++ | Containerization | Distributed SystemsEntry-level Full Time北京、上海14h ago
-
AGI 服务端工程师-Talkie&星野 CNY 144K-240KC++ | Containerization | Dify | Disaster Recovery | Distributed SystemsSenior-level Full Time北京、上海14h ago
-
AGI 服务端资深工程师-Talkie&星野 CNY 144K-240KBackend Development | Dify | Inference Optimization | LLM | LangchainSenior-level Full Time北京、上海14h ago
-
AI Agent 平台研发工程师 CNY 240K-360KCI/CD | Code generation | Container Orchestration | Container Sandbox | DAGMid-level Full Time北京、上海14h ago
-
Senior-level Full Time上海、北京14h ago
-
AI数据分析师（Mcode） CNY 180K-300KAIAgent | Business Intelligence | Dashboard | Data Analysis | Machine LearningMid-level Full Time上海、北京14h ago
-
预训练数据 Pipeline 工程师 CNY 96K-180KApache Arrow | Apache Flink | Apache Hudi | Apache Iceberg | Apache KafkaEntry-level Full Time北京、上海14h ago
-
大模型预训练数据算法工程师 CNY 216K-360KData Deduplication | Data Engineering | Data Filtering | Data Parsing | Data ProcessingMid-level Full Time北京、上海14h ago
-
AI Engineer | Financial Services HKD 425K-586KAWS | Agent-based | Agent-based systems | Azure | CCPAMid-level Full TimeChina - Hong Kong1d ago
-
Principal Data Engineer, Data Technology CNY 300K-420KAPI Development | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimeGuangzhou, Guangdong, China R1d ago