AI Data Engineer-
Tasks
- Build data pipelines
- Design data quality checks
- Design system for throughput latency consistency and idempotency
- Implement ETL/ELT pipelines
- Integrate heterogeneous data sources
- Manage unstructured data parsing chunking and normalization
- Monitor production pipelines
- Own data ingestion to retrieval ready data
- Prepare feature ready datasets
- Route pipeline failures
- Support data warehouse and data lake
- Trace and troubleshoot data pipeline issues
- Tune distributed compute jobs
Perks/Benefits
- Annual leave
- Continuous learning culture
- Digital wellbeing platform
- Employee assistance programme
- Flexible benefits
- Flexible working
- Life insurance
- Medical insurance
- Parental leave
- Resilience training
- Retirement savings
- Sabbatical
- Volunteering leave
Skills/Tech-stack
Amazon S3 | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Data Lake | Data Lake Storage | Data Warehouse | Databricks | Delta Lake | Distributed Systems | ELT | ETL | Flink | Iceberg | Kafka | Kinesis | Python | SQL | Streaming | System design | Vector
Education
Roles
Related jobs
-
Data Platform Engineer CNY 277K-370KAWS | Apache Airflow | CI/CD | Data Modeling | Data PrivacyEmployee assistance programme | Flexible working | Learning and development | Life insurance | Medical insuranceSenior-level Full TimeGuangzhou, CN15h ago
-
Amazon CloudWatch | Amazon EKS | Ansible | Apache Airflow | Apache SparkSenior-level Full TimeShanghai20h ago
-
Apache Doris | Automation | Backup | CSI | Cloud ComputingSenior-level Full TimeShanghai20h ago
-
Apache Doris | Backup and Restore | CSI | CockroachDB | CouchbaseSenior-level Full TimeShanghai20h ago
-
Apache Flink | Apache Kafka | Apache Spark | CI/CD | JavaSenior-level Full TimeShanghai20h ago
-
Apache Doris | Backup and Restore | CSI | Cloud automation | CockroachDBSenior-level Full TimeShanghai20h ago
-
Apache Doris | Automation | Backup and Restore | CSI | CockroachDBSenior-level Full TimeShanghai20h ago
-
AWS | Alibaba Cloud | Automation | Backup and Restore | CSISenior-level Full TimeShanghai20h ago
-
Backup and Restore | CSI | CockroachDB | Disaster Recovery | GoSenior-level Full TimeShanghai20h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive compensation | Friendly work environment | Remote-friendlyMid-level Full TimeShanghai, China20h ago
-
资深机器视觉专家 CNY 180K-300KComputer Vision | Deep learning | Docker | Image Segmentation | Image classificationMid-level Full Time北京、上海1d ago
-
Entry-level Full Time北京1d ago
-
Senior-level Full Time常州1d ago
-
Hr智能化（共享服务） CNY 192K-300KAgent Framework | JavaScript | Language Model | Large Language Model | Low CodeMid-level Full Time北京1d ago
-
Mid-level Full Time北京1d ago
-
Senior-level Full Time北京1d ago
-
Mid-level Full Time北京1d ago
-
大模型规划算法工程师- 北京 CNY 240K-480KAgent architecture | Agent systems | Context Management | Deep learning | Dialogue UnderstandingMid-level Full Time北京1d ago
-
Senior-level Full Time InternshipGuangzhou1d ago
-
大数据Ai测试工程师 CNY 144K-240KAPI Testing | Apache Airflow | Data Drift | Data Drift Detection | Data GovernanceMid-level Full Time上海1d ago
-
Senior AI Engineer CNY 120K-180KAPI Integration | AWS SageMaker | Java | JavaScript | LLM integrationSenior-level Full TimeChengdu, China1d ago
-
Senior Data Engineer, Retail Business Intelligence CNY 360K-510KAWS | Alibaba Cloud | CSS | Cloud Computing | Data ModelingSenior-level Full TimeShanghai1d ago
-
Quantitative Developer (C++) HKD 300K-300KAlgorithms | C++ | Data Structures | High Frequency | High-Frequency TradingFree meals | Hybrid work | Paid time off | Social events | Volunteer opportunitiesMid-level Full TimeHong Kong, Shanghai R1d ago
-
Senior Data Engineer, Retail Business Intelligence CNY 336K-510KAWS | Alibaba Cloud | CSS | Cloud Computing | Data LakeSenior-level Full TimeShanghai1d ago
-
Automation Excellence Senior Specialist CNY 360K-600K.NET | AI Document Intelligence | AI Governance | Access Management | Azure AISenior-level Full TimeCNCGD02 - Chengdu - 1-4 Floor, …1d ago