Data Engineer
Shanghai, CN, 201203
CNY 360K-600K (estimate) Senior-level Full Time
Tasks
- Build real time and batch ingestion
- Convert requirements into production ready systems
- Design and maintain scalable data pipelines
- Develop metadata pipelines
- Evaluate AI ML readiness of data assets
- Implement anonymization and PII controls
- Maintain semantic layers for business terminology
- Set up monitoring alerting and data quality controls
- Troubleshoot complex data issues end to end
- Write production-grade code with testing
Perks/Benefits
Skills/Tech-stack
APIs | Airflow | Alerting | Anonymization | CI/CD | Dagster | Data Contracts | Data Governance | Data Modeling | Delta Lake | Elasticsearch | Git | Integration Testing | Kafka | Kubeflow | Kubeflow Pipelines | Logging | Monitoring | Observability | PII Redaction | Pandas | PostgreSQL | Prefect | PySpark | Pytest | Python | SQL | Schema evolution | Spark | Unit Testing | Version control | Workflow Orchestration
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeShanghai, CN, 20120311h ago
-
Backend Developer - AI & Agentic Applications CNY 360K-600KCI/CD | Distributed Systems | Docker | Error Handling | GoSenior-level Full TimeShanghai, CN, 20120311h ago
-
Ai研发工程师（云服务与大模型部署） CNY 180K-300KC++ | CI/CD | Cloud Computing | Distributed Systems | Edge ComputingMid-level Full Time深圳16h ago
-
大模型算法工程师（Memory/RAG/意图识别） CNY 180K-360KComputer Vision | Data Processing | Data cleaning | Data labeling | Dataset developmentEntry-level Full Time深圳16h ago
-
AI应用研发工程师（架构设计/RAG/Agent） CNY 180K-300KCI/CD | Context Management | Data pipeline | Deep learning | DockerMid-level Full Time深圳16h ago
-
Entry-level Full Time深圳16h ago
-
Entry-level Full Time深圳16h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work environment | Competitive salary | Laid-back atmosphere | Remote-friendly cultureMid-level Full TimeShenzhen, China1d ago
-
Data Analysis | Machine Learning | Python | Quantitative Finance | Statistical modelingCollaborative environment | Health insurance | InsuranceMid-level Full TimeBeijing, Beijing, China2d ago
-
AVP - Data and Analytics CNY 300K-420KAI Governance | Algorithmic Compliance | Audit evidence | Behavioral analytics | Cause analysisFlexible working | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China2d ago
-
ANSYS APDL | C Programming | Design of Experiments | Durability analysis | Element analysisMid-level Full TimeWuhan, Hubei, China2d ago
-
Ai算法工程师 CNY 144K-240KBig Data | Big data processing | Data Processing | Deep learning | Feature EngineeringEntry-level Full Time深圳2d ago
-
【校招实习】Ai算法工程师 CNY 25K-37KComputer Vision | Data Analysis | Deep learning | Feature Engineering | HadoopInternship opportunityEntry-level Internship深圳2d ago
-
Entry-level Internship深圳2d ago
-
Mid-level Full Time北京 R2d ago
-
Entry-level Full Time北京 R2d ago
-
Ai数据闭环研发工程师 CNY 240K-360KData Distribution | Data Distribution Strategy | Data Flywheel | Data Mining | Data evaluationSenior-level Full Time上海、北京2d ago
-
Mid-level Full Time上海2d ago
-
Senior-level Full Time上海、武汉、北京2d ago
-
算法工程师-大模型数据方向 CNY 240K-360KAnnotation Automation | Apache Spark | Clustering | Data Annotation | Data GovernanceSenior-level Full Time上海2d ago
-
Mid-level Full Time上海2d ago
-
Mid-level Full Time上海2d ago
-
Senior-level Full Time上海2d ago
-
Mid-level Internship上海、北京2d ago
-
Mid-level Full Time上海2d ago