Data Engineer
Shanghai, CN, 201203
CNY 360K-600K (estimate) Senior-level Full Time
Tasks
- Automate ingestion validation
- Build real time and batch ingestion
- Conduct root cause analysis
- Deploy production ready data systems
- Design scalable data pipelines
- Develop metadata pipelines for profiling and lineage
- Develop production grade data code
- Enforce data quality controls
- Establish monitoring and alerting
- Evaluate AI ML readiness of data assets
- Implement anonymization and PII controls
- Implement unit and integration testing
- Maintain data pipeline architecture
- Map technical fields to business terminology
- Perform code reviews
- Troubleshoot data issues and reliability incidents
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Airflow | Alerting | Anonymization | Apache Spark | CI/CD | Dagster | Data Contracts | Data Governance | Data Modeling | Data redaction | Delta Lake | Elasticsearch | Git | Integration Testing | Kafka | Kubeflow Pipelines | Logging | Metrics | Observability | PII handling | Pandas | Polling | PostgreSQL | Prefect | Push based ingestion | PySpark | Pytest | Python | SQL | Schema evolution | Unit Testing | Workflow Orchestration
Education
Roles
Related jobs
-
Data Engineer CNY 360K-600KAPIs | Airflow | Alerting | Anonymization | CI/CDFlexible working models | Health and wellbeing benefits | Professional learning and developmentSenior-level Full TimeShanghai, CN, 20120312h ago
-
Backend Developer - AI & Agentic Applications CNY 360K-600KCI/CD | Distributed Systems | Docker | Error Handling | GoSenior-level Full TimeShanghai, CN, 20120312h ago
-
Ai研发工程师（云服务与大模型部署） CNY 180K-300KC++ | CI/CD | Cloud Computing | Distributed Systems | Edge ComputingMid-level Full Time深圳18h ago
-
大模型算法工程师（Memory/RAG/意图识别） CNY 180K-360KComputer Vision | Data Processing | Data cleaning | Data labeling | Dataset developmentEntry-level Full Time深圳18h ago
-
AI应用研发工程师（架构设计/RAG/Agent） CNY 180K-300KCI/CD | Context Management | Data pipeline | Deep learning | DockerMid-level Full Time深圳18h ago
-
Entry-level Full Time深圳18h ago
-
Entry-level Full Time深圳18h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work environment | Competitive salary | Laid-back atmosphere | Remote-friendly cultureMid-level Full TimeShenzhen, China1d ago
-
Data Analysis | Machine Learning | Python | Quantitative Finance | Statistical modelingCollaborative environment | Health insurance | InsuranceMid-level Full TimeBeijing, Beijing, China2d ago
-
AVP - Data and Analytics CNY 300K-420KAI Governance | Algorithmic Compliance | Audit evidence | Behavioral analytics | Cause analysisFlexible working | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China2d ago
-
ANSYS APDL | C Programming | Design of Experiments | Durability analysis | Element analysisMid-level Full TimeWuhan, Hubei, China2d ago
-
Ai算法工程师 CNY 144K-240KBig Data | Big data processing | Data Processing | Deep learning | Feature EngineeringEntry-level Full Time深圳2d ago
-
【校招实习】Ai算法工程师 CNY 25K-37KComputer Vision | Data Analysis | Deep learning | Feature Engineering | HadoopInternship opportunityEntry-level Internship深圳2d ago
-
Entry-level Internship深圳2d ago
-
Mid-level Full Time北京 R2d ago
-
Miclaw-端云协同调度专家 (Hybrid AI Architect) CNY 240K-360KAPI Integration | Claude 3.5 | Consistency protocols | Data Compression | Distributed SystemsHybrid workSenior-level Full Time北京 R2d ago
-
Mid-level Full Time武汉2d ago
-
Entry-level Full Time北京 R2d ago
-
Ai数据闭环研发工程师 CNY 240K-360KData Distribution | Data Distribution Strategy | Data Flywheel | Data Mining | Data evaluationSenior-level Full Time上海、北京2d ago
-
Mid-level Full Time上海2d ago
-
Senior-level Full Time上海、武汉、北京2d ago
-
算法工程师-大模型数据方向 CNY 240K-360KAnnotation Automation | Apache Spark | Clustering | Data Annotation | Data GovernanceSenior-level Full Time上海2d ago
-
Mid-level Full Time上海2d ago
-
Mid-level Full Time上海2d ago
-
Senior-level Full Time上海2d ago