Senior Data Engineer
CNY 360K-600K (estimate) Senior-level Full Time
Tasks
- Align data deliverables to architecture standards
- Build anonymization data systems
- Build data streaming pipelines
- Create data lake storage solutions
- Create integrated data views for AI ML workflows
- Create proof of concept
- Create proof of value
- Define data management strategy
- Design and implement data platform automation
- Design logging tracing and monitoring systems
- Develop APIs and maintain services
- Develop data pipelines using DevOps standards
- Develop minimal viable product
- Drive compute and storage optimization
- Implement data management processes
- Use continuous integration and continuous deployment
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Agile | Ansible | Apache Airflow | Apache Kafka | Apache Spark | Azure | Azure DevOps | Azure Functions | Azure Kubernetes | Azure Kubernetes Service | Azure Synapse | Blob Storage | CI/CD | Continuous Deployment | Continuous integration | Data Lake | Data Lake Store | Data Streaming | Databricks | DevOps | Docker | Event Hubs | GxP | Helm | Infrastructure as Code | Jenkins | Kafka | Kubernetes | Kubernetes Service | Logging | Monitoring | SAFe | Scala | Scrum | Terraform | Tracing | TypeScript | “as-code”
Education
Roles
Related jobs
-
Mid-level Full Time上海4h ago
-
Mid-level Full TimeBeijing, Beijing, China22h ago
-
Software Engineer II - Data CNY 180K-300KAWS | Apache Flink | Apache Kafka | Apache Spark | BigQueryMid-level Full TimeShenzhen, Guangdong Province, China1d ago
-
Agile | Analytics architecture | Cloud Computing | Data Engineering | Data GovernanceMid-level Full TimeDalian, Liaoning, China1d ago
-
【27届实习】云原生Ai平台研发工程师-杭州 CNY 25K-37KArgo Workflows | Computer Vision | Containers | Golang | KubeflowConversion to full time offer | Internship programEntry-level Internship杭州2d ago
-
Ai算法工程师 CNY 180K-300KApache Hadoop | Apache Hive | Apache Spark | Computer Vision | Data ProcessingEntry-level Full Time深圳3d ago
-
Entry-level Full Time北京、上海3d ago
-
BigQuery | DBT | Data Governance | Data Lakes | Data LineageAutonomy | Growth opportunities | TrustMid-level Full TimeChina3d ago
-
AI ML Engineer CNY 280K-360KAWS | Azure | C++ | Cloud Computing | Computer VisionPerformance bonuses | Professional development opportunities | Remote workMid-level Full TimeShenzhen, Guangdong Province, China R3d ago
-
CI/CD | Cloud Computing | Computer Vision | Control Systems | Language ProcessingEntry-level Full TimeShanghai3d ago
-
Agentic AI Application Engineer (27graduates) CNY 28K-50KAI Ops | AWS | Azure | Docker | FaissEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysEntry-level Full TimeHangzhou, China3d ago
-
Senior Analyst, Data Science CNY 360K-600KAWS | Apache Spark | Azure | Cloud platform | Computer VisionSenior-level Full TimeCN-OCG International Center, Cheng Du, China3d ago
-
Senior Analyst, Data Science CNY 360K-600KAWS | Anomaly Detection | Apache Spark | Azure | Computer VisionSenior-level Full TimeCN-OCG International Center, Cheng Du, China3d ago
-
Senior-level Full TimeChina, Shanghai3d ago
-
Mid-level Full Time武汉、北京、上海4d ago
-
数据管理工程师 CNY 240K-420KCassandra | Database Architecture | Distributed database | Distributed database architecture | DorisMid-level Full Time杭州4d ago
-
AI工程师-Agent Infra & LLMOps 方向(成都) CNY 180K-360KAccess Control | AutoGPT | CPU isolation | Docker | FirecrackerNone Full Time成都4d ago
-
Entry-level Full Time武汉4d ago
-
Entry-level Full Time北京4d ago
-
AI Engineer, Community Support Engineering CNY 397K-540KAPIs | Data Pipelines | Evaluation | Experimentation | Information RetrievalHybrid workMid-level Full TimeBeijing, China4d ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAgentic Engineering | Apache Airflow | Apache Hadoop | Apache Kafka | Apache NiFiMid-level Full TimeGuangzhou, Guangdong, China4d ago
-
Associate Director, Data and Analytics Specialist CNY 240K-360KAirflow | Artificial Intelligence | BigQuery | CI/CD | Cloud SQLMid-level Full TimeGuangzhou, Guangdong, China4d ago
-
Associate Director, Data and Analytics Specialist CNY 240K-360KAgentic Engineering | Airflow | Apache NiFi | Automated testing | BigQueryMid-level Full TimeGuangzhou, Guangdong, China4d ago
-
Senior DGX Cloud AI Infrastructure Software Engineer CNY 160K-240KAI Inference | AI Training | APIs | C# | C++Senior-level Full TimeChina, Shanghai4d ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Entrepreneurial team | Friendly work environment | Hands-off managementMid-level Full TimeShenzhen, China5d ago