数据挖掘平台工程架构开发工程师
Tasks
- Build and optimize distributed computing engines
- Design and develop data mining platform architecture
- Develop and optimize data processing pipelines
- Develop and optimize storage systems
- Implement engineering automation deployment monitoring and alerting
- Integrate data mining models into production
- Optimize platform resource utilization and processing latency
- Perform fault troubleshooting and version iteration
- Tune performance and resolve bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Kafka | Apache Spark | Automation tools | CI/CD | Database Design | Database optimization | Distributed Systems | Docker | Go | Hadoop | Java | Kubernetes | Performance Tuning | Python
Education
Roles
Backend | Backend Engineer | Data Platform | Data Platform Engineer | Engineer | Platform Engineer
Regions
Countries
States
Related jobs
-
Entry-level InternshipShanghai14h ago
-
Mid-level Full Time上海14h ago
-
Senior-level Full Time上海14h ago
-
【算法】多模态/大模型算法专家(上海) CNY 240K-480KAgent Frameworks | C++ | Computer Vision | Language Processing | LinuxSenior-level Full Time上海14h ago
-
【算法】计算机视觉算法专家(上海) CNY 240K-480KAnomaly Detection | C++ | Computer Vision | Deep learning | Fine-grained classificationSenior-level Full Time上海15h ago
-
Sr. Business Intelligence Engineer , CNGS NBS (New Business & New Seller) Amazon Business CNY 180K-500KBenchmarking | Data Analysis | Data Mapping | Data Modeling | Data NormalizationSenior-level Full TimeShanghai, CHN1d ago
-
Mid-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …1d ago
-
AI Engineer CNY 240K-360KAI workflow | AI workflow design | Agent systems | Computer Vision | Data AnnotationOccasional travel | Office environmentSenior-level Full TimeChina - Suzhou, Jiangsu - 297 …1d ago
-
Lead Hardware & Software Test Engineer CNY 300K-480KAI machine learning | Agile | Automation frameworks | Automation libraries | Cloud TestingSenior-level Full TimeChina - Shenzhen Office1d ago
-
Entry-level Full Time北京、上海1d ago
-
Mid-level Full Time北京 R1d ago
-
数据开发工程师(AI Agent方向) CNY 216K-360KAPI Development | AST | Data Dictionary | Data Governance | Data ModelingMid-level Full TimeBeijing1d ago
-
Data Analysist / Digital Consultant CNY 304K-399KAPI Integration | AWS Data | AWS Data Lake | Amazon Web Services | Apache SparkFlexible working hours | Inclusive work environment | Work-life balanceMid-level Full TimeShanghai, Asia, China1d ago
-
Principal Perception Engineer CNY 380K-540K3D Geometry | BEV Transformation | C++ | CNN | Camera CalibrationSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …2d ago
-
Senior Perception Engineer CNY 360K-540K3D Geometry | BEV Transformation | C++ | Camera Calibration | Computer VisionSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …2d ago
-
Senior Data Engineer, Off CNY 260K-366KAWS | Apache Iceberg | Apache Spark | Batch Processing | CI/CDEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China2d ago
-
AWS | Apache Iceberg | Apache Spark | Automated testing | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China2d ago
-
Senior Data Engineer, Off CNY 260K-366KAPIs | AWS | Apache Iceberg | Apache Spark | BIEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China2d ago
-
Data Platform Achitecture - Senior Lead, AVP CNY 397K-520KAWS | Access Control | Apache Iceberg | Audit Logging | CI/CDEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China2d ago
-
Senior Data Platform Infrastructure Engineer, Off CNY 397K-540KAWS | AWS CloudFormation | Access Management | Alerting | Audit LoggingEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China2d ago
-
AWS | Agentic AI | Apache Iceberg | Azure | CI/CDEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China2d ago
-
AWS | Access Control | Apache Iceberg | Authentication | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China2d ago
-
Senior-level Full TimeChina, Shanghai2d ago
-
Automated testing | C# | C++ | Datalink communication | DebuggingEmployee assistance programs | Flexible spending accounts | Health Lifestyle Programs | Health savings account | Life insuranceMid-level Full TimeWuxi, Jiangsu, China2d ago
-
Senior-level Full Time北京、苏州2d ago