数据开发主任
Tasks
- Automate jobs and scheduling
- Contribute to operational runbooks
- Create and maintain Linux shell scripts
- Design data warehouse structures
- Develop data pipelines
- Document technical processes
- Implement data warehouse structures
- Ingest transform and deliver data
- Investigate data quality issues
- Maintain data pipelines
- Maintain fact tables and dimension tables
- Participate in on-call rotation
- Perform database extraction and loading
- Prepare and deliver datasets for analytics and machine learning
- Resolve pipeline failures
- Support and monitor data platform operations
- Troubleshoot database issues
- Write and optimize PySpark scripts
- Write and optimize Python scripts
Perks/Benefits
Skills/Tech-stack
AWS Lambda | AWS Redshift | AWS S3 | Amazon EMR | Apache Airflow | Bash | Cloud Composer | Cloud Dataproc | Cloud Storage | Data Quality | Data Vault | Data Warehouse | Dimensional Modeling | ELT | ETL | Google BigQuery | Google Cloud | Google Cloud Dataproc | Google Cloud Storage | Inmon Method | Kimball Method | Linux | Machine Learning | MongoDB | MySQL | NoSQL | Oracle | PySpark | Python | SQL | Star Schema
Education
Roles
Related jobs
-
Entry-level Internship上海13h ago
-
多模态大模型数据工程师 CNY 25K-37KCorpus | Data Augmentation | Data Quality | Data Validation | Data pipelineInternship experienceEntry-level Internship北京13h ago
-
Mid-level Full Time上海14h ago
-
AVP, AI Solution Lead CNY 144K-240KArtificial Intelligence | Cloud Native | DataOps | DevOps | FlutterContinuous professional development | Flexible workingSenior-level Full TimeGuangzhou, Guangdong, China R23h ago
-
Active Directory | Amazon Web Services | Ansible | Apache Airflow | Apache KafkaMid-level Full TimeShanghai, SH, CN1d ago
-
AVP, AI Solution Lead CNY 144K-240KCloud Native | Cloud deployment | DataOps | DevOps | FlutterContinuous professional development | Flexible working | Inclusive work environmentSenior-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
AWS | Access Control | Alerting | Authentication | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysMid-level Full TimeHangzhou, China1d ago
-
Entry-level Full Time深圳1d ago
-
None Full Time上海、深圳、武汉、北京1d ago
-
None Full Time北京、上海1d ago
-
Mid-level Full Time上海、圣何塞1d ago
-
None Full Time上海、北京、深圳1d ago
-
Senior-level Full Time上海、北京、深圳1d ago
-
Entry-level Full Time上海1d ago
-
机器人交互数据与评测工程师 CNY 36K-42KBenchmarking | Data Governance | Data Mining | Data Quality | Data VersioningNone Full Time上海1d ago
-
None Full Time上海1d ago
-
Deep Learning Performance Architect CNY 144K-240KComputer Architecture | Deep learning | Hardware performance | Hardware performance analysis | Inference OptimizationSenior-level Full TimeChina, Shanghai1d ago
-
Senior-level Full Time上海1d ago
-
Entry-level Full Time广州、上海1d ago
-
Entry-level Internship苏州1d ago
-
AI Foundation Model方向实习生 CNY 25K-37KC++ | Caffe | Computer Vision | Data Structures | Data Structures and AlgorithmsEntry-level Internship北京、上海1d ago
-
Mid-level Full Time深圳 R1d ago
-
【27届校招提前批】算法工程师 CNY 180K-360KAgent collaboration | Asynchronous programming | Caching | Concurrency | Context engineeringNone Full Time上海1d ago
-
Entry-level Full Time北京1d ago
-
Entry-level InternshipBeijing,Beijing,China1d ago