Big Data Engineer_BST
Tasks
- Build ETL ELT workflows for ingestion cleaning transformation aggregation
- Design data models and curated datasets for analytics
- Design data pipelines with PySpark and Spark SQL
- Implement data validation monitoring and quality checks
- Optimize Spark jobs for performance reliability and cost efficiency
- Optimize data structures for visualization query performance
- Prepare analysis ready datasets for downstream analytics
- Process and transform structured and semi structured test data
- Review code and contribute to data engineering best practices
- Support Tableau dashboards and reports
- Translate analytical requirements into scalable data solutions
Perks/Benefits
- N/A
Skills/Tech-stack
Data Modeling | Data Quality | Data Validation | ELT | ETL | PySpark | Python | SQL | Spark SQL | Tableau
Education
N/A
Roles
Related jobs
-
Lead AI Data Engineer CNY 144K-240KAmazon S3 | Apache Iceberg | Apache Spark | Azure Data | Azure Data LakeAnnual leave | Continuous learning culture | Digital wellbeing platform | Employee assistance program | Flexible working optionsSenior-level Full TimeGuangzhou, CN16h ago
-
AI平台与MLOps工程师(27届校招)_BCSC CNY 70KAccess Control | Alerting | Alibaba Cloud | Amazon Web Services | Argo CDEntry-level Full TimeWuxi, Jiangsu, China19h ago
-
Robotics & Automation Engineer CNY 360K-600K3D Software | AutoCAD | C++ | CAD | Lean ManufacturingRelocation assistanceSenior-level Full TimeSuZhou, China21h ago
-
Lead Robotics & Automation Engineer CNY 360K-600KAutoCAD | C++ | Lean Manufacturing | PLC programming | PTC CreoRelocation assistanceSenior-level Full TimeSuZhou, China21h ago
-
Entry-level Internship Part TimeShanghai (Pudong), China21h ago
-
Data Platform Engineer CNY 277K-370KAWS | Apache Airflow | CI/CD | Data Modeling | Data PrivacyEmployee assistance programme | Flexible working | Learning and development | Life insurance | Medical insuranceSenior-level Full TimeGuangzhou, CN2d ago
-
AI Data Engineer- CNY 300K-420KAmazon S3 | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake StorageAnnual leave | Continuous learning culture | Digital wellbeing platform | Employee assistance programme | Flexible benefitsMid-level Full TimeGuangzhou, CN2d ago
-
Amazon CloudWatch | Amazon EKS | Ansible | Apache Airflow | Apache SparkSenior-level Full TimeShanghai2d ago
-
Apache Doris | Automation | Backup | CSI | Cloud ComputingSenior-level Full TimeShanghai2d ago
-
Apache Doris | Backup and Restore | CSI | CockroachDB | CouchbaseSenior-level Full TimeShanghai2d ago
-
Apache Flink | Apache Kafka | Apache Spark | CI/CD | JavaSenior-level Full TimeShanghai2d ago
-
Apache Doris | Backup and Restore | CSI | Cloud automation | CockroachDBSenior-level Full TimeShanghai2d ago
-
Apache Doris | Automation | Backup and Restore | CSI | CockroachDBSenior-level Full TimeShanghai2d ago
-
AWS | Alibaba Cloud | Automation | Backup and Restore | CSISenior-level Full TimeShanghai2d ago
-
Backup and Restore | CSI | CockroachDB | Disaster Recovery | GoSenior-level Full TimeShanghai2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive compensation | Friendly work environment | Remote-friendlyMid-level Full TimeShanghai, China2d ago
-
资深机器视觉专家 CNY 180K-300KComputer Vision | Deep learning | Docker | Image Segmentation | Image classificationMid-level Full Time北京、上海3d ago
-
Entry-level Full Time北京3d ago
-
Senior-level Full Time常州3d ago
-
Hr智能化（共享服务） CNY 192K-300KAgent Framework | JavaScript | Language Model | Large Language Model | Low CodeMid-level Full Time北京3d ago
-
Mid-level Full Time北京3d ago
-
Senior-level Full Time北京3d ago
-
Mid-level Full Time北京3d ago
-
大模型规划算法工程师- 北京 CNY 240K-480KAgent architecture | Agent systems | Context Management | Deep learning | Dialogue UnderstandingMid-level Full Time北京3d ago
-
Senior-level Full Time InternshipGuangzhou3d ago