Big Data Engineer_BST
Tasks
- Build ETL ELT workflows for ingestion cleaning transformation aggregation
- Design data models and curated datasets for analytics
- Design data pipelines with PySpark and Spark SQL
- Implement data validation monitoring and quality checks
- Optimize Spark jobs for performance reliability and cost efficiency
- Optimize data structures for visualization query performance
- Prepare analysis ready datasets for downstream analytics
- Process and transform structured and semi structured test data
- Review code and contribute to data engineering best practices
- Support Tableau dashboards and reports
- Translate analytical requirements into scalable data solutions
Perks/Benefits
- N/A
Skills/Tech-stack
Data Modeling | Data Quality | Data Validation | ELT | ETL | PySpark | Python | SQL | Spark SQL | Tableau
Education
N/A
Roles
Related jobs
-
Ai算法工程师实习 CNY 25K-37KComputer Vision | Deep learning | Hugging Face | Language Processing | Machine LearningFull-time internship | Long term internship preferred | One to one mentorshipEntry-level Internship合肥、上海1h ago
-
Entry-level Internship上海、北京2h ago
-
数据开发实习生 CNY 25K-37KAI tools | Apache Superset | Data Modeling | Data Quality | Data quality monitoringEntry-level Internship Part Time上海2h ago
-
多模态大模型数据工程师 CNY 25K-37KCorpus Processing | Data Augmentation | Data Automation | Data Quality | Data ValidationEntry-level Internship北京2h ago
-
Entry-level Internship Part Time上海2h ago
-
Senior Machine Learning Engineer USD 20KData Analysis | Data Visualization | Deep learning | Experimentation | Fraud DetectionCareer growth | Competitive compensation | Open, collaborative cultureSenior-level Full TimeShenzhen, China16h ago
-
Senior Data Engineer / AI Engineer CNY 360K-600KAI Agents | Apache Spark | Azure | Data Modeling | DatabricksSenior-level Full TimeShanghai, Shanghai, China18h ago
-
Operations / IE Special II HKD 360K-550KAPI | C# | Data Loss Prevention | Data Modeling | Data VisualizationMid-level Full TimeHK - Hong Kong (HKCHU), Hong …20h ago
-
Android | C# | C++ | Computer Architecture | Data StructuresMid-level Full TimeShanghai, China20h ago
-
C++ | Caffe2 | Computer Vision | Convolutional Neural Network | Deep learningMid-level Full TimeShanghai, China20h ago
-
Machine Learning Engineer CNY 240K-480KAI Deployment | AI Inference | AI acceleration | Android | C++Senior-level Full TimeGuangdong, China20h ago
-
ARM | Android | C++ | Communication Protocols | Digital CommunicationSenior-level Full TimeShanghai, China1d ago
-
AVP - Data and Analytics CNY 300K-420KA/B | A/B Testing | Automation | B testing | Data CleansingFlexible working | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China1d ago
-
AVP - Data and Analytics CNY 300K-420KA/B | A/B Testing | Automation | B testing | CRMFlexible working | Inclusive work culture | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China1d ago
-
Analyst, Data Science CNY 144K-240KAI Governance | Computer Vision | Data analytics | Deep learning | GitSenior-level Full TimeCN-Dong Bao Building, China1d ago
-
Analyst, Data Science CNY 144K-240KAgile | Artificial Intelligence | Data Science | Deep learning | MLOpsSenior-level Full TimeCN-Dong Bao Building, China1d ago
-
Mid-level Full TimeShanghai, Shanghai, China1d ago
-
Mobile Power optimization Engineer CNY 108K-184KAnalog circuit | Analog circuit design | Android | BW Governor | C#Entry-level Full TimeShanghai, Shanghai, China1d ago
-
AI/ML | Agentic Engineering | Apache Airflow | Apache Kafka | Apache NiFiMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Mid-level Full TimeGuangdong, China1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote work | Supportive team environmentMid-level Full TimeShenzhen, China2d ago
-
AI Agent算法架构师 CNY 144K-240KAgent Framework | Cloud Computing | Computer Vision | Edge AI | LLM InferenceSenior-level Full Time深圳4d ago
-
Entry-level Full Time北京4d ago
-
Apache Arrow | Data Engineering | Data Mining | Data Processing | Financial DataFast-paced environment | TeamworkMid-level Full TimeShanghai4d ago
-
Mid-level Full TimeBeijing, China4d ago