Big Data Engineer_BST
Tasks
- Build ETL ELT workflows for ingestion cleaning transformation aggregation
- Design data models and curated datasets for analytics
- Design data pipelines with PySpark and Spark SQL
- Implement data validation monitoring and quality checks
- Optimize Spark jobs for performance reliability and cost efficiency
- Optimize data structures for visualization query performance
- Prepare analysis ready datasets for downstream analytics
- Process and transform structured and semi structured test data
- Review code and contribute to data engineering best practices
- Support Tableau dashboards and reports
- Translate analytical requirements into scalable data solutions
Perks/Benefits
- N/A
Skills/Tech-stack
Data Modeling | Data Quality | Data Validation | ELT | ETL | PySpark | Python | SQL | Spark SQL | Tableau
Education
N/A
Roles
Related jobs
-
Senior Machine Learning Engineer USD 20KData Analysis | Data Visualization | Deep learning | Experimentation | Fraud DetectionCareer growth | Competitive compensation | Open, collaborative cultureSenior-level Full TimeShenzhen, China13h ago
-
Senior Data Engineer / AI Engineer CNY 360K-600KAI Agents | Apache Spark | Azure | Data Modeling | DatabricksSenior-level Full TimeShanghai, Shanghai, China15h ago
-
Operations / IE Special II HKD 360K-550KAPI | C# | Data Loss Prevention | Data Modeling | Data VisualizationMid-level Full TimeHK - Hong Kong (HKCHU), Hong …17h ago
-
ARM | Android | C++ | Communication Protocols | Digital CommunicationSenior-level Full TimeShanghai, China1d ago
-
AVP - Data and Analytics CNY 300K-420KA/B | A/B Testing | Automation | B testing | Data CleansingFlexible working | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China1d ago
-
AVP - Data and Analytics CNY 300K-420KA/B | A/B Testing | Automation | B testing | CRMFlexible working | Inclusive work culture | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China1d ago
-
Analyst, Data Science CNY 144K-240KAI Governance | Computer Vision | Data analytics | Deep learning | GitSenior-level Full TimeCN-Dong Bao Building, China1d ago
-
Analyst, Data Science CNY 144K-240KAgile | Artificial Intelligence | Data Science | Deep learning | MLOpsSenior-level Full TimeCN-Dong Bao Building, China1d ago
-
Mid-level Full TimeShanghai, Shanghai, China1d ago
-
Mobile Power optimization Engineer CNY 108K-184KAnalog circuit | Analog circuit design | Android | BW Governor | C#Entry-level Full TimeShanghai, Shanghai, China1d ago
-
AI/ML | Agentic Engineering | Apache Airflow | Apache Kafka | Apache NiFiMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote work | Supportive team environmentMid-level Full TimeShenzhen, China2d ago
-
AI Agent算法架构师 CNY 144K-240KAgent Framework | Cloud Computing | Computer Vision | Edge AI | LLM InferenceSenior-level Full Time深圳3d ago
-
Entry-level Full Time北京3d ago
-
Apache Arrow | Data Engineering | Data Mining | Data Processing | Financial DataFast-paced environment | TeamworkMid-level Full TimeShanghai4d ago
-
Mid-level Full TimeBeijing, China4d ago
-
顶尖应届-大模型训练框架研发工程师-MiMo AI 基建 CNY 72K-96KC++ | CUDA | Data loading | DeepSpeed | Distributed ComputingEntry-level Full Time北京4d ago
-
Entry-level Full Time北京4d ago
-
Entry-level Full Time北京4d ago
-
Entry-level Full Time上海4d ago
-
Entry-level Full Time上海4d ago
-
顶尖应届-机器人具身智能算法研究员-机器人事业部 CNY 25K-37KC++ | Diffusion Models | Git | Imitation Learning | Knowledge DistillationEntry-level Full Time北京4d ago
-
顶尖应届-具身大模型数据工程师-机器人事业部 CNY 25K-37K3D Vision | Action Recognition | Apache Spark | CLIP | Cloud processingEntry-level Full Time北京4d ago
-
Entry-level Full Time北京 R4d ago
-
数据开发主任 CNY 300K-420KAWS Lambda | AWS Redshift | AWS S3 | Amazon EMR | Apache AirflowCareer growth | Mentorship | Multi cloud platform experienceExecutive-level Full TimeGuangzhou, GD, CN4d ago