Senior Consultant Specialist
Tasks
- Apply data governance and security controls
- Automate ETL workflows
- Design ETL pipelines
- Develop Apache Beam Dataflow jobs
- Extract, transform and load data
- Implement ETL processes
- Integrate data from databases APIs and files
- Manage GCP data storage for analytics
- Monitor and troubleshoot ETL workflows
- Optimize data pipeline performance
- Set up monitoring and alerting
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Beam | Apache Flink | Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | Cloud Composer | Cloud Dataflow | Cloud Storage | Data Governance | Data Modeling | Data Quality | Data Warehousing | ETL | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Storage | HBase | Java | MapReduce | PubSub | Python | SQL
Education
Related jobs
-
Research MLE (Training Optimization)大模型训练优化工程师 CNY 144K-240KC++ | CUDA | DeepSpeed | Distributed Training | FSDPSenior-level Full TimeBeijing, Beijing, China8h ago
-
Senior-level Full TimeCN-OCG International Center, Cheng Du, China15h ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAPI Design | Agile | Automated testing | CI/CD | Cloud ComputingMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAWS | Angular | Azure | Cloud platform | Google CloudMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Associate Director, Data and Analytics CNY 240K-360KAPI Testing | AWS | CI/CD | Cause analysis | Cloud TestingMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Mid-level Full TimeXi'an, SN, CN, -1d ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAmazon Web Services | Angular | Java | Jenkins pipeline | KubernetesMid-level Full TimeXi'an, SN, CN, -1d ago
-
Mid-level Full TimeXi'an, SN, CN, -1d ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAmazon Web Services | Angular | CI/CD | Java | JenkinsMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Ai算法工程师 CNY 144K-240KBig Data | Big data processing | Computer Vision | Data Analysis | Data ProcessingEntry-level Full Time深圳1d ago
-
【校招实习】Ai算法工程师 CNY 25K-37KComputer Vision | Data Analysis | Deep learning | Distributed Computing | Feature EngineeringInternship | Research and development experienceEntry-level Internship深圳1d ago
-
Ai算法暑期实习生(Llm/强化学习) CNY 37K-37KDPO | Deep learning | Fine Tuning | LLM Fine-tuning | Language ModelsAt least 2 months internship duration | Beijing internship location | Full-time internshipEntry-level Internship北京2d ago
-
Ai算法暑期实习生(Llm/强化学习) CNY 37K-37KDPO | Deep learning | Language Models | Large Language Models | Machine LearningFull-time internship | Internship 2 months or moreEntry-level Internship北京2d ago
-
视觉感知算法工程师 - 榫卯计划 CNY 96K-120K4D reconstruction | C++ | Camera | Computer Vision | Computer Vision DatasetsEntry-level Full Time深圳2d ago
-
数据开发工程师 CNY 144K-240KAPI Development | Airbyte | Apache Flink | Apache Kafka | Apache SparkAI tool subscription | API quota | Cloud credits | Fast execution | Flat organizationSenior-level Full Time深圳2d ago
-
Ai算法暑期实习生(Llm/强化学习) CNY 37K-37KDPO | Deep learning | Experimentation | Information Retrieval | Language ModelsContinuous internship 2 months or more | Full-time internship | Location BeijingEntry-level Internship北京2d ago
-
Ai 应用工程师实习生 CNY 36K-37KLangchain | Language Models | Large Language Models | Prompt engineering | PyTorchEntry-level Internship北京2d ago
-
Applied AI Engineer (Agents)-算法2组 CNY 144K-240KApp Development | Context engineering | Data Engineering | Evaluation | Fine TuningMid-level Full Time深圳、厦门2d ago
-
Mid-level Full TimeChina - Hong Kong3d ago
-
CUDA | DeepSpeed | Diffusion Models | Distributed Training | FSDPSenior-level Full TimeBeijing, Beijing, China3d ago
-
LLM Agent Research Scientist 大模型智能体研究科学家 CNY 144K-240KAgent systems | Benchmarking | Cloud Computing | DeepSpeed | GPU ComputingInternship opportunity | Open to all experience levelsEntry-level Full TimeBeijing, Beijing, China3d ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAgile | Alerting | Automated testing | CI/CD | Data ArchitectureMid-level Full TimeGuangzhou, GD, CN, 5106203d ago
-
Senior-level Full TimeChina, Shanghai3d ago
-
Senior AI Engineer CNY 144K-240KCheckpointing | Distributed Training | Efficient Fine Tuning | Fine Tuning | GPU workload optimizationSenior-level Full TimeBeijing Yizhuang, China3d ago
-
Senior-level Full TimeCHN - Guangzhou - EMS, China3d ago