Consultant Specialist
Tasks
- Automate ETL workflows with Apache Airflow or Cloud Composer
- Conduct incident response and post-mortem analysis
- Design and develop ETL pipelines
- Develop Apache Beam Dataflow jobs
- Drive automation of operational tasks
- Ensure security and regulatory compliance
- Extract transform and load data to Google Cloud Platform
- Implement batch and streaming data processing
- Implement reliability strategies using SLOs and SLIs
- Improve system reliability and performance
- Integrate data from databases, APIs, and flat files
- Maintain data storage for analytics and reporting
- Maintain system documentation
- Monitor and troubleshoot ETL workflows
- Optimize data pipelines performance scalability and reliability
- Set up monitoring and alerting for pipeline health
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Beam | Apache Flink | Apache Hadoop | Apache Hive | Apache Iceberg | Apache Kafka | Apache Spark | Batch Processing | BigQuery | CI/CD | Cause analysis | CircleCI | Cloud Composer | Cloud Run | Cloud Storage | Cloud platform | Containerization | DevOps | ETL | Embeddings | Feature Store | GitLab CI | Google Cloud | Google Cloud Platform | Google Dataflow | Google Kubernetes | Google Kubernetes Engine | HBase | IAM | Incident Management | Infrastructure as Code | Java | Jenkins | Kubernetes | Kubernetes Engine | MapReduce | Post-mortem | Python | Reliability Engineering | Root Cause Analysis | Root cause | SQL | Site Reliability | Site Reliability Engineering | Streaming | System Architecture | Trino | Vector Search | Vertex AI | “as-code”
Related jobs
-
Entry-level Internship上海8h ago
-
具身智能 / Vla / Wam 算法工程师 CNY 180K-360KC plus plus | Camera Calibration | Coordinate transformations | Data Quality | Data labelingEntry-level Full Time上海8h ago
-
软件工程师 - pytorch训练框架国产芯片适配 CNY 240K-480KCUDA | GPU Architecture | GPU Programming | PyTorch | PythonMid-level Full Time北京9h ago
-
Senior Consultant Specialist CNY 160K-240KApache Airflow | Apache Beam | Apache Spark | Cloud Composer | Cloud DataflowSenior-level Full TimeXi'an, Shaanxi, China1d ago
-
R&D – Embedded Display Software Development Engineer CNY 180K-300KAndroid | Android Display Stack | C# | C++ | Device DriversMid-level Full TimeShenzhen, Guangdong, China1d ago
-
Senior Machine Learning Engineer I CNY 360K-600KAPI Integration | AWS | Agent Frameworks | Agile | AzureAnnual Medical Checkup | Flexible benefits | Life insurance | Long service award | Marriage leaveSenior-level Full TimeChina-Shanghai (Tianshan-W-Rd)1d ago
-
系统工程师（视觉感知方向） CNY 192K-300K3D Reconstruction | AI Vision | C plus plus | Camera Calibration | Computer VisionSenior-level Full Time深圳1d ago
-
高级运维工程师（Dba方向） CNY 240K-480KAccess Control | Alerting | Automation | Backup and Recovery | Capacity PlanningSenior-level Full Time深圳1d ago
-
2026届秋招-大数据开发工程师 CNY 144K-240KJava | Linux | Python | SQL | ScriptingMentorship | Regular technical sharing | Technical trainingNone Full Time上海1d ago
-
系统工程师（视觉感知方向） CNY 192K-300K3D Reconstruction | C++ | Camera Calibration | Computer Vision | Data ValidationSenior-level Full Time深圳1d ago
-
Entry-level Internship南京1d ago
-
Entry-level Internship南京1d ago
-
AI Agent开发工程师-汽车专项-实习 CNY 25K-37KAPI Design | Authentication | Autogen | Concurrency | Context ManagementEntry-level Internship上海1d ago
-
Dba工程师 CNY 50K-50KAlertmanager | Buffer Pool | Docker | GTID | GrafanaAnnual bonus | Flexible working hours | No blame incident postmortems | Stock incentivesEntry-level Full Time InternshipBeijing1d ago
-
Entry-level Full Time InternshipBeijing1d ago
-
Entry-level Full Time InternshipBeijing1d ago
-
IT Dept. AI Engineer_Tech. Foundation(上海) CNY 192K-240KAPI Integration | Access Control | Alibaba Cloud | Automation | Cloud servicesMid-level Full TimeShanghai, CN, 2018001d ago
-
Consultant Specialist CNY 300K-420KApache Airflow | Apache Beam | Artificial Intelligence | BigQuery | Cause analysisMid-level Full TimeGuangzhou, Guangdong, China2d ago
-
Senior-level Full TimeCN-OCG International Center, Cheng Du, China2d ago
-
Principal Specialist, AI Application CNY 360K-600KAgile | Angular | Cloud Platforms | Enterprise Integration | Generative AISenior-level Full TimeCN-OCG International Center, Cheng Du, China2d ago
-
Mid-level Full TimeShenzhen, Guangdong, China2d ago
-
Mid-level Full TimeShenzhen, Guangdong, China2d ago
-
Principal Specialist, AI Application CNY 360K-600KAgile | Angular | Cloud Computing | Enterprise Integration | Generative AISenior-level Full TimeCN-OCG International Center, Cheng Du, China2d ago
-
Senior-level Full TimeCN-OCG International Center, Cheng Du, China2d ago
-
具身智能-强化学习(灵巧操作方向) 实习生 CNY 25K-37KActor-critic | Diffusion Models | Distributed Training | Embodied intelligence | Flow matchingEntry-level Full Time Internship深圳2d ago