Data Engineer, AOP - RoW Central Data Engineer Team
Tasks
- Automate data pipeline operations
- Build ETL and ELT pipelines
- Build self healing monitoring alarms
- Design data pipelines
- Document pipeline designs and ownership
- Enforce data partitioning and retention
- Implement data models and schemas
- Implement data quality checks
- Implement permanent production incident fixes
- Ingest data from APIs and S3
- Ingest data from EDX datasets
- Ingest data from SNS events
- Ingest data from database tables
- Land data into Redshift and Aurora
- Maintain data accuracy and freshness SLAs
- Manage AWS infrastructure for data systems
- Manage materialized views
- Optimize SQL for cost reduction
- Participate in on-call rotation
- Partner with BI and data science stakeholders
- Perform root cause analysis
- Tune Redshift WLM queues
- Tune distribution sort keys
- Write and optimize SQL workloads
Perks/Benefits
Skills/Tech-stack
AWS CDK | AWS CloudFormation | AWS CloudWatch | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Amazon Aurora | Amazon ECS | Amazon EventBridge | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Data Modeling | Data Partitioning | Data Quality | Data Retention | Dimensional Modeling | ELT | ETL | Materialized views | Python | QuickSight | SQL | Secrets Manager | Snowflake Schema | Star Schema | Step Functions | Tableau | WLM
Education
N/A
Roles
Related jobs
-
Senior-level Full Time上海、北京13h ago
-
Entry-level Internship上海13h ago
-
Mid-level Full TimeBeijing14h ago
-
资深机器视觉专家 CNY 180K-300KComputer Vision | Deep learning | Docker | Image Segmentation | Image classificationMid-level Full Time北京、上海15h ago
-
Entry-level Full Time北京15h ago
-
Database Administrator (DBA / DBRE) - Cloud Database Operations & Reliability Engineering USD 140K-200KAWS Aurora | AWS RDS | Auditing | Backup | Cloud SQLH1B sponsorshipSenior-level Full Time圣克拉拉15h ago
-
Consultant Specialist (GenAI Agent Platform) CNY 300K-420KAWS | Access Control | Agent Orchestration | Audit Logging | AzureEntry-level Full TimeGuangzhou, Guangdong, China R22h ago
-
Mid-level Full TimeShanghai, Shanghai, China1d ago
-
Mid-level Full TimeQingpu, Shanghai, China1d ago
-
APIs | AWS | Agent Orchestration | Agent systems | AzureMid-level Full TimeShenzhen, Guangdong, China R1d ago
-
机器&学习&AI Machine Learning & AI Eng. CNY 300K-420KAI Agents | Artificial Intelligence | Cloud services | Continuous Monitoring | Data QualityMid-level Full TimeAnting, CN, 2018051d ago
-
Data Analytics & Management, Officer CNY 144K-240KAgentic AI | Alteryx | Anomaly Detection | Auditability | BCBS 239Employee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China1d ago
-
ASIC physical design | C++ | C++14 | Distributed Computing | High PerformanceEntry-level Full TimeChina, Shanghai1d ago
-
Entry-level Internship Part TimeWuxi, Jiangsu, China1d ago
-
Mid-level Full TimeGuangdong, China1d ago
-
2026 Intern for Crowd-Sourced Mapping Algorithms CNY 38K-50KCloud Computing | Computer Vision | Data Annotation | Deep learning | Graph Neural NetworksEntry-level InternshipChengdu, Sichuan, China1d ago
-
Principal Software Engineer--M365 Storage Team CNY 144K-240KAI Assisted Development | Automation | C# | C++ | CachingSenior-level Full TimeChina, Jiangsu, Suzhou; China, Shanghai, Shanghai1d ago
-
Ai算法工程师 CNY 144K-240KApache Hadoop | Apache Hive | Apache Spark | Deep learning | Feature EngineeringEntry-level Full Time深圳2d ago
-
Lead Engineer, AI Agent Systems CNY 144K-240KAgent Framework | Asynchronous programming | Authorization | Concurrency Control | Cost OptimizationSenior-level Full TimeShanghai2d ago
-
Senior Applied Scientist, Large Language Models CNY 360K-600KContext modeling | Cost Optimization | Distributed Training | Evaluation & benchmarking | Fine TuningSenior-level Full TimeShanghai2d ago
-
Senior AI Operations Engineer CNY 144K-240KAlert Correlation | Docker | Forecasting | Function Calling | KubernetesSenior-level Full TimeChina, China3d ago
-
Consultant Specialist CNY 144K-184KAlibaba Cloud | CI/CD | Cloud deployment | Cloud platform | ContainerizationSenior-level Full TimeXi'an, Shaanxi, China4d ago
-
Computer Vision | CoreML | Diffusion Models | GLSL | Geometric processingSenior-level Full TimeBeijing, China4d ago
-
Agentic Engineering | Apache Airflow | Apache NiFi | Automated testing | BigQueryMid-level Full TimeGuangzhou, Guangdong, China4d ago
-
Senior Consultant Specialist(GenAI Agent platform) CNY 160K-240KAWS | Access Management | Agent Orchestration | Audit Logging | AzureSenior-level Full TimeGuangzhou, Guangdong, China R4d ago