Data Engineer, AOP - RoW Central Data Engineer Team
Tasks
- Automate data pipeline operations
- Build ETL and ELT pipelines
- Build self healing monitoring alarms
- Design data pipelines
- Document pipeline designs and ownership
- Enforce data partitioning and retention
- Implement data models and schemas
- Implement data quality checks
- Implement permanent production incident fixes
- Ingest data from APIs and S3
- Ingest data from EDX datasets
- Ingest data from SNS events
- Ingest data from database tables
- Land data into Redshift and Aurora
- Maintain data accuracy and freshness SLAs
- Manage AWS infrastructure for data systems
- Manage materialized views
- Optimize SQL for cost reduction
- Participate in on-call rotation
- Partner with BI and data science stakeholders
- Perform root cause analysis
- Tune Redshift WLM queues
- Tune distribution sort keys
- Write and optimize SQL workloads
Perks/Benefits
Skills/Tech-stack
AWS CDK | AWS CloudFormation | AWS CloudWatch | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Amazon Aurora | Amazon ECS | Amazon EventBridge | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Data Modeling | Data Partitioning | Data Quality | Data Retention | Dimensional Modeling | ELT | ETL | Materialized views | Python | QuickSight | SQL | Secrets Manager | Snowflake Schema | Star Schema | Step Functions | Tableau | WLM
Education
N/A
Roles
Related jobs
-
【中台】后端开发专家（Ai 方向） CNY 144K-240KAsynchronous Queue | Caching | Code review | Distributed Systems | Function CallingSenior-level Full Time上海14h ago
-
AI Infra工程师-算法研发方向 CNY 180K-300KC++ | CI/CD | CUDA | Data parallelism | Distributed TrainingMentorshipMid-level Full Time北京、上海14h ago
-
Associate Director, Data and Analytics Specialist CNY 510K-510KAgentic AI | Authentication | Authorization | CI/CD | Data StoresMid-level Full TimeGuangzhou, Guangdong, China23h ago
-
Senior Software Engineer(IC3 Data Platform) CNY 480K-540KAgent workflows | Airflow | Apache Flink | C# | C++Senior-level Full TimeChina, Jiangsu, Suzhou; China, Beijing, Beijing; …1d ago
-
Data Services Engineer CNY 160K-264KAWS | Alerting | Alibaba Cloud | Amazon Aurora | Amazon ElastiCacheSenior-level Full TimeShanghai1d ago
-
Senior Machine Learning Engineer CNY 360K-510KBandits | C++ | Deep learning | Distributed Systems | Graphical ModelsSenior-level Full TimeShanghai1d ago
-
Associate Director, Data and Analytics Specialist CNY 510K-510KAPI Development | Agentic AI | Authentication | Authorization | CI/CDMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Apache Flink | Apache Iceberg | Apache Spark | CI/CD | DockerEntry-level Full TimeShanghai R1d ago
-
CI/CD | Docker | Flink | Go | IcebergEntry-level Full TimeShanghai R1d ago
-
Apache Flink | Apache Iceberg | Apache Spark | CI/CD | DockerSenior-level Full TimeShanghai R1d ago
-
高级数据工程师（座舱Ai） CNY 144K-240KApache Airflow | Apache Flink | Apache Hive | Apache Kafka | Apache SparkSenior-level Full Time北京1d ago
-
Senior-level Full Time武汉1d ago
-
Ai算法工程师 CNY 180K-360KComputer Vision | Continuous Delivery | Continuous integration | Data Analysis | Deep learningMid-level Full Time北京1d ago
-
车机 Ai 算法工程师（大模型 / 多模态 / 端侧部署） CNY 180K-360KC++ | Deep learning | INT4 Quantization | Inference engine | Int8 QuantizationMid-level Full Time北京1d ago
-
Entry-level Internship上海1d ago
-
Mid-level Full Time北京1d ago
-
具身大模型训练框架工程师/专家 CNY 240K-480KCUDA | Checkpointing | Collective communication | Computer Vision | Data parallelismSenior-level Full Time上海1d ago
-
AI Operations Builder CNY 144K-240KA/B | A/B Testing | API Integration | Agent workflow | AutomationSenior-level Full TimeHuangpu, Shanghai, China; Haidian, Beijing, China1d ago
-
Entry-level Internship上海1d ago
-
None Full Time上海、成都、杭州1d ago
-
Principal Software Engineer(M365 Storage Fabric team) CNY 360K-510KAI-assisted engineering | AI-assisted engineering tools | Admission control | Automation | Autonomous Coding AgentsSenior-level Full TimeChina, Beijing, Beijing; China, Jiangsu, Suzhou; …2d ago
-
AI-assisted engineering | APIs | AWS | Algorithms | AutomationMid-level Full TimeChina, Beijing, Beijing; China, Jiangsu, Suzhou; …2d ago
-
Software Engineering & Development, SrAssc CNY 300K-420KAI Foundry | AKS | AWS | AWS Bedrock | AWS CloudWatchEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysMid-level Full TimeHangzhou, China2d ago
-
Mid-level Full Time东莞3d ago
-
Mid-level Full Time深圳4d ago