Senior Data Engineer
Tasks
- Build real time automated scalable data pipelines
- Collaborate on data infrastructure issue triage and resolution
- Collaborate on data requirements and data access
- Deploy and support real time automated scalable data streams
- Implement data auditing for data quality
- Maintain data pipeline processes and troubleshoot failures
- Optimize query performance using SQL
- Own data quality for assigned data domains
- Profile applications and queries
- Resolve large scale data processing workflow issues
- Translate business operations and analytics requirements into data
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon SES | Amazon SNS | Amazon SQS | Apache Airflow | Apache Spark | BigQuery | Cassandra | Data Governance | Data Quality | Data Warehousing | DynamoDB | Elasticsearch | Hadoop | Kafka | Python | Redshift | S3 | SQL | Snowflake | Spark Streaming | Stored Procedures | Time Series | Time-series databases | Triggers | Window Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
(Sr) Cloud & Data Engineer CNY 192K-240KAWS | Automation | CI/CD | Container Security | Data ModelingMid-level Full TimeBeijing, Beijing, CN11h ago
-
C# | C++ | Computer Vision | Debugging | Deep learningSenior-level Full TimeChina, Shanghai19h ago
-
大数据开发（数据挖掘、数据测试、java） CNY 25K-37KApache Kafka | Apache Spark | Data Mining | Data Modeling | Data WarehousingMid-level Full Time保定21h ago
-
Entry-level Full Time广州22h ago
-
Senior-level Full Time上海、北京22h ago
-
None Full Time淄博23h ago
-
None Full Time济南23h ago
-
【27届实习】Ai实习生(可转正) CNY 36K-48KAmazon Web Services | Computer Vision | Deep learning | Docker | KubernetesEntry-level Internship淄博、济南、青岛23h ago
-
Mid-level Full Time北京 R1d ago
-
Java开发工程师（大数据方向） CNY 180K-360KApache Flink | Apache Spark | Data pipeline | Distributed Systems | IO ProgrammingMid-level Full Time武汉1d ago
-
A/B | A/B Experimentation | Autoscaling | Caching | Canary testingCommute subsidy | Disability insurance | Employee stock ownership | Generous vacation | Health insuranceSenior-level Full TimeShanghai, China1d ago
-
Apache Airflow | Apache Flink | Apache Spark | Automated testing | Data LakeCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacation personal daysSenior-level Full TimeShanghai, China1d ago
-
Airflow | CUDA | Data Lake | Data Warehouse | FlinkCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacation personal daysSenior-level Full TimeShanghai, China1d ago
-
A/B | A/B Testing | Autoscaling | B testing | Canary testingCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacationSenior-level Full TimeShanghai, China1d ago
-
Senior Data Engineer, Content Management Systems (China) CNY 144K-240KAPI Integration | AWS | Access Control | Alibaba Cloud | CI/CDAnnual medical check-up | Flexible benefits | Long service award | Medical and life insurance | Paid time offSenior-level Full TimeChina - Shanghai1d ago
-
AWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeCN-Shenzhen-HyQ, China1d ago
-
Entry-level Internship Part TimeShanghai (JingAn), China1d ago
-
Senior Data Engineer, Content Management Systems (China) CNY 144K-240KAPI Integration | AWS | Alibaba Cloud | Apache Kafka | Apache SparkAnnual Medical Checkup | Flexible benefits | Life insurance | Long service award | Medical insuranceSenior-level Full TimeChina - Shanghai1d ago
-
Mid-level Full Time深圳2d ago
-
Entry-level Internship北京2d ago
-
Senior Software Engineer - Machine Learning CNY 360K-600KData Analysis | Data Visualization | Deep learning | Experimentation | Fraud DetectionCareer progression | Collaborative culture | Competitive compensation | Global growth opportunitiesSenior-level Full TimeShenzhen, China2d ago
-
Senior Data Engineer CNY 156K-240KAccess Control | Agile | Apache Cassandra | Apache Hadoop | Apache KafkaSenior-level Full TimeBeijing, Beijing, China2d ago
-
AI intern CNY 28K-50KAutomated testing | Continuous integration | Deep learning | Generative AI | JavaEntry-level InternshipBeijing,Beijing,China2d ago
-
Intelligent Test Automation & GenAI Tool Engineer CNY 360K-540KAgent systems | C# | C++ | CI/CD | ConfluenceSenior-level Full TimeShanghai, Shanghai, China2d ago
-
Senior Data Engineer CNY 360K-600KActive Directory | Agile | Apache Spark | Azure Active Directory | Azure CosmosHybrid work environment | Inclusion support | Professional growth | Wellbeing supportSenior-level Full TimeChengdu, Manulife Information and Technology Center, …2d ago