Senior Data Engineer
Tasks
- Build real time automated scalable data pipelines
- Collaborate on data infrastructure issue triage and resolution
- Collaborate on data requirements and data access
- Deploy and support real time automated scalable data streams
- Implement data auditing for data quality
- Maintain data pipeline processes and troubleshoot failures
- Optimize query performance using SQL
- Own data quality for assigned data domains
- Profile applications and queries
- Resolve large scale data processing workflow issues
- Translate business operations and analytics requirements into data
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon SES | Amazon SNS | Amazon SQS | Apache Airflow | Apache Spark | BigQuery | Cassandra | Data Governance | Data Quality | Data Warehousing | DynamoDB | Elasticsearch | Hadoop | Kafka | Python | Redshift | S3 | SQL | Snowflake | Spark Streaming | Stored Procedures | Time Series | Time-series databases | Triggers | Window Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimeShanghai, CHN8h ago
-
Entry-level Internship合肥13h ago
-
Entry-level Internship上海13h ago
-
Senior-level Full Time上海、苏州、北京、广州、深圳13h ago
-
Mid-level Full Time北京、上海、苏州13h ago
-
Senior-level Full Time上海、苏州、北京、深圳13h ago
-
Deep Learning Planning R&D Engineer CNY 180K-300KC++ | Data Structures | Data Structures and Algorithms | Deep learning | Deep reinforcement learningMid-level Full Time上海、苏州、北京、深圳13h ago
-
Mid-level Full Time北京、深圳、苏州、上海13h ago
-
Senior-level Full Time北京、上海13h ago
-
数据挖掘平台工程架构开发工程师 CNY 180K-420KAlerting | Automated Deployment | CI/CD | Database Design | Distributed SystemsMid-level Full Time北京、上海、苏州13h ago
-
Mid-level Full Time北京、深圳、苏州、上海13h ago
-
Entry-level Full TimeSuzhou, Jiangsu, China1d ago
-
Technical Consultant – Machine Learning DevOps CNY 272K-370KAWS | Amazon SageMaker | Azure | Batch Processing | CI/CDMid-level Full TimeDalian Office, China1d ago
-
Technical Consultant – Machine Learning CNY 304K-380KAWS | AWS SageMaker | Amazon Redshift | Amazon SageMaker | AzureMid-level Full TimeDalian Office, China1d ago
-
BigQuery | Cloud platform | DBT | Data Lake | Data ModelingAutonomy | Growth | Impact | Rewards | TrustMid-level Full TimeChina2d ago
-
Java服务端研发工程师 - 商业化 CNY 180K-300KApache Flink | Apache Hive | Apache Spark | Data Analysis | Distributed ComputingMid-level Full Time北京3d ago
-
数据开发工程师 CNY 240K-420KAPI Development | Data Lineage | Data Modeling | Data Quality | Data ValidationMid-level Full Time深圳3d ago
-
【27届实习】Ai实习生(可转正) CNY 25K-37KAI Services | AWS | Classification | Cloud AI | Cloud AI servicesPotential full-time conversion | Team collaboration | Technical trainingEntry-level Internship淄博、济南、青岛3d ago
-
Entry-level Full Time InternshipBeijing, Beijing, China4d ago
-
AI Computing Development Engineer, TensorRT-LLM CNY 337K-490KArtificial Intelligence | C# | C++ | Debugging | Deep learningSenior-level Full TimeChina, Shanghai4d ago
-
AI Software Engineering Graduate Intern CNY 38K-50KAI Algorithms | AI Models | Computer Architecture | Performance Analysis | Performance ProfilingOn-site workEntry-level Full Time InternshipCHN - Beijing, China4d ago
-
Web Runtime Optimization Engineer CNY 400K-540KBlink | C# | C++ | Chromium | JavaScriptOn-site work modelSenior-level Full TimeCHN - Minhang, China4d ago
-
Machine Learning Engineer (Training Optimization) CNY 240K-480KCUDA | Data Types | DeepSpeed | Diffusion Models | Distributed TrainingSenior-level Full TimeBeijing, Beijing, China4d ago
-
Entry-level InternshipShanghai5d ago
-
Mid-level Full Time上海5d ago