Senior Data Engineer
Tasks
- Build real time automated scalable data streams
- Collaborate on data quality ownership
- Deploy data pipelines to data lake or data warehouse
- Implement data auditing for data quality
- Maintain pipeline processes and troubleshoot failures
- Optimize query performance with profiling tools
- Resolve large scale data processing workflow issues
- Specify data requirements and provide data access
- Triaging data infrastructure issues and drive resolution
- Tune application and query performance using SQL
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS SES | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | Apache Spark | Big Data | Cassandra | Cloud Computing | Data Auditing | Data Governance | Data Lake | Data Mining | Data Quality | Data Warehouse | DynamoDB | Elasticsearch | Machine Learning | NoSQL | Query Tuning | Real Time | Real-time Data | SQL | Snowflake | Stored Procedures | Time Series | Time-series databases | Triggers | Window Functions
Education
N/A
Roles
Related jobs
-
【27届实习】云原生Ai平台研发工程师-杭州 CNY 25K-37KArgo Workflow | Computer networks | Containerization | Data Structures | GolangConversion to permanent role | Technical documentation supportEntry-level Internship杭州5h ago
-
【27届实习】数据挖掘工程师 CNY 25K-37KData Structures | Deep learning | Distributed machine learning | Go | Image ProcessingConversion to full time roleEntry-level Internship Temporary上海5h ago
-
【27届实习】算法研究员-视觉方向 CNY 25K-37KAIGC | Computer Vision | Cross-Modal Learning | Data Structures | Deep learningFull-time conversion opportunityEntry-level Internship上海、杭州5h ago
-
【27届实习】Dba(数据库工程师) CNY 37K-37KAutomation | Database Architecture | Distributed Systems | MongoDB | MySQLConversion to permanent position | Internship programEntry-level Internship上海5h ago
-
Mid-level Full TimeShanghai, China17h ago
-
Senior-level Full TimeShanghai, China18h ago
-
AI Algorithm and Development Software Engineer CNY 240K-360KAgent architecture | Agent systems | AutoGPT | CUDA | Chain-of-ThoughtOn-call supportMid-level Full TimeBeiJing, China23h ago
-
AWS | Azure | JavaScript | NoSQL | Node.jsFast-paced environment | Remote workMid-level Full TimeHangzhou R2d ago
-
AWS | Agile | Azure | Blockchain | CursorRemote workMid-level Full TimeShenzhen R2d ago
-
高级算法工程师（Nlp方向） CNY 240K-480KAgent memory | CUDA | Chroma | Client-Server | Client-Server ArchitectureSenior-level Full Time北京3d ago
-
机器人VLA算法研究员 - XiaomiRobotics CNY 500K-500KDeep learning | Diffusion Models | Language Modeling | Machine Learning | Mixture of ExpertsEntry-level Full Time北京3d ago
-
具身世界模型训练INFRA工程师 - XiaomiRobotics CNY 180K-360KAPIs | Deep learning | Distributed Training | Fault Tolerance | Infrastructure EngineeringMid-level Full Time北京3d ago
-
具身世界模型数据工程师 - XiaomiRobotics CNY 96K-144KComputer Vision | Data Engineering | Machine Learning | Video CompressionMid-level Full Time北京3d ago
-
Mid-level Full TimeChina, Shanghai3d ago
-
Executive-level Full TimeBeiJing, China4d ago
-
Entry-level Internship上海5d ago
-
Data Analytics & Management, Off CNY 397K-540KAPIs | AWS | Airflow | Apache Iceberg | BIEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer days | Vibrant employee networksSenior-level Full TimeHangzhou, China5d ago
-
Algorithm modeling | Computer Vision | Data Augmentation | Emulation Platforms | F1-scoreCross site international experienceMid-level Full TimeShanghai, China5d ago
-
Software Dev Engineer I, Japan Store Tech CNY 28K-50KAlgorithms | Complexity analysis | Data Mining | Data Structures | Distributed SystemsEntry-level Full TimeBeijing, CHN5d ago
-
Mid-level Full Time深圳6d ago
-
Mid-level Full Time上海6d ago
-
Mid-level Full Time深圳、上海6d ago
-
Mid-level Full Time北京6d ago
-
Mid-level Full Time广州6d ago
-
驾舱一体专家/高级专家/总监 CNY 240K-480KComputer Vision | Data Generation | Data Preprocessing | Data cleaning | Deep learningSenior-level Full Time北京、上海、深圳、广州6d ago