Senior Data Engineer - AVP
SGP-Head Office, Singapore
SGD 148K-180K (estimate) Senior-level Full Time
Tasks
- Build ETL and ELT workflows
- Build Spark Structured Streaming logic
- Capture data lineage and metadata
- Design and build scalable data pipelines
- Develop automated data quality checks
- Develop real-time streaming pipelines
- Implement data Lakehouse solutions
- Implement data governance and catalogue
- Migrate legacy SQL workloads to cloud
- Monitor data reliability and performance
- Optimize SQL and transformation logic
- Troubleshoot pipeline issues
- Write SQL for data transformations
Perks/Benefits
Skills/Tech-stack
Agile | Apache Iceberg | Apache Spark | Data Catalog | Data Governance | Data Lakehouse | Data catalogue | Datahub | ELT | ETL | Git | Metadata Management | Open Data | Open Data Catalogue | OpenMetadata | PySpark | Python | Real Time | Real-time Processing | SQL | Spark Structured Streaming | Streaming | Structured Streaming | Time processing | Unix/Linux
Education
N/A
Roles
Related jobs
-
AI | APIs | Anomaly Detection | Data Governance | Data ModelingHybrid work | Mentoring | Training opportunitiesSenior-level Full TimeSingapore, Singapore5h ago
-
Apache Kafka | CI/CD | Docker | GraphQL | JavaScriptSenior-level Full TimeSingapore, Singapore7h ago
-
AI Intern SGD 44K-56KAPI Development | Cyber Security | Fine Tuning | Governance Risk | Governance risk complianceDiversity and inclusion | Flexible working arrangements | Training opportunitiesEntry-level InternshipSingapore, SG11h ago
-
Data Governance | Data Modeling | Data Processing | Data Warehousing | ETLEntry-level Full TimeSingapore, Singapore15h ago
-
Data Modeling | Data Processing | Data Quality | Data Warehousing | ETLEntry-level Full TimeSingapore, Singapore15h ago
-
Control Theory | Domain Randomization | Dynamics | Imitation Learning | IsaacGymMid-level Full TimeSingapore1d ago
-
C++ | Dynamic Obstacle Avoidance | Footstep planning | Localization | Localization and mappingEquitySenior-level Full TimeSingapore1d ago
-
C++ | Contact Rich Control | Control Theory | Data collection | Deep learningEquity | Open source contributionsMid-level Full TimeSingapore1d ago
-
Data Engineer SGD 105K-141KAzure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure SynapseSenior-level Contract Full TimeSingapore, Singapore, Singapore2d ago
-
APIs | Amazon Web Services | Azure Data | Azure Data Explorer | Azure Data FactoryMonday to Friday schedule | Onsite workMid-level Full TimeSingapore, Singapore3d ago
-
.NET | Agent Orchestration | Agent systems | App Service | Azure AppSenior-level Full TimeSingapore, Singapore3d ago
-
Fullstack AI Engineer SGD 162K-220KAWS | Azure | CI/CD | Django | DockerEmployee wellness programs | Flexible work arrangements | Paid leaveSenior-level Full TimeSingapore, Singapore, Singapore3d ago
-
Senior-level Full TimeSingapore3d ago
-
AI Engineer (Managed Services) SGD 85K-138KARES | AWQ | Agent Orchestration | Agent systems | Attention MechanismsMid-level Full TimeSingapore3d ago
-
Data Engineer SGD 96K-133KCloudera Data Platform | Data Analysis | Data Modeling | Data platform | Data virtualizationMid-level Full TimeSingapore3d ago
-
Data Engineer SGD 136K-190KAgile | Cloudera Data Platform | Data Modeling | Data Warehousing | Data platformSenior-level Full TimeSingapore3d ago
-
Mid-level Full TimeSingapore3d ago
-
Applied AI Engineer (Singapore) SGD 107K-170KAutomation | CRM | Document processing | Evaluation | Fraud DetectionFast interview process | Remote workMid-level Full TimeSingapore3d ago
-
AWS | Azure | Batch Processing | CI/CD | Cloud platformSenior-level Full TimeSingapore, Singapore, Singapore3d ago
-
Mid-level Full TimeSingapore, SG4d ago
-
AWS | Anomaly Detection | Azure | Docker | Feature EngineeringSenior-level Full TimeSingapore, Singapore4d ago
-
Senior-level Full TimeSingapore, Singapore4d ago
-
Data Modeling | Data integration | Java | LLM Agents | Language ModelsEntry-level Full TimeSingapore, Singapore4d ago
-
M41 - Full Stack Engineer SGD 150K-220KAWS | CI/CD | Generative AI | GitLab CI | Infrastructure as CodeSenior-level Full TimeSingapore4d ago
-
AI Software Engineer - Nas.com SGD 120K-220KAI Agents | AWS | Anthropic API | Azure | Backend FrameworksMedical insurance | Mental health fund | Profit share | Stock options | Wellness fundMid-level Full TimeSingapore4d ago