Senior Data Engineer - AVP
SGP-Head Office, Singapore
SGD 148K-180K (estimate) Senior-level Full Time
Tasks
- Build ETL and ELT workflows
- Build Spark Structured Streaming logic
- Capture data lineage and metadata
- Design and build scalable data pipelines
- Develop automated data quality checks
- Develop real-time streaming pipelines
- Implement data Lakehouse solutions
- Implement data governance and catalogue
- Migrate legacy SQL workloads to cloud
- Monitor data reliability and performance
- Optimize SQL and transformation logic
- Troubleshoot pipeline issues
- Write SQL for data transformations
Perks/Benefits
Skills/Tech-stack
Agile | Apache Iceberg | Apache Spark | Data Catalog | Data Governance | Data Lakehouse | Data catalogue | Datahub | ELT | ETL | Git | Metadata Management | Open Data | Open Data Catalogue | OpenMetadata | PySpark | Python | Real Time | Real-time Processing | SQL | Spark Structured Streaming | Streaming | Structured Streaming | Time processing | Unix/Linux
Education
N/A
Roles
Related jobs
-
Machine Learning Intern, Perception (End-to-end) SGD 45K-56KC++ | Cloud processing | Computer Vision | Deep learning | Machine LearningFlexible working hours | Full time internship duration at least 5 months | Remote work optionEntry-level InternshipSingapore, Central, Singapore12h ago
-
Machine Learning Engineer SGD 138K-178KArtifact tracking | Cloud Computing | Data Lineage | Data orchestration | Data pipelineFitness Events | Free meals | Hybrid work | Paid time off | Volunteer opportunitiesMid-level Full TimeSingapore, Singapore12h ago
-
Professional Services Engineer SGD 109K-140KAPI | Amazon Web Services | Apache Tomcat | Authentication | CI/CDMid-level Full TimeSingapore, SG1d ago
-
Automation | C# | C++ | Crisis management | DNSOn-call rotation | TravelSenior-level Full TimeSingapore1d ago
-
Software Engineer, Content Safety SGD 85K-140KAdversarial Detection | Automation | C++ | Computer Vision | Content processingMid-level Full TimeSingapore1d ago
-
Staff Research Engineer, Applied AI, DeepMind SGD 74K-130KAlgorithms | Cloud Computing | Cloud platform | Data Processing | Data StructuresSenior-level Full TimeSingapore1d ago
-
Mid-level Full TimeSLA-REVENUE HOUSE LEVEL 14, Singapore1d ago
-
C++ | Computer Vision | Image Processing | LabVIEW | MATLABMid-level Full TimeNTU Main Campus, Singapore1d ago
-
Senior-level Full TimeSingapore, Singapore, Singapore1d ago
-
MGR, Quantitative Developer - Global Markets Division SGD 132K-170KAPI Development | Backtesting | C# | C++ | DatabasesCommunity initiatives | Flexible benefits | Learning and professional development | Wellbeing supportEntry-level Full TimeSGP-Head Office, Singapore1d ago
-
2D Engineering | 2D Engineering Drawings | 3D Modeling | Additive Manufacturing | CNCCross-disciplinary collaboration | Hands on real robot deployments | Open source contributionsSenior-level Full TimeSingapore2d ago
-
CAN bus | Connector selection | Current Sense Amplifier | DC Systems | DC-DC converterSenior-level Full TimeSingapore2d ago
-
Mid-level Full TimeSingapore2d ago
-
Senior Software Engineer, Acceleration Platform SGD 162K-220KAI Safety | C++ | Computer Vision | Data Processing | Data StructuresMentorship | Technical leadershipSenior-level Full TimeSingapore3d ago
-
Azure | Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore4d ago
-
C++ | CSS | Computer Vision | Data Modeling | Deep learningSenior-level Full TimeSingapore4d ago
-
Principal Software Engineer - ML Platform Engineer SGD 150K-191KAWS | Access Control | Alerting | Azure | CI/CDSenior-level Full TimeSingapore4d ago
-
Data and AI Tech Principal Specialist SG SGD 160K-191KAWS Data | AWS Data Pipeline | Acceptance Testing | Amazon EC2 | Amazon EMRSenior-level Full TimeSingapore4d ago
-
Azure Synapse | Data Modeling | Data Preparation | Feature Engineering | Microsoft FabricMid-level Full TimeRepublic Polytechnic, Singapore4d ago
-
Azure AI Engineer (Azure AI Foundry & Gen AI) SGD 69K-130KAI Foundry | AI Search | APIs | Agent systems | AutogenMid-level Full TimeSingapore, Singapore, Singapore4d ago
-
Senior-level Contract Full TimeSingapore, Singapore, Singapore4d ago
-
AI Customer Engineer III, Cloud AI, Google Cloud SGD 160K-214KAgent Development | Application Programming | Application Programming Interfaces | Audit Logging | Cloud ArchitectureSenior-level Full TimeSingapore5d ago
-
Agile | Big Data | Cloud Platforms | Data Engineering | Data LakesMid-level Full TimeSingapore5d ago
-
Team Lead, Data Science & AI Engineering, Vice President SGD 162K-195KBigQuery | CI/CD | Cloud Storage | Cloud platform | Data PipelinesSenior-level Full TimeBOS-SGP, Singapore5d ago
-
AI Engineer (Azure OpenAI | LLM | RAG | AI Agents) SGD 70K-130KAI Agents | AI Foundry | Azure AI | Azure AI Foundry | Azure Machine LearningMid-level Full TimeSingapore, Singapore, Singapore5d ago