Senior Data Engineer - AVP
SGP-Head Office, Singapore
SGD 148K-180K (estimate) Senior-level Full Time
Tasks
- Build ETL and ELT workflows
- Build Spark Structured Streaming logic
- Capture data lineage and metadata
- Design and build scalable data pipelines
- Develop automated data quality checks
- Develop real-time streaming pipelines
- Implement data Lakehouse solutions
- Implement data governance and catalogue
- Migrate legacy SQL workloads to cloud
- Monitor data reliability and performance
- Optimize SQL and transformation logic
- Troubleshoot pipeline issues
- Write SQL for data transformations
Perks/Benefits
Skills/Tech-stack
Agile | Apache Iceberg | Apache Spark | Data Catalog | Data Governance | Data Lakehouse | Data catalogue | Datahub | ELT | ETL | Git | Metadata Management | Open Data | Open Data Catalogue | OpenMetadata | PySpark | Python | Real Time | Real-time Processing | SQL | Spark Structured Streaming | Streaming | Structured Streaming | Time processing | Unix/Linux
Education
N/A
Roles
Related jobs
-
APIs | Azure | Azure Data | Azure Data Explorer | Azure Data FactoryOnsite work scheduleMid-level Full TimeSingapore, Singapore1d ago
-
Data Ingestion | Data Pipelines | Data Transformation | Fault Tolerance | Low LatencyCredit bearing internshipEntry-level InternshipSingapore, Singapore1d ago
-
Graduate DeFi Algorithmic Trader SGD 87K-91KBlockchain | Ethereum Virtual Machine | Foundry | Git | GoEmployment pass sponsorshipEntry-level Full TimeSingapore1d ago
-
AI Research Scientist SGD 54K-60KAWS | Azure | Computer Vision | Data Engineering | Data ModelingFlexible work arrangements | Hybrid work | International projects | Project based rotations | Referral programEntry-level Full TimeSGP - Singapore - Singapore (Boulevard …1d ago
-
Senior Staff Software Engineer SGD 150K-204KApache Flink | Apache Hive | Apache Iceberg | Apache Kafka | Apache SparkCareer development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeSingapore-Singapore1d ago
-
Professional Services Engineer SGD 73K-111KAPI | Amazon Web Services | Authentication | CI/CD | JavaMid-level Full TimeSingapore, SG2d ago
-
Agent systems | Cloud platform | CrewAI | Data Pipelines | Google CloudSenior-level Full TimeSingapore2d ago
-
Staff, Machine Learning Engineer - Coupang Play SGD 140K-160KA/B | A/B Testing | AWS | Ad Personalization | B testingSenior-level Full TimeSingapore, Singapore2d ago
-
Data Analysis | Data Visualization | Java | Machine Learning | PyTorchDental insurance | Flexible working hours | Health insurance | Paid time off | Professional developmentMid-level Full TimeSingapore, Singapore, Singapore2d ago
-
Lead AI Engineer SGD 160K-214KAI Pipelines | AWS Bedrock | AWS SageMaker | AWS SageMaker Pipelines | AnsibleSenior-level Full TimeSingapore2d ago
-
Senior AI Engineer SGD 150K-184KAWS Bedrock | AWS SageMaker | Ansible | Azure Machine Learning | CI/CDSenior-level Full TimeSingapore2d ago
-
Mid-level Full TimeSingapore2d ago
-
Executive-level Full TimeSingapore, SG2d ago
-
Mid-level Full TimeSingapore, Raffles City Tower2d ago
-
Mid-level Full TimeSingapore, Raffles City Tower2d ago
-
Mid-level Full TimeSingapore, Raffles City Tower2d ago
-
Backend Software Engineer(DBA) SGD 36K-41KACID | Algorithms | CAP Theorem | Data Structures | Database theoryEntry-level Internship新加坡2d ago
-
APIs | Agent systems | Cloud platform | CrewAI | Data PipelinesMid-level Full TimeSingapore3d ago
-
Senior Data Engineer, Product Analytics, Payments SGD 136K-191KAI-native | AI-native analytics | Analytics infrastructure | Data Architecture | Data GovernanceSenior-level Full TimeSingapore3d ago
-
M06 - Senior Software Engineer SGD 139K-170KAPI Keys | API Management | Alerting | App Services | AuditabilitySenior-level Full TimeSingapore3d ago
-
SM/M, Senior Data Engineer SGD 96K-144KAnomaly Detection | Apache Airflow | Apache Spark | Data Cataloging | Data GovernanceSenior-level Full TimeMapletree Business City, Block 10, Level …3d ago
-
Mid-level Full Time新加坡3d ago
-
Apache Doris | ClickHouse | Data pipeline | Java | KV storeMid-level Full TimeSingapore, Singapore4d ago
-
Agent systems | Cloud platform | CrewAI | Google Cloud | Google Cloud PlatformMid-level Full TimeSingapore4d ago
-
C++ | Cloud Native | Data Modeling | Data Pipelines | ETLMid-level Full TimeSingapore4d ago