Senior Data Engineer
Tasks
- Automate data quality checks
- Build ETL/ELT workflows
- Build Spark Structured Streaming logic
- Build data lakehouse solutions
- Collaborate with analysts, data scientists, and stakeholders
- Design scalable data pipelines
- Develop real-time streaming pipelines
- Ensure data lineage and metadata capture
- Implement data lakehouse metadata and catalog
- Implement data validation and monitoring
- Leverage data governance and catalogue frameworks
- Migrate legacy SQL workloads to cloud
- Optimize SQL transformations
- Troubleshoot pipeline issues
Perks/Benefits
- Community initiatives
- Holistic flexible benefits
- Learning and professional development
- Wellbeing support
Skills/Tech-stack
Apache Iceberg | Apache Spark | CI/CD | Cloud Data | Cloud Storage | Cloud Streaming | Cloud compute | Cloud data processing | Data Governance | Data Lakehouse | Data Lineage | Data Processing | Data catalogue | Datahub | Docker | ELT | ETL | Git | Kubernetes | Metadata Management | OpenMetadata | PySpark | Python | SQL | Streaming | Structured Streaming | Unix/Linux | Workflow Orchestration
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Professional Services Engineer SGD 72K-123KAPI | Amazon Web Services | Authentication | Java | KubernetesMid-level Full TimeSingapore, SG3h ago
-
Software Engineer, Android and Pixel SDLC SGD 140K-191KAgent systems | Android Performance Diagnostics | Android performance | Anomaly Detection | AutomationSenior-level Full TimeSingapore7h ago
-
Arduino | C++ | CSS | Computer Vision | Deep learningSenior-level Full TimeSingapore7h ago
-
Software Engineer, Acceleration Platform SGD 70K-143KAI Safety | Algorithms | C++ | Computer Vision | Data ProcessingMid-level Full TimeSingapore7h ago
-
Software Engineer, Acceleration Platform Team SGD 150K-191KAI Safety | Algorithms | C++ | Data Structures | DebuggingSenior-level Full TimeSingapore7h ago
-
Senior Software Engineer, Acceleration Platform SGD 150K-200KAI Safety | C++ | Computer Vision | Data Processing | Data StructuresMentorship opportunities | Technical leadership pathSenior-level Full TimeSingapore7h ago
-
Senior Software Engineer- Singapore SGD 184K-203KAIOps | Apache Spark | Artificial Intelligence | Dspy | JavaSenior-level Full TimeSingapore14h ago
-
Mid-level Full TimeSingapore14h ago
-
AI/ML Engineer SGD 64K-130KAI Agents | Anomaly Detection | Azure | Change Management | Cloud platformMid-level Full TimeSingapore, Singapore18h ago
-
Senior Analytics Engineer USD 144K-180KAirflow | Amazon Redshift | CI/CD | DBT | Data GovernanceEmployee recognition programs | Employee rewards | Exponential career development | Medical insurance coverage | Mobile and flexible work environmentSenior-level Full TimeSingapore, Ho Chi Minh, Vietnam1d ago
-
Container Orchestration | Distributed Computing | High Performance | High-Performance Computing | KubernetesMid-level Full TimeSingapore1d ago
-
Cloud deployment | Computer Vision | Data Modeling | Language Processing | Machine LearningEntry-level Full TimeSingapore, Singapore1d ago
-
Mid-level Full TimeSingapore1d ago
-
Artificial Intelligence | C# | C++ | CSS | Distributed SystemsEntry-level Full TimeSingapore1d ago
-
Software Engineer III, Enterprise Data Protection SGD 108K-148KAgentic Software | Agentic Software Engineering | Artificial Intelligence | C++ | CSSSenior-level Full TimeSingapore1d ago
-
Entry-level Full Time InternshipSG Ensign Kallang Place, L9 (Right …1d ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Cloud platformExecutive-level Contract Full TimeHEALTH SCIENCES AUTHORITY BUILDING, Singapore1d ago
-
AES | AWS IAM | Access Control | Attribute-Based Access Control | Attribute-based accessSenior-level Full TimeNgee Ann Polytechnic, Clementi Campus, Singapore1d ago
-
ABBYY | Alteryx | C# | Data Cleansing | Data ManagementNone Full TimeSingapore - Marina One1d ago
-
Machine Learning Engineer (Singapore) SGD 140K-142KAWS | Airflow | Azure | CLIP | Cloud StorageEquipment provided | Equipment stipend | Global travel insurance | Health insurance | Paid HolidaysSenior-level Full TimeSingapore1d ago
-
Lead AI Research Strategist SGD 100K-144KAI Agents | AI benchmarking | Dataset curation | Evaluation Methodologies | Fine TuningHybrid work | In-office collaboration | Ownership of work | Personal growth | Professional growthSenior-level Full TimeSingapore, Singapore, Singapore R2d ago
-
Senior-level Full TimeSingapore2d ago
-
Senior-level Full TimeSingapore | Hong Kong2d ago
-
Artificial Intelligence | Big Data | Data Visualization | Database Programming | HadoopEntry-level Full TimeSingapore2d ago
-
Data & AI Engineer SGD 100K-143KAWS | AWS Glue | AWS Lambda | Airflow | Amazon EC2Mentorship | Professional growthMid-level Full TimeSingapore, Singapore, Singapore2d ago