Data Engineer (Pyspark,Python,SQL,ETL)
Tasks
- Build reusable data transformation logic
- Collaborate with analysts architects and scientists
- Design scalable ETL/ELT pipelines
- Develop data models staging layers curated datasets
- Ensure data governance, security, and regulatory compliance
- Extract, transform and load data
- Maintain technical documentation
- Monitor scheduled ETL jobs
- Optimize PySpark jobs
- Optimize SQL queries
- Participate in code reviews, testing, and deployment
- Perform data cleansing validation reconciliation and quality checks
- Troubleshoot data pipeline failures and performance bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
ELT | ETL | PySpark | Python | SQL
Education
N/A
Roles
Related jobs
-
.NET | AKS | Azure DevOps | Azure Functions | Azure OpenAIMid-level Full TimeSingapore, Singapore3h ago
-
Mid-level Full TimeSingapore, Singapore3h ago
-
Data Warehouse Engineer - Data Platform - TikTok SGD 128K-165KApache Flink | Apache Hive | Apache Kafka | Apache Spark | JavaSenior-level Full TimeSingapore5h ago
-
Data Engineer, Product Analytics SGD 136K-204KAgent Orchestration | Artificial Intelligence | Bias Mitigation | C# | C++Senior-level Full TimeSingapore6h ago
-
Lead AI Engineer SGD 153K-216KAgent automation | CI/CD | Clean Code | Generative AI | Knowledge Grounded Language ModelsSenior-level Full TimeSingapore17h ago
-
Ansible | ArgoCD | Automation | Bash | BitbucketSenior-level Full TimeDBS Asia Hub, Singapore17h ago
-
Algorithms | Bayesian statistics | Deep learning | Formal Methods | Language ModelsResearch collaboration opportunities | Research funding grant support | Teaching opportunitiesMid-level Full TimeNTU Main Campus, Singapore17h ago
-
Control Theory | Domain Randomization | Dynamics | Imitation Learning | IsaacGymMid-level Full TimeSingapore1d ago
-
C++ | Dynamic Obstacle Avoidance | Embedded Systems | Footstep planning | LocalizationCompetitive compensation | EquitySenior-level Full TimeSingapore1d ago
-
VP of Research, Machine Learning SGD 120K-270KAgent systems | GPU | JAX | Knowledge Distillation | Machine LearningExecutive-level Full TimeSingapore R2d ago
-
Technical Lead, Machine Learning SGD 160K-225KBatch inference | Bias Evaluation | DPO | Data Pipelines | Fine TuningSenior-level Full TimeSingapore R2d ago
-
Staff Machine Learning Engineer SGD 150K-220KBias Evaluation | DPO | Data Pipelines | Evaluation | GPU OptimizationSenior-level Full TimeSingapore R2d ago
-
Senior Associate, Data Analytics and Machine Learning SGD 150K-238KCloud Computing | Cybersecurity | Dashboard Development | Data Engineering | Data GovernanceTransport providedSenior-level Full TimeSingapore - MTO AML2d ago
-
AWS | Anomaly Detection | Azure | Classification | ClusteringSenior-level Full TimeSingapore, Singapore3d ago
-
Senior-level Full TimeSingapore, Singapore3d ago
-
Agile | Application Insights | Azure DevOps | Azure Monitor | Azure ResourceCareer development resources | Training opportunitiesEntry-level Full TimeSingapore, Singapore3d ago
-
Capacity Planning | Distributed Systems | Docker | Grafana | KubernetesMid-level Full TimeSingapore, Singapore3d ago
-
Big Data | Data Catalog | Data pipeline | Distributed Systems | JavaEntry-level Full TimeSingapore, Singapore3d ago
-
API Design | Data Pipelines | Distributed Systems | Java | LinuxMid-level Full TimeSingapore, Singapore3d ago
-
Senior Data Engineer, Product Analytics, Payments SGD 162K-216KAnalytics infrastructure | Artificial Intelligence | Data Architecture | Data Governance | Data ModelingSenior-level Full TimeSingapore3d ago
-
Foundation Engineering, AI Platform, GenAI Search and Document Management Developer, Associate, Singapore SGD 146K-256KConcurrent programming | Distributed Systems | Elasticsearch | GRPC | JavaEntry-level Full TimeSingapore, Singapore, Singapore3d ago
-
Principal / Senior Engineer, Data Analytics & Management, Technical Operations Management SGD 120K-160KATDF | Automation | Cloud Architecture | Clustering Analysis | DashboardingSenior-level Full TimeSingapore, Singapore3d ago
-
Senior Data Analyst SGD 175K-204KAWS Athena | AWS Glue | Amazon EMR | Amazon QuickSight | Amazon RedshiftSenior-level Full TimeSingapore, Singapore3d ago
-
Backend Engineer - AI Solutions - A26300 SGD 90K-108KAI Agent | AI agent workflows | API Development | AWS | Access ControlsEmployee wellness program | Fun working environment | Learning and development opportunities | Structured development frameworkMid-level Contract Full TimeSingapore, Singapore, Singapore3d ago
-
Marketing Data Engineer SGD 159K-238KA/B | A/B Testing | Airflow | Anomaly Detection | Audience SegmentationIn office days policyMid-level Full TimeSingapore, Robinson Road3d ago