Senior Data Engineer
A SGD 143K-191K (estimate) Senior-level Full Time
Tasks
- Collaborate with cross-functional teams
- Develop data dictionaries and metadata repositories
- Document data pipelines and schemas
- Enforce data security and compliance
- Identify performance bottlenecks
- Implement data access controls and encryption
- Implement data quality checks
- Integrate data from multiple sources
- Monitor data pipelines and resolve errors
- Optimize data processing and query performance
- Optimize data structures for querying
- Set up monitoring tools alerts and logging
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Web Services | Apache Avro | Apache Beam | Apache Flink | Apache Hadoop | Apache Kafka | Apache Parquet | Apache Spark | Avro | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hub | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Bash | CI/CD | Cloud platform | Data Modeling | Data Warehousing | Database performance | Database performance tuning | Event Hubs | Git | GitHub | Google Cloud | Google Cloud Platform | Indexing | IoT Hub | JSON | Microsoft Azure | MySQL | Parquet | Performance Tuning | PostgreSQL | Powershell | Python | SQL | SQL Database | Synapse Analytics | Web Services
Education
Roles
Related jobs
-
BigQuery | Cloud Data Catalog | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeSingapore, Singapore8h ago
-
Mid-level Full TimeSingapore, Singapore8h ago
-
ARM Templates | Alerting | Application Insights | Aqua Security | Azure ContainerSenior-level Full TimeSingapore, Singapore8h ago
-
Machine Learning Engineer - Search E-Commerce SGD 30K-36KComputer Vision | Information Retrieval | Language Processing | Machine Learning | Model DeploymentMid-level Full TimeSingapore, Singapore8h ago
-
Senior Data Management Professional - Data Engineering - Listed Derivatives Data, Singapore SGD 113K-142KAmazon S3 | Business Rules | Data Governance | Data Pipelines | Data QualitySenior-level Full TimeSingapore8h ago
-
Senior-level Full TimeSingapore, Singapore9h ago
-
Data collection | Deep learning | Feature Engineering | Foundation Models | Language ProcessingCredit bearing internshipEntry-level InternshipSingapore, Singapore9h ago
-
Senior-level Full TimeSingapore14h ago
-
Senior-level Full TimeFab 10A, Singapore21h ago
-
Associate Machine Learning Engineer SGD 95K-140KAWS | Azure | CI/CD | Data Preprocessing | Data VisualizationMid-level Full TimeSG Ensign Kallang Place, L9 (Right …21h ago
-
Senior Embedded Software Engineer SGD 96K-132KARM | AWS | Agile | Azure | C#Dental and vision | Health screening | Hybrid work options | Life and accident protection | Outpatient benefitsSenior-level Full TimeSingapore Singapore (Corporation Road)21h ago
-
Mid-level Full TimeSingapore1d ago
-
Component Engineer – Data Analytics SGD 78K-95KAPI Integration | Azure Data | Azure Data Factory | BOM | DAXMid-level Full TimeSingapore, Singapore, Singapore2d ago
-
AWS Athena | AWS Glue | AWS SageMaker | Agile | Amazon RDSEmployee wellness program | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore2d ago
-
AWS | Azure | Cloud platform | Data Pipelines | Data WarehousingEmployee wellness program | Fun working environment | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore2d ago
-
AWS | CI/CD | Experiment design | Exploratory research | FastAPICoaching and mentoring | Employee wellness program | Equal opportunity workplace | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore2d ago
-
APIs | Azure | Azure Data | Azure Data Explorer | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore3d ago
-
AWS | Agile | Apache Airflow | Apache Flink | Apache SparkMid-level Full TimeSingapore, Singapore3d ago
-
Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeSingapore, Singapore3d ago
-
Machine Learning Engineer - Global E-Commerce - Personalized Presentation/Pricing & User Growth SGD 70K-70KAnomaly Detection | Causal Inference | Causal modeling | Data Analysis | Data MiningEntry-level Full TimeSingapore, Singapore3d ago
-
Senior-level Full TimeSingapore, Singapore, Singapore3d ago
-
Backend Developer(.Net) SGD 111K-160K.Net Core | Amazon Web Services | Apache Kafka | C# | Cloud platformSenior-level Full TimeSingapore, Singapore, Singapore3d ago
-
Senior-level Full TimeSingapore, Singapore, Singapore3d ago
-
Mid-level Full TimeSingapore, Singapore, Singapore3d ago
-
Mid-level Full TimeSingapore, Singapore, Singapore3d ago