M13 - Data Engineer
Tasks
- Build and maintain data pipelines
- Configure AWS Lambda for data processing automation
- Configure and maintain AWS S3 data storage
- Develop CI/CD pipelines for data workflows
- Document data pipeline architectures and technical specifications
- Implement ETL and ELT processes
- Implement automated testing for data pipelines and data quality
- Implement data partitioning indexing and compression
- Maintain runbooks and operational procedures
- Manage and optimize AWS Redshift operations
- Monitor and troubleshoot data pipeline failures
- Optimize data workflows for performance and scalability
- Provide technical support for data related issues
- Set up monitoring and alerting for pipeline health
- Track engineering tasks in Jira
- Use version control and deployment strategies for data assets
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | AWS Glue | AWS Lambda | AWS Redshift | Amazon CloudWatch | Amazon S3 | Automated testing | CI/CD | Confluence | Data Compression | Data Modeling | Data Partitioning | Data Quality | Data Warehouse | Data indexing | ELT | ETL | GitLab | Infrastructure as Code | Jira | Python | Query Optimization | SQL | Shell Scripting | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Machine Learning | Model Evaluation | Performance optimization | Python | Software ArchitectureMid-level Full TimeSingapore, Singapore19h ago
-
Backend Engineer, Applied Machine Learning Platform SGD 122K-170KData Processing | Deep learning | Distributed Training | Docker | Feature EngineeringMid-level Full TimeSingapore, Singapore20h ago
-
Artificial Intelligence | Big Data | Data Modeling | Data Pipelines | Email MarketingEntry-level Full TimeSingapore, Singapore20h ago
-
Research Scientist, Machine Learning (PhD) SGD 65K-65KAlgorithms | Artificial Intelligence | Bias Mitigation | Computer Vision | Data MiningEntry-level Full TimeSingapore20h ago
-
RPA & Artificial Intelligence Engineer SGD 85K-138KAWS | Automation Anywhere | Azure | Azure Cognitive | Azure Cognitive ServicesHands-on experience | Mentorship | Training workshopsMid-level Full TimeSingapore, Singapore1d ago
-
AWS | Analytical Skills | Artificial Intelligence | C++ | CI/CDMindfulness programs | Training and development | Wellness programsSenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
Data Science Intern SGD 50K-57KAPI Development | Batch inference | Data Pipelines | Embeddings | Experiment designEntry-level Full Time InternshipSingapore-CapitaSky1d ago
-
APIs | Automated retraining | Automated testing | CI/CD | Cloud DataMid-level Full TimePaya Lebar Quarter 2 (SSG), Singapore1d ago
-
Senior-level Full TimeSingapore, Singapore, Singapore1d ago
-
AI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI SearchFlexible work environmentMid-level Full TimeManulife Tower, Manulife (Singapore) Pte Ltd1d ago
-
Senior Data Scientist (Computer Vision Engineer) SGD 184K-221KAPIs | C++ | Computer Vision | Data Validation | Deep learningSenior-level Full TimeSingapore1d ago
-
BigQuery | Cloud Data Catalog | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeSingapore, Singapore1d ago
-
Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOps | Azure SynapseOnsite work environmentMid-level Full TimeSingapore, Singapore1d ago
-
Mid-level Full TimeSingapore, Singapore, Singapore1d ago
-
Entry-level Full TimeSingapore-Yishun2d ago
-
Mid-level Full TimeSG Ensign Kallang Place, L9 (Right …2d ago
-
Forward Deployed Engineer - Singapore SGD 120K-143KBackend Development | Frontend Development | Full Stack | Full-Stack Development | Generative ModelsHybrid work | Relocation assistance | Travel opportunitiesMid-level Full TimeSingapore2d ago
-
Senior-level Full TimeSingapore, Singapore2d ago
-
Agent systems | Cloud Computing | MLOps | Machine Learning | Model EvaluationMid-level Full TimeSingapore, Singapore2d ago
-
ANSI SQL | Apache Iceberg | Apache Spark | Avro | CI/CDExecutive-level Full TimeSingapore, Singapore, Singapore2d ago
-
Data Engineering, Lakehouse and AI Data Platform Engineer, Analyst/ Associate, Singapore SGD 147K-180KANSI SQL | Apache Iceberg | Apache Spark | Avro | CI/CDSenior-level Full TimeSingapore, Singapore, Singapore2d ago
-
Senior AI Applications Engineer (Full Stack) SGD 140K-190KAWS | Azure | ClickHouse | Data Pipelines | DockerSenior-level Full TimeSingapore3d ago
-
Lead Algorithm Engineer - Search & Recommendation SGD 140K-160KAd Targeting | C++ | Computer Vision | Experimentation | JavaSenior-level Full TimeSingapore3d ago
-
Data Analytics Engineer/Data Scientist SGD 165K-220KAirflow | BigQuery | Cloud Databases | Cloud platform | DBTSenior-level Full TimeSingapore - Technology Centre3d ago
-
Data Engineer - A26137 SGD 60K-92KAPI Development | Agile | ArcGIS Server | Batch Processing | Continuous DeliveryCoaching and mentoring | Employee wellness program | Fun working environment | Growth opportunities | Structured development frameworkMid-level Full TimeSingapore, Singapore, Singapore3d ago