M25 - Data Engineer
Tasks
- Automate pipeline deployment configuration testing and operations
- Build batch incremental CDC and streaming ingestion patterns
- Build monitoring alerting and error recovery for pipelines
- Build trusted datasets and reusable data products for reporting analytics and applications
- Continuously improve automation reliability performance and maintainability
- Create data models and define data contracts schemas and lineage
- Create transformation pipelines for data cleaning enrichment standardization joining aggregation and structuring
- Design build and operate production data pipelines
- Design data integration architectures across on premises and cloud with secure data flows
- Design secure and resilient data transfer between on premises and cloud environments
- Detect investigate ingestion failures data quality anomalies and reconciliation differences
- Develop cloud native and hybrid data stores and data lakes
- Enable machine learning use cases with governed traceable reproducible data
- Enforce access controls least privilege and data governance
- Extract ingest transform and load data
- Implement ETL and ELT workflows
- Implement auditability traceability retention archival lifecycle and deletion
- Implement data quality validation reconciliation completeness consistency and controls
- Implement failure handling retry recovery idempotency and scalability
- Integrate data from APIs databases enterprise systems files and streams
- Maintain documentation runbooks and operational procedures
- Monitor data freshness pipeline health processing latency and quality indicators
- Monitor pipeline performance capacity reliability and cost
- Operate and support production pipelines and data products
- Perform incident investigation and root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | Alerting | Automated testing | Azure | CDC | CI/CD | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Database Integration | ELT | ETL | Event Driven | Event-driven architecture | Infrastructure as Code | Monitoring | Python | SQL | Schema Design | Streaming | Version control | “as-code”
Education
N/A
Roles
Related jobs
-
Machine Learning Engineer / Data Scientist (OCR/CV) SGD 166K-225KA/B | A/B Testing | B testing | CI/CD | Computer VisionMid-level Full TimeSingapore R13h ago
-
Software Engineer, ML Dev Enablement SGD 115K-140KAWS | C++ | DDP | Data loading | Distributed SystemsMid-level Full TimeSingapore, Central, Singapore13h ago
-
AI Algorithm Engineer SGD 36K-36KAction Recognition | C++ | Computer Vision | Data Visualization | Deep learningEntry-level Full Time InternshipSingapore23h ago
-
Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOps | Azure SynapseOnsite workMid-level Full TimeSingapore, Singapore1d ago
-
Bash | C# | C++ | GCC | GitFull-time conversion opportunity | MentorshipEntry-level InternshipHong Kong/Singapore/Shanghai1d ago
-
U02 - Senior Backend Engineer SGD 150K-190KAzure DevOps | CI/CD | Clean architecture | Distributed Systems | DockerSenior-level Full TimeSingapore1d ago
-
M04 - Operations Support Engineer SGD 90K-96KAWS CloudWatch | Access Control | Access Management | Agile | Amazon Web Services24 7 on call support coverageMid-level Full TimeSingapore1d ago
-
M01 - Cloud Logging & Data Platform Engineer SGD 175K-225KAWS | Access Control | Alerting | Audit Logging | AuthenticationOn-call support | Professional growth opportunitiesSenior-level Full TimeSingapore R1d ago
-
Senior Software Engineer, Machine Learning, Debug SGD 90K-144KC++ | CSS | Computer Vision | Data Modeling | Deep learningSenior-level Full TimeSingapore1d ago
-
Machine Learning Engineer SGD 75K-139KAWS | Embeddings | LLM API | LLM Evaluation | LangchainMentoring opportunitiesMid-level Full TimeSingapore1d ago
-
Senior Data Engineer SGD 165K-225KAPI Development | Apache Airflow | Asynchronous programming | Celery | CypherSenior-level Full TimeSingapore1d ago
-
GenAI Engineer SGD 107K-140KAgent Frameworks | Agent systems | Agentic Workflows | Cloud Computing | ContainerizationMid-level Full TimeSingapore, Singapore1d ago
-
Research and Analytics Intern SGD 42K-52KAI Agents | Automation | Data Storytelling | Data scraping | Language ModelsCareer growth | Fast-paced environment | Learning opportunitiesEntry-level InternshipSingapore1d ago
-
College Intern - Manufacturing AI Solutions SGD 44K-55KAI Agents | API Integration | Artificial Intelligence | Data Visualization | Data analyticsHands-on project experience | Mentorship | Portfolio worthy project | Relocation N/AEntry-level Full Time InternshipSOH01 - Singapore HP Campus Block …1d ago
-
VP, Data Engineer, Data Platform, Group Technology SGD 224K-270KAgile | Amazon S3 | Apache Iceberg | Apache Spark | BitbucketExecutive-level Full TimeDBS Asia Hub, Singapore1d ago
-
Associate, Digibot Agentic AI Transformation Specialist, Group Operations Capability Centre (GOCC), Group COO SGD 107K-170KAgentic AI | Chatbot Development | Conversational AI | GenAI | LLM APIEntry-level Full TimeDBS Asia Hub, Singapore1d ago
-
College Intern - Manufacturing AI Solutions SGD 44K-55KAI Agents | API Integration | Artificial Intelligence | Factory Automation | Industrial IoTHands-on experience | Mentorship | Portfolio worthy projectEntry-level Full Time InternshipSOH01 - Singapore HP Campus Block …1d ago
-
Engineer II (AI Enablement) SGD 70K-110KAPI Design | AWS | Application Architecture | CI/CD | Data ModelingMid-level Full TimeSingapore2d ago
-
C plus plus | C# | Communication Protocols | Debugging | Device DriversMid-level Full TimeSingapore2d ago
-
Algorithms | ClickHouse | Data Processing | Data Structures | HadoopEntry-level Full TimeSingapore, Singapore2d ago
-
Software Engineer (Big Data) - Application Computing SGD 82K-100KApache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache KuduMid-level Full TimeSingapore2d ago
-
Software Engineer (Big Data) - Application Computing SGD 75K-100KApache Cassandra | Apache Flink | Apache HBase | Apache Hudi | Apache IcebergMid-level Full TimeSingapore2d ago
-
Business Support Engineer - AdTech SGD 165K-249KAI tools | API Development | AWS | Agent Orchestration | Azure24 7 Oncall Rotation | Cross-functional collaborationMid-level Full TimeSingapore2d ago
-
AI Customer Engineer, Google Cloud SGD 140K-214KAgentic AI | As-a-Service | Audit Logging | Cloud Networking | Cloud infrastructureCollaborative culture | Conference participation | Travel opportunitiesSenior-level Full TimeSingapore2d ago
-
Data Pipelines | Domain Randomization | Imitation Learning | IsaacGym | IsaacLabHigh visibility projects | Open source contributionsSenior-level Full TimeSingapore2d ago