Lead Data & Integration Engineer
Tasks
- Analyze business and technical requirements into data flows and integration designs
- Coordinate SIT UAT and production rollouts
- Coordinate integrations in data lake ecosystem
- Define data contracts and interfaces with upstream and downstream teams
- Design and implement data movement across systems using APIs and file transfers
- Document flows mappings and interfaces
- Ensure integration reliability error handling and monitoring
- Ingest and prepare structured and unstructured data for GenAI workflows
- Support data aggregation enrichment and transformation for RAG and search
- Transform map and deliver data to target systems
- Troubleshoot integration issues across environments
Perks/Benefits
- N/A
Skills/Tech-stack
Batch Processing | Branching | CI/CD | Cloudera | Code Reviews | Confluence | Control-M | Data Aggregation | Data Mapping | Data Quality | Data Reconciliation | Data Transformation | Data pipeline | Data pipeline orchestration | Elastic Stack | File-Based | File-based integration | Git | Informatica | Java | Jira | Logging | OpenTelemetry | Pipeline Orchestration | Pull Requests | Python | RAG | REST APIs | SFTP | SQL | Splunk
Education
N/A
Related jobs
-
Bash | Cloud infrastructure | Cost Throughput Optimization | Data Ingestion | Data Ingestion PipelinesAsynchronous work culture | Career impact on large scale product | Friendly laid-back atmosphereMid-level Full TimeSingapore, Singapore9h ago
-
Mid-level Full TimeRemote - Singapore R10h ago
-
AI | APIs | Anomaly Detection | Data Governance | Data ModelingHybrid work | Mentoring | Training opportunitiesSenior-level Full TimeSingapore, Singapore1d ago
-
Apache Kafka | CI/CD | Docker | GraphQL | JavaScriptSenior-level Full TimeSingapore, Singapore1d ago
-
AI Intern SGD 44K-56KAPI Development | Cyber Security | Fine Tuning | Governance Risk | Governance risk complianceDiversity and inclusion | Flexible working arrangements | Training opportunitiesEntry-level InternshipSingapore, SG1d ago
-
Data Governance | Data Modeling | Data Processing | Data Warehousing | ETLEntry-level Full TimeSingapore, Singapore1d ago
-
Data Modeling | Data Processing | Data Quality | Data Warehousing | ETLEntry-level Full TimeSingapore, Singapore1d ago
-
AI Engineer SGD 74K-74KAI Platform | Amazon SageMaker | Azure Machine Learning | CI/CD | Cloud AI PlatformSenior-level Full TimeSingapore, Raffles City Tower1d ago
-
Senior-level Full TimeIOI Central Boulevard Towers, Singapore1d ago
-
Control Theory | Domain Randomization | Dynamics | Imitation Learning | IsaacGymMid-level Full TimeSingapore2d ago
-
C++ | Dynamic Obstacle Avoidance | Footstep planning | Localization | Localization and mappingEquitySenior-level Full TimeSingapore2d ago
-
C++ | Contact Rich Control | Control Theory | Data collection | Deep learningEquity | Open source contributionsMid-level Full TimeSingapore2d ago
-
Senior-level Full TimeSingapore2d ago
-
Data Engineer SGD 105K-141KAzure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure SynapseSenior-level Contract Full TimeSingapore, Singapore, Singapore3d ago
-
APIs | Amazon Web Services | Azure Data | Azure Data Explorer | Azure Data FactoryMonday to Friday schedule | Onsite workMid-level Full TimeSingapore, Singapore4d ago
-
.NET | Agent Orchestration | Agent systems | App Service | Azure AppSenior-level Full TimeSingapore, Singapore4d ago
-
Fullstack AI Engineer SGD 162K-220KAWS | Azure | CI/CD | Django | DockerEmployee wellness programs | Flexible work arrangements | Paid leaveSenior-level Full TimeSingapore, Singapore, Singapore4d ago
-
AI Engineer (Managed Services) SGD 85K-138KARES | AWQ | Agent Orchestration | Agent systems | Attention MechanismsMid-level Full TimeSingapore4d ago
-
Data Engineer SGD 96K-133KCloudera Data Platform | Data Analysis | Data Modeling | Data platform | Data virtualizationMid-level Full TimeSingapore4d ago
-
Data Engineer SGD 136K-190KAgile | Cloudera Data Platform | Data Modeling | Data Warehousing | Data platformSenior-level Full TimeSingapore4d ago
-
Mid-level Full TimeSingapore4d ago
-
Applied AI Engineer (Singapore) SGD 107K-170KAutomation | CRM | Document processing | Evaluation | Fraud DetectionFast interview process | Remote workMid-level Full TimeSingapore4d ago
-
AWS | Azure | Batch Processing | CI/CD | Cloud platformSenior-level Full TimeSingapore, Singapore, Singapore4d ago
-
Mid-level Full TimeSingapore, SG4d ago
-
AWS | Anomaly Detection | Azure | Docker | Feature EngineeringSenior-level Full TimeSingapore, Singapore4d ago