Executive Officer, GT-Data & Payments Platform (Data Engineer)
Tasks
- Analyze server utilization before and after deployments
- Conduct server and application performance assessments
- Coordinate patch upgrade and backup maintenance
- Design data ingestion pipelines
- Develop data pipelines and platforms
- Develop remediation plans from vulnerability assessment results
- Implement error handling and logging
- Implement logging, monitoring, and alerting
- Monitor pipeline health system performance and data availability
- Optimize pipeline performance
- Perform end to end testing for extraction transformation and loading
- Provide production support for pipelines
- Troubleshoot pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Apache Spark | Data Ingestion | Data Lakehouse | Data Processing | Data Warehousing | ETL | Linux | Logging | Monitoring | Oracle | PostgreSQL | Python | SQL | SQL Server | Shell Scripting | Unix
Education
Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Information Technology | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
AI DevOps Engineer 2213 USD 106K-150KAlerting | Automation | CI/CD | Cause analysis | ITSM24x7 production supportMid-level Full TimeCyberjaya, Selangor, Malaysia1d ago
-
Data Engineer USD 117K-156KAutomation | Data Warehousing | Data integration | Data virtualization | Database ViewsEntry-level Full TimeGeorge Town, Penang, Malaysia1d ago
-
Consultant - Snowflake Data Engineer USD 138K-192KAWS | Azure | Cloud Data | Cloud Data Platforms | Cloud platform360-degree feedback | Community clubs | Innovation days | Mentorship | Paid certificationsMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Remote distributed settingMid-level Full TimePenang, Malaysia4d ago
-
Operation Analytic Engineer USD 111K-153KAnomaly Detection | Classification | Clustering | Cpk analysis | DOESenior-level Full TimePasir Gudang, Johor, Malaysia5d ago
-
Cloud Engineer EUR 102K-105KAWS CloudFormation | Amazon EKS | Amazon Web Services | Argo CD | CI/CDMid-level ContractKuala Lumpur, Malaysia6d ago
-
Senior Data Engineer USD 110K-151KAgile | Autonomous Database | CI/CD | Data Governance | Data ModelingSenior-level ContractKL,Malaysia, Malaysia6d ago
-
AI Computer Vision Engineer USD 100K-150K3D Vision | Anomaly Detection | Camera Calibration | Clustering | Defect DetectionSenior-level Full TimePenang Bayan Lepas, Malaysia6d ago
-
AI Engineer USD 100K-205KAWS SageMaker | Anomaly Detection | Azure Machine Learning | CI/CD | ClassificationMid-level Full TimePenang Bayan Lepas, Malaysia6d ago
-
Entry-level Full TimeMelaka, Malaysia6d ago
-
Engineer, Data Analytics Engineering USD 73K-110KDVC | Data Preprocessing | Data Visualization | Defect localization | Detectron2Entry-level Full TimeBatu Kawan, Penang, Malaysia6d ago
-
Staff Data Platform Engineer (Cloud-Native) USD 119K-202KAWS | Apache Hive | Apache Kafka | Apache Spark | CI/CDSenior-level Full TimeBatu Kawan, Penang, Malaysia6d ago
-
Software & AI Platform Engineer USD 100K-215KAPI | Anomaly Detection | C# | CI/CD | Computer VisionMid-level Full TimeBatu Kawan, Penang, Malaysia7d ago
-
Entry-level Full TimeKuala Lumpur, MY7d ago
-
Technology Consulting - Data Engineer, AI & Data CAD 108K-160KAgile | Amazon Web Services | Apache Kafka | Apache NiFi | AzureCareer growth | Coaching and development | Continuous learning | Flexible working arrangements | Inclusive workplaceMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …8d ago
-
Internship - Software Development (Embedded) USD 58K-90KARM | Agile | Algorithms | Arc | C plus plusEntry-level InternshipPetaling Jaya, Selangor, Malaysia8d ago
-
Analytics Specialist - Data Automation & Reporting USD 126K-170KCRM | Data Pipelines | Data integration | ETL | ExcelHybrid work | Onsite workMid-level Full TimePerai, Penang, Malaysia8d ago
-
AI Coding Agents | AI coding | Agent systems | ClickHouse | Code AnalysisCross-functional team collaboration | Mandarin language support collaborationMid-level Full TimeFederal Territory of Kuala Lumpur, Federal …9d ago
-
Automation | Autosys | Batch Processing | Cause analysis | Data Pipeline MonitoringMid-level Full TimeMY-Kuala Lumpur-IT, Malaysia9d ago
-
Data Platform Engineer GBP 48K-52KAWS | Azure | CI/CD | DBT | Data GovernanceFlexible hybrid working | International work environment | Learning and development | Work-life balanceMid-level Full TimeKuala Lumpur - Level 19, 1 …9d ago
-
GenAI Software Solutions Engineer USD 105K-192KAgent Orchestration | Autogen | C++ | Chroma | DebuggingHybrid work modelMid-level Full TimeMYS - Penang, Malaysia10d ago
-
Entry-level Full TimeBangsar South, Malaysia10d ago
-
Anomaly Detection | Data Modeling | Data Quality | Data pipeline | DatabricksHybrid workSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …10d ago
-
Operation Analytic Engineer USD 113K-151KAnomaly Detection | Classification | Clustering | Cpk | DOESenior-level Full TimePasir Gudang, Johor, Malaysia11d ago
-
Data Engineer USD 132K-200KBigQuery | Cloud platform | DBT | Data Governance | Data LakeAutonomy | Growth opportunities | Impact | Ownership | TrustMid-level Full TimeMalaysia12d ago