Executive Officer, GT-Data & Payments Platform (Data Engineer)
Tasks
- Analyze server utilization before and after deployments
- Conduct server and application performance assessments
- Coordinate patch upgrade and backup maintenance
- Design data ingestion pipelines
- Develop data pipelines and platforms
- Develop remediation plans from vulnerability assessment results
- Implement error handling and logging
- Implement logging, monitoring, and alerting
- Monitor pipeline health system performance and data availability
- Optimize pipeline performance
- Perform end to end testing for extraction transformation and loading
- Provide production support for pipelines
- Troubleshoot pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Apache Spark | Data Ingestion | Data Lakehouse | Data Processing | Data Warehousing | ETL | Linux | Logging | Monitoring | Oracle | PostgreSQL | Python | SQL | SQL Server | Shell Scripting | Unix
Education
Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Information Technology | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
Microsoft Fabric Data Engineer - Malaysia USD 117K-238KApache Spark | Azure Cognitive | Azure Cognitive Search | Azure Data | Azure Data FactoryMid-level Full Timekuala lumpur, Malaysia20h ago
-
Entry-level Full TimeKuala Lumpur, MY1d ago
-
Manufacturing Engineer – Data Science USD 85K-117KAmazon Web Services | Anomaly Detection | Azure | CI/CD | Cloud platformDevelopment curriculum | Mentorship | Structured onboardingEntry-level Full TimePasir Gudang, Malaysia1d ago
-
Senior Python AI Engineer USD 119K-209KArtificial Intelligence | Code review | Debugging | Machine Learning | Project ManagementFlexible work schedule | In-person collaborationSenior-level Full TimeMY209 - DXC Petaling Jaya (MY209), …1d ago
-
AI Solutions Engineer USD 115K-203KAPI Development | Backend Development | Cloud Computing | Containerization | Data PreprocessingSenior-level Full TimePetaling Jaya, Malaysia1d ago
-
Mid-level Full TimeCyberjaya, Selangor, Malaysia1d ago
-
Operation Analytic Engineer USD 113K-153KAnomaly Detection | Classification | Clustering | Cpk | DOESenior-level Full TimePasir Gudang, Johor, Malaysia2d ago
-
Senior Software Engineer, Customer Data Platform SGD 255K-334KAPI Development | AWS | Apache Flink | Apache Kafka | Apache SparkBirthday leave | Insurance Benefits Package | Medical insurance | Parental leave | Term life insuranceSenior-level Full TimePetaling Jaya, Malaysia2d ago
-
Data Analytics Engineer USD 82K-115KDAX | Data Analysis | Data Modeling | Data Quality | Data VisualizationMid-level Full TimePenang, Malaysia2d ago
-
Senior Data Engineer, Metrics Platform SGD 272K-320KAPI | Apache Pinot | Automation | Cloud services | Data ModelingBirthday leave | Custom benefits package | Employee assistance programme | FlexWork | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia3d ago
-
AI Engineer (Data) INR 1800K-3000KAccess patterns | Apache Airflow | Automated Quality | Automated Quality Assessment | Context ManagementMid-level Full TimeKuala Lumpur, Kuala Lumpur, Malaysia4d ago
-
AI/ML Engineer III INR 4000K-6000KAI Agents | AI Engineering | Anomaly Detection | Azure | Capacity PlanningSenior-level Full TimeKuala Lumpur, Malaysia4d ago
-
Senior Data Engineer - Qlik Replicate INR 1500K-2500KCI/CD | Cloudera | DB2 | ETL | Enterprise ManagerSenior-level Full TimeKuala Lumpur5d ago
-
Mid-level Full TimeJohor, Malaysia5d ago
-
Senior-level Full TimeKuala Lumpur, Malaysia5d ago
-
Data Engineer Intern USD 42K-55KApache Spark | Data Visualization | ELT | ETL | NoSQLHands-on experience | Industry networking | Multicultural environment | Project coordination experienceEntry-level Full Time InternshipMalaysia5d ago
-
Amazon Web Services | CI/CD | Data Pipelines | Databricks | EKSHybrid workSenior-level Full TimeKuala Lumpur, Malaysia7d ago
-
Manufacturing Engineer – Data Science USD 81K-116KAWS | Anomaly Detection | Azure | CI/CD | Cause analysisCross-functional collaboration | Development curriculum | Mentorship | Structured onboardingEntry-level Full TimePasir Gudang, Malaysia8d ago
-
Executive, Data Analytics EUR 95K-110KAnalytics engineering | BigQuery | Cloud platform | DBT | Data GovernanceDiscounted flights | Discounts on eateries | Growth opportunities | Unlimited training | Vacation timeExecutive-level Full TimeKuala Lumpur, Federal Territory of Kuala …8d ago
-
AI Data Engineer USD 125K-209KAmazon Redshift | Anomaly Detection | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimePenang Bayan Lepas, Malaysia8d ago
-
AWS | Airflow | Automated retraining | CI/CD | Context learningMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …8d ago
-
Senior Data Engineer USD 119K-165KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon AthenaCareer development | Flexible working arrangements | Hybrid work arrangement | Paid parental leave | Partner leaveSenior-level Full TimeMY: Kuala Lumpur - Bangsar South …9d ago
-
Senior-level Full TimeKuala Lumpur, Federal Territory of Kuala …9d ago
-
Machine Learning Engineer (4023) INR 3000K-5000KA/B | A/B Testing | AML | AWS SageMaker | Anomaly DetectionSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …9d ago
-
Senior Product Engineer, Embedded Finance USD 170K-250KAWS Lambda | Amazon Aurora | Amazon CloudWatch | Amazon EventBridge | Amazon S3AI tools at work | Continuous learning | Inclusive culture | Insurance coverage after probation | Reap Card stipendSenior-level Full TimeMalaysia, Malaysia R9d ago