Executive Officer, GT-Data & Payments Platform (Data Engineer)
Tasks
- Analyze server utilization before and after deployments
- Conduct server and application performance assessments
- Coordinate patch upgrade and backup maintenance
- Design data ingestion pipelines
- Develop data pipelines and platforms
- Develop remediation plans from vulnerability assessment results
- Implement error handling and logging
- Implement logging, monitoring, and alerting
- Monitor pipeline health system performance and data availability
- Optimize pipeline performance
- Perform end to end testing for extraction transformation and loading
- Provide production support for pipelines
- Troubleshoot pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Apache Spark | Data Ingestion | Data Lakehouse | Data Processing | Data Warehousing | ETL | Linux | Logging | Monitoring | Oracle | PostgreSQL | Python | SQL | SQL Server | Shell Scripting | Unix
Education
Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Information Technology | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
Senior-level Full TimeKuala Lumpur17h ago
-
Specialist-Data Analytics & Automation (Investment) USD 98K-150KArtificial Intelligence | Azure | Azure Data | Azure Data Services | Azure KubernetesCareer growth opportunities | Professional developmentMid-level Full TimeMY-Cyberjaya, Malaysia20h ago
-
Senior Associate Data Engineer USD 90K-140K.NET | Analysis Services | Apache Storm | Azure Data | Azure Data FactoryHybrid workingMid-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia20h ago
-
Internship - Software Development (Embedded) USD 44K-70KARM | Agile | Algorithms | Arc | C#Executive exposure | Mentorship | Networking events | On-the-job training | Professional development trainingEntry-level InternshipPetaling Jaya, Selangor, Malaysia1d ago
-
Intern, Data and Analytics USD 57K-86KAzure | Azure Data | Azure Data Factory | CI/CD | Data FactoryEntry-level Full Time InternshipMY-Kuala Lumpur-IT, Malaysia1d ago
-
Intern, Data and Analytics USD 57K-86KAzure | Azure Data | Azure Data Factory | Azure Databricks | CI/CDEntry-level Full Time InternshipMY-Kuala Lumpur-IT, Malaysia1d ago
-
Azure Infrastructure & Data Engineer USD 120K-176KAccess Control | Azure Bicep | Azure Cosmos | Azure Cosmos DB | Azure DataContinuing education support | Continuous learning | Family-friendly perks | Flexible time off | Health and wellnessMid-level Full TimeMY - PENANG 38 JALAN SULTAN …1d ago
-
Azure Infrastructure & Data Engineer USD 120K-176KARM Templates | App Service | Application Gateway | Azure App | Azure App ServiceMid-level Full TimeMY - PENANG 38 JALAN SULTAN …1d ago
-
C# | Element analysis | Finite Element Analysis | Finite element | GrasshopperSenior-level Full TimeKuala Lumpur, Malaysia2d ago
-
Data System Specialist USD 91K-115KAccess Control | Azure Data | Azure Data Factory | Azure DevOps | Data FactoryMid-level Full TimePenang, MY2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Collaborative team | Flexible remote work | Opportunity to make impactMid-level Full TimeKuala Lumpur, Malaysia2d ago
-
Senior-level Full TimeMYS - Penang - GBS, Malaysia2d ago
-
Senior GenAI Software Solutions Engineer USD 149K-269KAI Agents | Autogen | C++ | Caching | ChromaHybrid workSenior-level Full TimeMYS - Penang, Malaysia2d ago
-
Software Development Engineer USD 92K-120KGit | JQuery | JavaScript | PHP | SQLHybrid work | Overtime if necessary | Remote workEntry-level Full TimeMalaysia Office -Penang2d ago
-
Mid-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
AWS | Automation | Capacity Planning | Compute | Data GovernanceHybrid work | On-call supportSenior-level Full TimeKuala Lumpur, Malaysia3d ago
-
AWS | Apache Flink | Apache Spark | CI/CD | Data ModelingBirthday leave | Flexible work | Life and Mental Health Support | Medical insurance | Parental leaveSenior-level Full TimePetaling Jaya, Malaysia3d ago
-
A/B | A/B Testing | Anomaly Detection | Apache Flink | Apache SparkBirthday leave | Confidential Assistance Programme | Flexwork arrangements | Medical insurance | Parental leaveSenior-level Full TimePetaling Jaya, Malaysia3d ago
-
Full Stack AI Engineer - QA Department USD 125K-165KAWS | Agentic Systems | Anthropic | Azure | Cloud infrastructureAdditional hardware | Conferences participation | Flexible hours | Free trainings | GitLabEntry-level Full TimeKuala Lumpur3d ago
-
Experienced Associate - Data Engineer cum Scientist USD 67K-140KAWS | Amazon Redshift | Apache Airflow | Apache Hadoop | Apache KafkaMid-level Full TimeKuala Lumpur Office, Malaysia3d ago
-
Data Engineer USD 124K-166KAccess Control | Alerting | BigQuery | DBT | Data GovernanceAutonomy | Growth opportunities | Impact | Rewards | TrustMid-level Full TimeMalaysia5d ago
-
Senior-level Full TimePetaling Jaya (First Avenue), Malaysia5d ago
-
Automation | Cross-Functional Collaboration | Cross-functional | Data Analysis | Electrical EngineeringEntry-level Full Time InternshipMalaysia7d ago
-
Data pipeline | Deep learning | Finetuning | Foundation Models | Knowledge DistillationBirthday leave | FlexWork | GrabFlex benefits | Medical insurance | Parental leaveEntry-level Full Time InternshipPetaling Jaya, Malaysia7d ago
-
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | Amazon EC2Senior-level Full TimeKuala Lumpur, Federal Territory of Kuala …7d ago