Data Engineer
Tasks
- Aggregate and analyze data
- Build data pipelines
- Build data warehouses and lakes
- Collaborate with data science stakeholders
- Design data architectures
- Develop data ingestion pipelines
- Ensure data quality and integrity
- Ensure data system reliability
- Implement data governance
- Implement data validation and cleansing
- Manage data storage systems
- Optimize data processing workflows
- Process and transform data
- Troubleshoot data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Kinesis | Apache Beam | Apache Flink | Apache Kafka | Apache NiFi | Apache Spark | Data Cleansing | Data Governance | Data Ingestion | Data Lakes | Data Pipelines | Data Quality | Data Validation | Data Warehousing | Java | NoSQL Databases | Python | Relational databases | Scala
Education
Roles
Related jobs
-
Operation Analytic Engineer USD 111K-153KAnomaly Detection | Classification | Clustering | Cpk analysis | DOESenior-level Full TimePasir Gudang, Johor, Malaysia1d ago
-
AI Computer Vision Engineer USD 100K-150K3D Vision | Anomaly Detection | Camera Calibration | Clustering | Defect DetectionSenior-level Full TimePenang Bayan Lepas, Malaysia1d ago
-
AI Engineer USD 100K-205KAWS SageMaker | Anomaly Detection | Azure Machine Learning | CI/CD | ClassificationMid-level Full TimePenang Bayan Lepas, Malaysia1d ago
-
Engineer, Data Analytics Engineering USD 73K-110KDVC | Data Preprocessing | Data Visualization | Defect localization | Detectron2Entry-level Full TimeBatu Kawan, Penang, Malaysia2d ago
-
Staff Data Platform Engineer (Cloud-Native) USD 119K-202KAWS | Apache Hive | Apache Kafka | Apache Spark | CI/CDSenior-level Full TimeBatu Kawan, Penang, Malaysia2d ago
-
API | Azure Data | Azure Data Factory | BOM | CSVEntry-level Full TimeSeri Iskandar, Perak, Malaysia2d ago
-
Software & AI Platform Engineer USD 100K-215KAPI | Anomaly Detection | C# | CI/CD | Computer VisionMid-level Full TimeBatu Kawan, Penang, Malaysia2d ago
-
Entry-level Full TimeKuala Lumpur, MY2d ago
-
Technology Consulting - Data Engineer, AI & Data CAD 108K-160KAgile | Amazon Web Services | Apache Kafka | Apache NiFi | AzureCareer growth | Coaching and development | Continuous learning | Flexible working arrangements | Inclusive workplaceMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …3d ago
-
Internship - Software Development (Embedded) USD 58K-90KARM | Agile | Algorithms | Arc | C plus plusEntry-level InternshipPetaling Jaya, Selangor, Malaysia4d ago
-
Analytics Specialist - Data Automation & Reporting USD 126K-170KCRM | Data Pipelines | Data integration | ETL | ExcelHybrid work | Onsite workMid-level Full TimePerai, Penang, Malaysia4d ago
-
AI Coding Agents | AI coding | Agent systems | ClickHouse | Code AnalysisCross-functional team collaboration | Mandarin language support collaborationMid-level Full TimeFederal Territory of Kuala Lumpur, Federal …4d ago
-
Automation | Autosys | Batch Processing | Cause analysis | Data Pipeline MonitoringMid-level Full TimeMY-Kuala Lumpur-IT, Malaysia4d ago
-
Data Platform Engineer GBP 48K-52KAWS | Azure | CI/CD | DBT | Data GovernanceFlexible hybrid working | International work environment | Learning and development | Work-life balanceMid-level Full TimeKuala Lumpur - Level 19, 1 …4d ago
-
GenAI Software Solutions Engineer USD 105K-192KAgent Orchestration | Autogen | C++ | Chroma | DebuggingHybrid work modelMid-level Full TimeMYS - Penang, Malaysia5d ago
-
Entry-level Full TimeBangsar South, Malaysia5d ago
-
Anomaly Detection | Data Modeling | Data Quality | Data pipeline | DatabricksHybrid workSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …5d ago
-
Operation Analytic Engineer USD 113K-151KAnomaly Detection | Classification | Clustering | Cpk | DOESenior-level Full TimePasir Gudang, Johor, Malaysia7d ago
-
Data Engineer USD 132K-200KBigQuery | Cloud platform | DBT | Data Governance | Data LakeAutonomy | Growth opportunities | Impact | Ownership | TrustMid-level Full TimeMalaysia8d ago
-
GenAI Software Solutions Engineer USD 105K-194KAgent Orchestration | Autogen | C# | C++ | ChromaHybrid work model | On site and off site flexibilityMid-level Full TimeMYS - Penang, Malaysia8d ago
-
Graduate Talent (GenAI Software Solutions Engineer) USD 80K-136KAPIs | Autogen | C# | C++ | ChromaHybrid work modelEntry-level Full TimeMYS - Penang, Malaysia8d ago
-
Graduate Talent (GenAI Software Solutions Engineer) USD 80K-134KAPI Integration | Agent tooling | Autogen | C++ | ChromaHybrid work modelEntry-level Full TimeMYS - Penang, Malaysia8d ago
-
GenAI Software Solutions Engineer USD 105K-194KAgent Orchestration | Autogen | C# | C++ | ChromaHybrid work modelMid-level Full TimeMYS - Penang, Malaysia8d ago
-
Automation Analyst (AI) (English & Japanese Bilingual) USD 115K-183KAI Governance | AI Security | API Integration | AWS | AzureBilingual support | Hybrid workSenior-level Full TimeCyberjaya, Malaysia8d ago
-
Power ML Engineer USD 135K-200KAPI performance | API performance optimization | AWS | Agile | AirflowSenior-level Full TimeMalaysia9d ago