Data Engineer and Analyst
Tasks
- Build ETL processes for ODS staging and data warehousing
- Conduct post implementation usage analysis
- Deploy and debug production data lake
- Design ETL pipelines
- Develop and implement data lake sources
- Identify data quality issues
- Implement stored procedures
- Ingest real-time and batch data
- Perform on the fly data analysis
- Perform root cause analysis
- Provide leadership for data projects
- Support users and operations
- Write SQL queries and optimize performance
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Anaconda | ClickHouse | Data Lake | Data Quality | Data Warehouse | ETL | Flink | Hive | Hudi | Informatica | Jupyter Notebook | Kafka | Linux | Python | Query Tuning | SQL | SSIS | Shell Scripting | Stored Procedures
Education
N/A
Roles
Related jobs
-
[FRESH GRAD ONLY] Data Analytics Engineering USD 90K-142KData Preprocessing | Machine Learning | Machine Learning Pipelines | Model Evaluation | Model TrainingEntry-level Full TimeBatu Kawan, Penang, Malaysia20h ago
-
Manager, People Advisory, Reporting and Analytics USD 82K-119KAI Change Management | Artificial Intelligence | Automation | Benefits Administration | Case managementMid-level Full TimeMY-Cyberjaya, Malaysia1d ago
-
Integrated Risk Analytics, Risk Analyst GBP 53K-65KBasel Capital Accord | Basel capital | Credit Risk | Data Sourcing | Microsoft ExcelCommunity initiatives | Equal opportunity | Flexible benefits | Professional development | Wellbeing supportEntry-level Full TimeMAL-Menara GE2, Malaysia1d ago
-
Analyst, Transformation Automation USD 140K-175KBias detection | Computer Vision | Data Loss Prevention | Data Privacy | Data labelingContinuous improvement | Training opportunitiesSenior-level Full TimeMY-Kuala Lumpur-IT, Malaysia1d ago
-
Applied AI Engineer AUD 68K-104KA/B | A/B Testing | API Integration | Anthropic | B testingFlexible collaboration | High ownership culture | Hybrid work arrangement | Learning and development budgetMid-level Full TimeMalaysia1d ago
-
Lead AI Engineer (AI Systems & Automation) PHP 200K-350KAlerting | Anthropic | Distributed Systems | Docker | KubernetesHigh ownership culture | Hybrid work arrangement | Learning and development budget | Modern engineering practicesSenior-level Full TimeMalaysia1d ago
-
Microsoft Fabric Data Engineer - Malaysia USD 117K-238KApache Spark | Azure Cognitive | Azure Cognitive Search | Azure Data | Azure Data FactoryMid-level Full Timekuala lumpur, Malaysia3d ago
-
Entry-level Full TimeKuala Lumpur, MY4d ago
-
Manufacturing Engineer – Data Science USD 85K-117KAmazon Web Services | Anomaly Detection | Azure | CI/CD | Cloud platformDevelopment curriculum | Mentorship | Structured onboardingEntry-level Full TimePasir Gudang, Malaysia4d ago
-
Senior Python AI Engineer USD 119K-209KArtificial Intelligence | Code review | Debugging | Machine Learning | Project ManagementFlexible work schedule | In-person collaborationSenior-level Full TimeMY209 - DXC Petaling Jaya (MY209), …4d ago
-
AI Solutions Engineer USD 115K-203KAPI Development | Backend Development | Cloud Computing | Containerization | Data PreprocessingSenior-level Full TimePetaling Jaya, Malaysia4d ago
-
Data Analyst, Private Markets (Graduate Hire) USD 50K-65KData Cleansing | Data Governance | Data Quality | Data Validation | GAAPContinuing education program | Continuous learning resources | Family-friendly perks | Financial wellness programs | Generous time offEntry-level Full TimeMY - KUALA LUMPUR NO 10 …4d ago
-
Data Analyst, Private Markets (Graduate Hire) USD 50K-65KData Cleansing | Data Quality | Data Validation | Fund accounting | GAAPContinuous learning | Family-friendly perks | Financial wellness programs | Flexible time off | Health care coverageEntry-level Full TimeMY - KUALA LUMPUR NO 10 …4d ago
-
Mid-level Full TimeCyberjaya, Selangor, Malaysia4d ago
-
Operation Analytic Engineer USD 113K-153KAnomaly Detection | Classification | Clustering | Cpk | DOESenior-level Full TimePasir Gudang, Johor, Malaysia4d ago
-
Senior Software Engineer, Customer Data Platform SGD 255K-334KAPI Development | AWS | Apache Flink | Apache Kafka | Apache SparkBirthday leave | Insurance Benefits Package | Medical insurance | Parental leave | Term life insuranceSenior-level Full TimePetaling Jaya, Malaysia4d ago
-
Data Analytics Engineer USD 82K-115KDAX | Data Analysis | Data Modeling | Data Quality | Data VisualizationMid-level Full TimePenang, Malaysia4d ago
-
Senior Associate Data Analyst MYR 120K-168KAccounting | Dashboard Development | Data Auditing | Data Integrity | Data MappingBenefits package | Birthday leave | Employee assistance programme | FlexWork | Medical insuranceMid-level Full TimePetaling Jaya, Malaysia5d ago
-
Senior Data Engineer, Metrics Platform SGD 272K-320KAPI | Apache Pinot | Automation | Cloud services | Data ModelingBirthday leave | Custom benefits package | Employee assistance programme | FlexWork | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia5d ago
-
Change Management | Data Governance | Data Integrity | Data Management | Data QualityHybrid work environmentSenior-level Full TimePetaling Jaya, Selangor, Malaysia6d ago
-
Senior-level Full TimePenang, Malaysia6d ago
-
Embedded Software Engineer USD 85K-115KAgile | C# | C++ | DMR | DebuggingCollaborative global team environment | Onsite work arrangementMid-level Full TimePenang, Malaysia6d ago
-
AI Engineer (Data) INR 1800K-3000KAccess patterns | Apache Airflow | Automated Quality | Automated Quality Assessment | Context ManagementMid-level Full TimeKuala Lumpur, Kuala Lumpur, Malaysia6d ago
-
Data Analyst USD 59K-68KAdvanced Analytics | Data Analysis | Data Quality | Data Visualization | KPIsEntry-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …6d ago
-
S&C GN - TS&T - Data & Analytics - Consultant USD 136K-237KData Modeling | Data Visualization | Machine Learning | Power BI | PythonExecutive-level Full TimeKuala Lumpur, Exchange 106, Malaysia7d ago