Lead Data Engineer
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, Malaysia
USD 171K-214K (estimate) Senior-level Full Time
Tasks
- Architect cloud data platform
- Build dashboards and reporting layers
- Build streaming data pipelines
- Create CI CD deployments
- Design data warehouse schemas and dimensional models
- Design real time replication pipelines
- Develop ETL and ELT pipelines
- Enable natural language querying and LLM reporting
- Implement Change Data Capture
- Implement data quality validation
- Lead and mentor data engineering team
- Migrate OLAP workloads to cloud warehouses
- Monitor and troubleshoot data pipelines
- Optimize data pipelines for performance and cost
- Orchestrate data workflows
- Perform root cause analysis
- Prepare governed datasets for machine learning
- Run incident response and triage
Perks/Benefits
Skills/Tech-stack
AWS | AWS Step Functions | Airflow | Amazon Redshift | CDC | CI/CD | Cause analysis | Change Data Capture | CloudWatch | Data Capture | Data Modeling | Data Warehousing | Data replication | Datadog | Dimensional Modeling | Docker | ELT | ETL | GitHub Actions | Google Cloud | Grafana | LLM APIs | MCP | Metabase | Model Context Protocol | MySQL | OLAP | PostgreSQL | Power BI | Prompt engineering | Python | Real Time | Real-time Data | Real-time data replication | Root Cause Analysis | Root cause | SQL | Snowflake | Step Functions | Streaming | Tableau | Terraform
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Manager | Engineer | Engineering Manager | Lead | Lead Data | Lead Data Engineer | Manager
Regions
Countries
States
Related jobs
-
Software Engineer I EUR 38K-64KAWS | Agile | Automated testing | Azure | CI/CDAnnual leave | Equal opportunity employer | Family care leave | Hybrid working | Onsite work 2 days per weekMid-level Full TimeCyberjaya, Selangor, Malaysia R1d ago
-
Support Manager - Data Lake SRE USD 140K-210KApache Airflow | Apache Spark | Cloud | Control-M | HBaseAnnual leave | Development courses | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeBukit Jalil KL, MY1d ago
-
Cloud Computing | Data Engineering | Data Governance | Data Lakes | Data PipelinesFlexible working hours | Inclusive workplace | Work-life balance supportSenior-level Full TimeKuala Lumpur, Asia, Malaysia1d ago
-
Senior Data Engineer USD 108K-170KAWS Athena | AWS Glue | AWS Lambda | AWS S3 | AlertingHealth insurance | Hybrid work | Learning opportunities | Medical care packageSenior-level Full TimeMY: Kuala Lumpur - Bangsar South …1d ago
-
Senior Data Engineer USD 108K-170KAWS Athena | AWS Glue | AWS Lambda | AWS S3 | Amazon RedshiftHybrid office remote working | Learning opportunities | Life and health insurance | Medical care package | No travel expectedSenior-level Full TimeMY: Kuala Lumpur - Bangsar South …1d ago
-
AI/ML Expert & Technical Lead INR 2750K-5000KAWS | Azure | CI/CD | Cloud platform | DockerRemote workSenior-level Full TimeKuala Lumpur, Malaysia R1d ago
-
Machine Learning Engineer EUR 51K-60KBayesian statistics | Causal Inference | Docker | Econometric Modeling | Experimental DesignEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeKuala Lumpur, Malaysia1d ago
-
Junior AI Developer [12 Months Contract] GBP 35K-35K.NET | API Integration | API Testing | AWS | AngularEntry-level Full TimeMid Valley City, KUALA LUMPUR, Malaysia2d ago
-
Senior-level Full TimeSelangor, Malaysia2d ago
-
Data Analyst Lead (12-months) M/F USD 125K-173KCorrelation Analysis | Dashboard Development | Data Cleansing | Data Governance | Data ModelingSenior-level Contract TemporaryAsia, Malaysia R2d ago
-
Excel | GaussDB | SAS | SQL | SQL ServerEntry-level Full TimeHLT-Hong Leong Tower, Malaysia2d ago
-
Artificial Intelligence | Commercial due diligence | Data extraction | Due Diligence | ExcelSenior-level Full TimeHLT-Hong Leong Tower, Malaysia2d ago
-
DevOps / Operation Engineer (English and Mandarin) MYR 1048K-1072KAPM | Argo Workflows | ArgoCD | Automation | Backup & RecoveryMedical insurance | Performance allowanceEntry-level Full TimeKuala Lumpur, WP, Malaysia2d ago
-
Machine Learning Engineer - Kuala Lumpur USD 143K-194KAWS | Embeddings | Evaluation Frameworks | Guardrails | LLM APIsCollaborative culture | Flexible, fast-paced environment | Mentorship opportunitiesMid-level Full TimeKuala Lumpur, Malaysia2d ago
-
AWS | Data Lake | Data Pipelines | Data Warehouse | Google AnalyticsRemote work option | Training and supportMid-level Full TimeKuala Lumpur, Federal Territory of Kuala … R3d ago
-
Manager, AI & Automation USD 81K-120KData Architecture | Data Governance | Data Lineage | Data Modeling | Data PipelinesMid-level Full TimeKuala Lumpur, MY3d ago
-
Manager, Data & AI USD 82K-120KData Architecture | Data Engineering | Data Governance | Data Lineage | Data ModelingMid-level Full TimeKuala Lumpur, MY3d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Friendly work environment | Remote distributed settingMid-level Full TimeKuala Lumpur, Malaysia4d ago
-
Senior-level Full TimePJC-PJ City, Malaysia5d ago
-
BCP Management | Cause analysis | Content Management | Content Management System | Content ModerationSenior-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …5d ago
-
Data Scientist (Analytics) USD 134K-187KA/B | A/B Testing | B testing | Data Modeling | Data PipelinesBirthday leave | FlexWork | Medical insurance | Parental leave | Term life insuranceSenior-level Full TimePetaling Jaya, Malaysia6d ago
-
Senior Software Engineer [Fullstack] - Contract GBP 32K-35KAWS | Angular | Automated testing | CI/CD | CucumberHybrid work model | Mentorship opportunities | Technical documentation supportEntry-level Contract Full TimeCyberjaya, Selangor, Malaysia6d ago
-
Data Engineer MYR 54K-54KAWS | Amazon EMR | Apache Spark | Data Modeling | Data PipelinesCasual dress | Conferences and courses | Hackathons and trivia events | Work from anywhereMid-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, … R6d ago
-
Associate Director, Data & AI Architect USD 107K-159KAI Foundry | AI SDLC | Access Control | Agentic AI | Apache AirflowMid-level Full TimePSA | Kuala Lumpur - Menara …6d ago
-
Data AI Engineer USD 124K-216KAgent Frameworks | Azure OpenAI | Azure OpenAI Service | Chat Completions | Data PipelinesHybrid work arrangementMid-level Full TimeKuala Lumpur, Malaysia6d ago