Lead Data Engineer
USD 171K-214K (estimate) Senior-level Full Time
Tasks
- Architect cloud data platform
- Build dashboards and reporting layers
- Build streaming data pipelines
- Create CI CD deployments
- Design data warehouse schemas and dimensional models
- Design real time replication pipelines
- Develop ETL and ELT pipelines
- Enable natural language querying and LLM reporting
- Implement Change Data Capture
- Implement data quality validation
- Lead and mentor data engineering team
- Migrate OLAP workloads to cloud warehouses
- Monitor and troubleshoot data pipelines
- Optimize data pipelines for performance and cost
- Orchestrate data workflows
- Perform root cause analysis
- Prepare governed datasets for machine learning
- Run incident response and triage
Perks/Benefits
Skills/Tech-stack
AWS | AWS Step Functions | Airflow | Amazon Redshift | CDC | CI/CD | Cause analysis | Change Data Capture | CloudWatch | Data Capture | Data Modeling | Data Warehousing | Data replication | Datadog | Dimensional Modeling | Docker | ELT | ETL | GitHub Actions | Google Cloud | Grafana | LLM APIs | MCP | Metabase | Model Context Protocol | MySQL | OLAP | PostgreSQL | Power BI | Prompt engineering | Python | Real Time | Real-time Data | Real-time data replication | Root Cause Analysis | Root cause | SQL | Snowflake | Step Functions | Streaming | Tableau | Terraform
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Manager | Engineer | Engineering Manager | Lead | Lead Data | Lead Data Engineer | Manager
Regions
Countries
States
Related jobs
-
Data Science Engagement Lead USD 124K-186KAI/ML | AWS | Agile | Azure | CI/CDCompetitive Salary Increase | Flexible working hours | Inclusive workplace | Paid parental leave | Remote WorkingSenior-level Full TimeShell Centre Kuala Lumpur, Malaysia R1d ago
-
Specialist - AI Developer Phyton CAD 90K-130KC++ | Data Visualization | Deep learning | Java | Machine LearningAnnual leave | Medical and hospitalization coverage | Medical leaveMid-level Full TimeKuala Lumpur, WP, Malaysia1d ago
-
Service Quality Analytics & AI Automation Intern USD 40K-46KArtificial Intelligence | Data analytics | Generative AI | IT Service Management | IT serviceFree parking | Global job opportunities | Hybrid work | International team exposure | Modern officesEntry-level InternshipCyberjaya, Selangor, Malaysia R1d ago
-
Senior Data Engineer INR 1050K-3650KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Log AnalyticsSenior-level Full TimeCyberjaya, Selangor, Malaysia1d ago
-
Data Modeling | Data integration | Data pipeline | ETL | PythonHybrid work environmentSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Senior-level Full TimeMalaysia2d ago
-
Manager, Deposit Analytics & Campaign Insights USD 133K-175KAttrition Analysis | Behavioral analytics | CARDS | CASA | Campaign analyticsMid-level Full TimeMenara Affin, TRX, Malaysia2d ago
-
Artificial Intelligence & Machine Learning Engineer USD 81K-113KAPI Integration | C# | Cause analysis | Classification | Computer VisionEntry-level Full TimeBatu Kawan, Penang, Malaysia5d ago
-
Amazon Web Services | Apache Kafka | Apache NiFi | Apache Spark | Azure DevOpsFlexible working hoursSenior-level Full TimeKuala Lumpur, MY5d ago
-
Operations Analytics and Automation Engineer ZAR 660K-660KArtificial Intelligence | Automation | C# | C++ | Cause analysisComprehensive benefits | Continuous learning | Five-day work week | Flexible working arrangement | Overseas opportunitiesSenior-level Full TimeMalaysia5d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimePenang, Malaysia5d ago
-
100G Ethernet | 200G Ethernet | 400G Ethernet | AWS | AnsibleSenior-level Contract Full TimeMalaysia - Remote R5d ago
-
AI Solutions Engineer USD 141K-207KAPI Development | Anthropic | Automation Anywhere | Chatbots | DatabaseCertifications | Health insurance | Paid time off | Professional training | Soft skills developmentMid-level Full TimeMalaysia6d ago
-
Associate Director, Data Science USD 120K-177KAPIs | Agentic AI | Causal Inference | Chatbot | Cloud ComputingMid-level Full TimeMY-Kuala Lumpur-Menara AIA, Malaysia6d ago
-
Lead AI Integration Strategist (Cloud & Communications) USD 130K-155KAWS | Audio Processing | Azure | Cloud Architecture | Cloud platformSenior-level Full TimePenang, Malaysia6d ago
-
Senior Engineer Robotic System USD 146K-201KAMR | Access Points | Application Management | C# | Database ManagementFlexible work hours | On-call availability | TrainingSenior-level Full TimePenang7d ago
-
ATS | AWS EBS | AWS EC2 | AWS S3 | BIOSEntry-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …7d ago
-
Reporting & Analytics PM – Business Dashboards USD 118K-188KAPIs | Agile | Data Ingestion | Data Quality | Data TransformationMid-level Full TimePSA | Kuala Lumpur - Menara …9d ago
-
Senior Analytics Engineer USD 117K-176KApache Spark | Azure SQL | CSV | Databricks | Google BigQuerySenior-level Full TimeMY - Malaysia9d ago
-
Mid-level Full TimeKuala Lumpur, Exchange 106, Malaysia9d ago
-
Assistant Manager, AIOps Engineering INR 1200K-4000KAgentic AI | Amazon Web Services | Apache Spark | CI/CD | Cloud ComputingMid-level Full TimeMalaysia - KL Eco City9d ago
-
Analytics | Data Manipulation | Data Transformation | Data Visualization | Data cleaningFlexible schedule | Internal promotion opportunities | Remote work | Training supportMid-level Full TimeKuala Lumpur, Federal Territory of Kuala … R9d ago
-
Mid-level Full TimeMelaka11d ago
-
Big Data Development Engineer USD 156K-218KApache Doris | Apache Flink | Apache Kafka | Apache Spark | Business IntelligenceCareer advancement | Global collaboration | Internal events | Internal mobility | Study Growth FundEntry-level Full TimeKuala Lumpur, Malaysia12d ago
-
Intern USD 40K-50KApps Script | Data Modeling | Database normalization | Google Apps | Google Apps ScriptMentorship | Real-world project experienceEntry-level Full Time InternshipKuala Lumpur - RedQ, Malaysia12d ago