Lead Data Architect - AWS (Databricks / Lakehouse)
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
USD 139K-247K (estimate) Senior-level Full Time
Tasks
- Architect high performance data pipelines with PySpark and Databricks
- Build and scale data and analytics center of excellence
- Collaborate with business stakeholders on data needs
- Define enterprise data architecture on AWS
- Design data orchestration for pipelines
- Design real time and batch processing frameworks
- Design scalable secure cost efficient data platforms
- Drive adoption of reusable data engineering standards
- Drive delivery across multiple data programs
- Establish data governance, quality, and security frameworks
- Implement emerging technologies in AWS data ecosystem
- Lead and mentor data engineers BI developers and analysts
- Modernize data lake to lakehouse using Databricks and Delta Lake
- Optimize Spark workloads and query performance
- Own end to end data platform reliability and performance
Perks/Benefits
- Dependent visa support
- Employment visa sponsorship
- Flight ticket coverage
- Free accommodation
- Group insurance
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon IAM | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD | Data fabric | Data mesh | Data orchestration | Databricks | Delta Lake | DevOps | Git | HDFS | Hadoop | Hive | Kafka | PySpark | Python | SQL | Web Services
Education
N/A
Roles
Architect | Data Architect | Lead | Lead Data | Lead Data Architect
Regions
Countries
States
Related jobs
-
Senior-level Full TimeKuala Lumpur, MY1d ago
-
Senior-level Full TimeKuala Lumpur, MY1d ago
-
Data Architect CAD 120K-165KAWS | AWS Glue | AWS Lake Formation | AWS Lambda | Amazon AthenaInternational travel | Mentorship | Professional growth opportunitiesSenior-level Full TimeKuala Lumpur, Malaysia6d ago
-
AWS | Angular | Artificial Intelligence | Azure | Cloud platform100 percent remote work | Employment visa support not availableSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala … R6d ago
-
Data Analyst USD 120K-199KAutomation | Business Intelligence | Dashboarding | Data Governance | Data ModelingCompany-sponsored activities | Flexible work arrangement | Global job rotation program | Inclusive culture | Internal transferSenior-level Full TimeMenara Prudential, Kuala Lumpur7d ago
-
Technical Lead, Data Engineering USD 110K-172KAWS | Azure | Cloud Platforms | Cloud platform | Data PipelinesHybrid workingSenior-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia8d ago
-
AI Lead USD 155K-180KAI strategy | Agentic AI | Data Pipelines | Deep learning | Language ProcessingSenior-level Full TimeSoutheast Asia, Malaysia9d ago
-
Tencent Cloud- Big Data Migration Architect (Malaysia) USD 123K-254KBig Data | Business Continuity | Cloud Migration | Cluster performance | Cluster performance tuningSenior-level Full TimeMalaysia-Kuala Lumpur11d ago
-
Executive-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …12d ago
-
Business AI Architect USD 200K-340KAI Business Services | AI Core | AI-Hub | Analytics Cloud | Business servicesContinuous learning | Flexible working models | Health and wellness | Skill growthSenior-level Full TimeKuala Lumpur, MY, 5920014d ago
-
Software Engineer, AI Model Training - Team Lead USD 160K-220KAsana | C++ | Code review | Data Annotation | JavaDynamic inclusive work environment | Global presence | Innovative mindset | Professional growth and developmentSenior-level Full TimeKuala Lumpur, Malaysia19d ago
-
Data Governance - Collibra USD 129K-168KAzure | Azure Databricks | Azure Databricks Unity Catalog | Azure Purview | CollibraSenior-level Full TimeKuala Lumpur, MY27d ago
-
Team Leader EUR 44K-63KA/B | A/B Testing | AI Agents | B testing | BI reportingCareer development | Company car | Corporate doctor | Discount program | Education allowanceSenior-level Full TimeCyprus; Malaysia1mo ago
-
Lead, Growth (Strategy & Data Analytics) EUR 60K-62KData Modeling | Data Storytelling | Excel | Forecasting | SQLSenior-level Full TimeBangsar South, Malaysia1mo ago
-
API Integration | Application development | Automation | Azure | Data WarehouseContinuous learning | Educational assistance | Family benefits | Flexible time off | Health careSenior-level Full TimeMY - KUALA LUMPUR NO 10 …1mo ago
-
API Integration | Application development | Automation Techniques | Azure | Data WarehousingContinuous learning | Employee discounts | Family benefits | Flexible time off | Health careSenior-level Full TimeMY - KUALA LUMPUR NO 10 …1mo ago