Lead Data Architect - AWS (Databricks / Lakehouse)
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
USD 139K-247K (estimate) Senior-level Full Time
Tasks
- Architect high performance data pipelines with PySpark and Databricks
- Build and scale data and analytics center of excellence
- Collaborate with business stakeholders on data needs
- Define enterprise data architecture on AWS
- Design data orchestration for pipelines
- Design real time and batch processing frameworks
- Design scalable secure cost efficient data platforms
- Drive adoption of reusable data engineering standards
- Drive delivery across multiple data programs
- Establish data governance, quality, and security frameworks
- Implement emerging technologies in AWS data ecosystem
- Lead and mentor data engineers BI developers and analysts
- Modernize data lake to lakehouse using Databricks and Delta Lake
- Optimize Spark workloads and query performance
- Own end to end data platform reliability and performance
Perks/Benefits
- Dependent visa support
- Employment visa sponsorship
- Flight ticket coverage
- Free accommodation
- Group insurance
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon IAM | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD | Data fabric | Data mesh | Data orchestration | Databricks | Delta Lake | DevOps | Git | HDFS | Hadoop | Hive | Kafka | PySpark | Python | SQL | Web Services
Education
N/A
Roles
Architect | Data Architect | Lead | Lead Data | Lead Data Architect
Regions
Countries
States
Related jobs
-
A/B | A/B Testing | Anomaly Detection | Apache Flink | Apache SparkBirthday leave | Confidential Assistance Programme | Flexwork arrangements | Medical insurance | Parental leaveSenior-level Full TimePetaling Jaya, Malaysia1d ago
-
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | Amazon EC2Senior-level Full TimeKuala Lumpur, Federal Territory of Kuala …6d ago
-
Data Science Engagement Lead USD 124K-186KAI for Responsible Use | Agile | Amazon Web Services | Artificial Intelligence | CI/CDFlexible working hours | Paid parental leave | Remote work possibilitySenior-level Full TimeCyberjaya-Wisma Shell, Malaysia6d ago
-
Software Engineer, Team Lead GBP 79K-109KAgile | CI/CD | Cloud Computing | Observability | Secure DevelopmentSenior-level Full TimeCyberjaya, Selangor, Malaysia14d ago
-
Data Quality Developer USD 99K-135KAzure | Data Architecture | Data Cleansing | Data Enrichment | Data GovernanceSenior-level Full TimeKuala Lumpur, MY16d ago
-
Senior Software Engineer, Customer Data Platform USD 142K-235KAPI Development | AWS | Amazon DynamoDB | Apache Flink | Apache SparkBirthday leave | Employee assistance programme | FlexWork Benefits Package | Flexible work arrangements | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia19d ago
-
Lead Software Engineer, Customer Data Platform USD 140K-207KAPI Development | AWS | Amazon DynamoDB | Apache Flink | Apache HiveBirthday leave | Employee assistance programme | Flex work | Flexible benefits package | Life insuranceSenior-level Full TimePetaling Jaya, Malaysia19d ago
-
Lead Database Engineer USD 110K-177KAmazon Aurora | Amazon DynamoDB | Amazon RDS | Cloud Databases | Database securityMentorshipSenior-level Full TimePetaling Jaya (First Avenue), Malaysia20d ago
-
Senior-level Full TimeKuala Lumpur, MY22d ago
-
Senior-level Full TimeKuala Lumpur, MY22d ago
-
Data Architect CAD 120K-165KAWS | AWS Glue | AWS Lake Formation | AWS Lambda | Amazon AthenaInternational travel | Mentorship | Professional growth opportunitiesSenior-level Full TimeKuala Lumpur, Malaysia26d ago
-
AWS | Angular | Artificial Intelligence | Azure | Cloud platform100 percent remote work | Employment visa support not availableSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala … R27d ago
-
Data Analyst USD 120K-199KAutomation | Business Intelligence | Dashboarding | Data Governance | Data ModelingCompany-sponsored activities | Flexible work arrangement | Global job rotation program | Inclusive culture | Internal transferSenior-level Full TimeMenara Prudential, Kuala Lumpur27d ago
-
Technical Lead, Data Engineering USD 110K-172KAWS | Azure | Cloud Platforms | Cloud platform | Data PipelinesHybrid workingSenior-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia29d ago
-
AI Lead USD 155K-180KAI strategy | Agentic AI | Data Pipelines | Deep learning | Language ProcessingSenior-level Full TimeSoutheast Asia, Malaysia30d ago
-
Tencent Cloud- Big Data Migration Architect (Malaysia) USD 123K-254KBig Data | Business Continuity | Cloud Migration | Cluster performance | Cluster performance tuningSenior-level Full TimeMalaysia-Kuala Lumpur1mo ago
-
Business AI Architect USD 200K-340KAI Business Services | AI Core | AI-Hub | Analytics Cloud | Business servicesContinuous learning | Flexible working models | Health and wellness | Skill growthSenior-level Full TimeKuala Lumpur, MY, 592001mo ago
-
Software Engineer, AI Model Training - Team Lead USD 160K-220KAsana | C++ | Code review | Data Annotation | JavaDynamic inclusive work environment | Global presence | Innovative mindset | Professional growth and developmentSenior-level Full TimeKuala Lumpur, Malaysia1mo ago
-
Data Governance - Collibra USD 129K-168KAzure | Azure Databricks | Azure Databricks Unity Catalog | Azure Purview | CollibraSenior-level Full TimeKuala Lumpur, MY1mo ago