Lead Data Architect - AWS (Databricks / Lakehouse)
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
USD 139K-247K (estimate) Senior-level Full Time
Tasks
- Architect high performance data pipelines with PySpark and Databricks
- Build and scale data and analytics center of excellence
- Collaborate with business stakeholders on data needs
- Define enterprise data architecture on AWS
- Design data orchestration for pipelines
- Design real time and batch processing frameworks
- Design scalable secure cost efficient data platforms
- Drive adoption of reusable data engineering standards
- Drive delivery across multiple data programs
- Establish data governance, quality, and security frameworks
- Implement emerging technologies in AWS data ecosystem
- Lead and mentor data engineers BI developers and analysts
- Modernize data lake to lakehouse using Databricks and Delta Lake
- Optimize Spark workloads and query performance
- Own end to end data platform reliability and performance
Perks/Benefits
- Dependent visa support
- Employment visa sponsorship
- Flight ticket coverage
- Free accommodation
- Group insurance
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon IAM | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD | Data fabric | Data mesh | Data orchestration | Databricks | Delta Lake | DevOps | Git | HDFS | Hadoop | Hive | Kafka | PySpark | Python | SQL | Web Services
Education
N/A
Roles
Architect | Data Architect | Lead | Lead Data | Lead Data Architect
Regions
Countries
States
Related jobs
-
Data Governance - Collibra USD 129K-168KAzure | Azure Databricks | Azure Databricks Unity Catalog | Azure Purview | CollibraSenior-level Full TimeKuala Lumpur, MY7d ago
-
Team Leader EUR 44K-63KA/B | A/B Testing | AI Agents | B testing | BI reportingCareer development | Company car | Corporate doctor | Discount program | Education allowanceSenior-level Full TimeCyprus; Malaysia13d ago
-
Lead, Growth (Strategy & Data Analytics) EUR 60K-62KData Modeling | Data Storytelling | Excel | Forecasting | SQLSenior-level Full TimeBangsar South, Malaysia27d ago
-
Business AI Architect INR 4120K-8239KAI Business Services | AI Core | APIs | Analytics Cloud | Best practicesFlexible work arrangements | Health and wellness programs | Inclusive cultureSenior-level Full TimeKuala Lumpur, MY, 5920027d ago
-
API Integration | Application development | Automation | Azure | Data WarehouseContinuous learning | Educational assistance | Family benefits | Flexible time off | Health careSenior-level Full TimeMY - KUALA LUMPUR NO 10 …29d ago
-
API Integration | Application development | Automation Techniques | Azure | Data WarehousingContinuous learning | Employee discounts | Family benefits | Flexible time off | Health careSenior-level Full TimeMY - KUALA LUMPUR NO 10 …29d ago