Azure Databricks Engineer
Tasks
- Build and optimize big data platforms
- Design and manage Spark cluster configurations
- Develop batch and streaming data pipelines
- Ensure data governance, security, and lineage
- Implement data quality frameworks
- Manage data storage and modeling
- Support cloud administration cost monitoring backups and automation
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | Apache Deequ | Apache Hadoop | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure SQL | DBT | Data Factory | Data Governance | Data Lake Storage | Databricks | Great Expectations | PII | SQL | Schema evolution | Snowflake | Streaming Data
Education
N/A
Regions
Countries
States
Related jobs
-
Mid-level Full TimeKuala Lumpur13h ago
-
Activiti | BPMN 2.0 | BigQuery | Cloud platform | CollibraMid-level Full TimeKuala Lumpur, MY14h ago
-
Director, AI & Chatbot USD 233K-344KAPIs | Conversational AI | Data Annotation | Data Governance | Entity recognitionEmployee recognition program | Growth and promotion opportunities | Insurance coverage | Meal allowance | Monthly team buildingExecutive-level Full TimeKuala Lumpur, Malaysia1d ago
-
Senior Data Engineer PLN 206K-328KAWS | Agile | Airflow | Alerting | Apache SparkCareer development planning | Casual dress | Conferences | Courses | Flexible workingSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Data Engineer CAD 120K-145KAWS | Amazon ECR | Amazon EKS | Azure | CI/CDDevelopment opportunities | Equal opportunity | Reward and recognition | Volunteering | WellnessSenior-level Full TimeCyberjaya, Selangor, Malaysia2d ago
-
Data Engineer CAD 95K-122KAWS | Airflow | Apache Spark | CI/CD | Code reviewCasual dress | Flexible working | Tailored career development planning | Work from homeMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Azure Databricks USD 172K-241KAPI Integration | Access Control | Access Control Lists | Apache Deequ | Apache SparkMid-level Full TimeKuala Lumpur, MY2d ago
-
Senior Data Engineer USD 161K-216KAPI Integration | Airflow DAGs | Airflow operators | Airflow sensors | Apache AirflowSenior-level Full TimePetaling Jaya (First Avenue), Malaysia2d ago
-
Hiring AI / ML Engineer for Leading Client in Malaysia, KL INR 2000K-4800KAWS | Azure | Chatbots | Cloud platform | Data EngineeringEnterprise scale AI initiatives | Hybrid work | Innovation-driven environment | Mentorship and collaboration | Next generation AI projectsSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Hiring: Data Engineer for Leading Client in Malaysia, KL INR 1500K-2000KAzure Data | Azure Data Factory | Azure Databricks | Azure Key Vault | Azure SynapseMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Senior-level Full TimeKuala Lumpur, MY2d ago
-
AWS | Automation | Capacity Planning | Clustering | ComplianceHybrid workSenior-level Full TimeKuala Lumpur, Malaysia3d ago
-
Senior-level Full TimeBatu Kawan, Penang, Malaysia3d ago
-
T&T Senior Consultant - Artificial Intelligence & Data (Google Cloud Data Engineer) - SG USD 118K-179KAnalytics | BigQuery | Cloud platform | Data Cleansing | Data GovernanceMid-level Full TimeKuala Lumpur, MY3d ago
-
API Integration | Automation Anywhere | Blue Prism | C# | JavaScriptDental benefits | Free snacks | Growth opportunities | Health benefits | Life insuranceMid-level ContractKuala Lumpur, Federal Territory of Kuala …3d ago
-
Senior Machine Learning Engineer USD 157K-200KApache Spark | CI/CD | Causal Inference | Deep learning | ETLBirthday leave | Flexwork arrangements | GrabFlex Benefits Package | Life Assistance Programme | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia3d ago
-
Data Engineer USD 118K-165KBigQuery | Cloud platform | DBT | Data Governance | Data LakesAutonomy | Growth opportunities | TrustMid-level Full TimeMalaysia5d ago
-
Senior-level Full TimeKuala Lumpur6d ago
-
Software Developer/ Software Programmer(ETL) USD 110K-155KApache NiFi | Data Governance | Data Warehouse | ETL | Metadata ManagementSenior-level Full TimeKuala Lumpur6d ago
-
Entry-level Full TimeKuala Lumpur - RedQ, Malaysia6d ago
-
Senior Machine Learning Engineer USD 154K-200KApache Spark | Causal Inference | Data pipeline | Deep learning | ETLBirthday leave | Employee assistance programme | FlexWork | Flexible benefits plan | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia7d ago
-
Executive, Group Corporate Assurance (Data Analytics) USD 155K-245KCloud Computing | Data Analysis | Data Mapping | Data Visualization | Data cleaningExecutive-level Full TimeMalaysia | Selangor | Menara Sime …7d ago
-
None Full TimePenang 15, Penang, Malaysia7d ago
-
Senior-level Full TimeCyberjaya, Selangor, Malaysia8d ago
-
Developer 2, Programming USD 105K-149KData Warehousing | Data integration | Database Indexing | Database Views | ETLEntry-level Full TimeGeorge Town, Penang, Malaysia9d ago