Senior Data Engineer
Tasks
- Build ETL/ELT workflows
- Deploy containerized applications
- Develop data ingestion scripts
- Develop data lake solutions
- Ensure data security compliance
- Implement data quality checks
- Implement real-time streaming pipelines
- Integrate data pipelines with DataHub and Ranger
- Migrate data pipelines
- Orchestrate workflows with Apache Airflow
- Orchestrate workloads on Kubernetes
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Iceberg | Apache Kafka | Azure Data | Azure Data Lake | Azure Data Lake Storage | Big Data | Data Lake Storage | Data Modeling | Data Warehousing | Datahub | Docker | Java | Kubernetes | Linux | Minio | Python | Ranger | Shell | Trino
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
BigQuery | CI/CD | CTE | CTEs | DBTAnnual performance bonus plan | Casual dress every day | Flexible working | Tailored career development planning | Work from home daysSenior-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …1d ago
-
MY - Technical Analyst Engineer USD 110K-165KAI | APIs | Business Intelligence | Excel | LLMLife insurance | Team buildingMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …1d ago
-
AI workflow | AI workflow design | API | Artificial Intelligence | CRMEntry-level Full TimeKuala Lumpur, Malaysia1d ago
-
ARM | C# | C++ | Embedded C | EthernetAnnual leave | Company insurance | Medical leaveSenior-level Full TimeBayan Lepas, Pulau Pinang, Malaysia1d ago
-
Data Engineer USD 95K-115KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure DatabricksEntry-level Full TimeKuala Lumpur, MY2d ago
-
Senior / Staff Embedded Software Engineer EUR 90K-90KARM | C Sharp | C plus plus | C# | EthernetAnnual leave | Company insurance | Medical leaveSenior-level Full TimeBayan Lepas, Pulau Pinang, Malaysia3d ago
-
Data Engineer USD 120K-162KAlibaba Cloud | Cloud Computing | Data Integrity | Data Lakes | Data ModelingSenior-level Full TimeKL - Headquarter, Malaysia4d ago
-
Data Engineer AUD 104K-106KAPI Development | Agile | Azure | Data Modeling | Data PipelinesAccess to global inclusion networks | Career development and learning support | Collaboration with global teams | Regional and team-specific benefits | Wellness support for you and your familyMid-level Full TimeMY002 - MIN - Batu Caves …4d ago
-
Senior-level Full TimeKuala Lumpur4d ago
-
Mid-level Full TimeBatu Kawan, MY5d ago
-
Data Engineer USD 120K-150KData Monitoring | Data Pipelines | Data Quality | Data Warehouse | PythonMid-level Full TimeKuala Lumpur, Malaysia7d ago
-
AWS Data | AWS Data Pipeline | AWS Glue | Amazon Athena | Amazon EMRSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …7d ago
-
Cloud Specialist (Data Analytics) - Malaysia USD 123K-176KAnthos | BigQuery | Cloud platform | Dashboards | Data IngestionMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …7d ago
-
Senior-level Full TimeKuala Lumpur, Federal Territory of Kuala …7d ago
-
Azure | Azure Data | Azure Data Factory | Azure Synapse | CI/CDSenior-level Full TimeSelangor, Malaysia7d ago
-
Artificial Intelligence | CI/CD | Cloud Computing | Computer Vision | Data EngineeringSenior-level Full TimeBayan Lepas, Penang, Malaysia7d ago
-
Mid-level Full TimeKuala Lumpur, Federal Territory of Kuala …7d ago
-
Entry-level Full TimeKuala Lumpur, Federal Territory of Kuala …7d ago
-
Access Control | Artificial Intelligence | Computer Vision | Data Governance | Data ModelingExecutive-level Full TimeShah Alam, Selangor, Malaysia7d ago
-
Senior Data Engineer USD 131K-180KApache Iceberg | Azure | CI/CD | Control-M | Data LakeCareer development | Flexible work/life support | Health and well-being benefits | Inclusive teamSenior-level Full TimeWilayah Persekutuan Kuala Lumpur, Malaysia8d ago
-
Platform Software Enabling and Optimization USD 126K-211KC# | C++ | Computer Architecture | Firmware | PythonHybrid work modelMid-level Full TimeMYS - Penang, Malaysia8d ago
-
Data Scientist Specialist USD 140K-200KBatch Processing | Computer Vision | Data Analysis | Data Transformation | Data VisualizationCollaborative team | Inclusive culture | Performance-based rewardsSenior-level Full TimeMenara Maxis, Malaysia8d ago
-
Data Analysis | Data Modeling | Data Pipelines | Data Transformation | Data cleaningEmployment pass not provided | Hybrid work | Relocation support not provided | Work visa not providedMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …10d ago
-
Senior-level Full TimePenang 15, Penang, Malaysia10d ago
-
Senior Data Engineer USD 103K-132KApache Iceberg | Apache Ranger | Apache Spark | Azure Blob | Azure Blob StorageSenior-level Full TimeKuala Lumpur, MY10d ago