Senior Data Engineer
Tasks
- Build and maintain Docker images
- Configure and manage Azure cloud services
- Deploy and operate workloads on Kubernetes
- Design cloud-native data platforms
- Ensure compliance with enterprise change and release processes
- Ensure secure platform access
- Implement Azure CI/CD pipelines
- Implement and manage Nginx and Ingress controllers
- Implement metadata query and governance workflows
- Manage and automate infrastructure using Linux
- Monitor platforms with Prometheus and Grafana
- Provide production support and troubleshooting
- Support and optimize Apache Spark and Apache Iceberg
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Ranger | Apache Spark | Azure Blob | Azure Blob Storage | Azure DevOps | Azure Kubernetes | Azure Kubernetes Service | Blob Storage | CI/CD | Datahub | Docker | Enterprise governance | Firewall | Grafana | HashiCorp Vault | Ingress Controller | Kubernetes | Kubernetes Service | Linux | Nginx | OAuth | Prometheus | Python | Shell | TLS/SSL | Trino | Virtual Machines | Virtual Network
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Data Analysis | Data Modeling | Data Pipelines | Data Transformation | Data cleaningEmployment pass not provided | Hybrid work | Relocation support not provided | Work visa not providedMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …1d ago
-
Senior-level Full TimePenang 15, Penang, Malaysia1d ago
-
Senior-level Full TimeBayan Lepas, Penang, Malaysia2d ago
-
Senior Machine Learning Engineer (Mobility) USD 155K-207KAgent systems | Agentic RAG | Algorithmic optimization | Apache Flink | Apache KafkaBirthday leave | Confidential Employee Assistance Programme | Flexwork arrangements | GrabFlex Benefits Package | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia2d ago
-
MY - AI Specialist USD 115K-160KAPI Authentication | Data integration | Langchain | Language Models | Large Language ModelsLife insurance | Team buildingMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Senior DevOps Engineer USD 150K-200KAWS | Bash | CI/CD | Datadog | Dependency ScanningBudget for certifications | Budget for conferences | High-trust environment | Hybrid work setupSenior-level Full TimePetaling Jaya2d ago
-
Senior-level Full TimeKuala Lumpur, Malaysia3d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Diverse inclusive workplace | Friendly laid-back atmosphere | Opportunity to make impactMid-level Full TimePenang, Malaysia6d ago
-
Fraud Data Engineer, Assistant Vice President USD 125K-188KAI | Agile | Confluence | Data Governance | Data ModelingConfidential counseling | Health advocates | Learning and development resources | Paid parental leave | Paid time offExecutive-level Full Time165 JALAN AMPANG KUALA LUMPUR, Malaysia7d ago
-
Senior Data Engineer(AWS and Azure) USD 124K-180KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web ServicesSenior-level Full TimeKuala lumpur, Selangor, Malaysia7d ago
-
AI Automation Engineer USD 110K-141KAI Agents | API Integration | LLM API | Multi-step reasoning | N8nSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …7d ago
-
Gen AI Engineer, DAI - GenAI - Development MY USD 103K-155KAI/ML | AI/ML Development | AWS | Azure | Data GovernanceMid-level Full TimeMalaysia8d ago
-
Internship - Software Development (Embedded) USD 48K-80KAlgorithms | C# | C++ | Data Structures | Embedded Firmware DevelopmentCross-cultural collaboration | Mentorship | Networking opportunities | Professional developmentEntry-level InternshipPetaling Jaya, Selangor, Malaysia9d ago
-
Lead Analyst, Process Transformation CAD 120K-170KApache Spark | Azure Data | Azure Data Factory | Data Factory | DatabricksSenior-level Full TimeMY-Kuala Lumpur-IT, Malaysia9d ago
-
Senior Manager, Data Engineering MYR 54K-66KBig Data | Big Data Tools | Cloud platform | Confluence | ContainerizationSenior-level Full TimeKuala Lumpur - RedQ, Malaysia9d ago
-
Senior Data Engineer USD 90K-120KBig Data | Big Data Technologies | Cloud Platforms | Data Governance | Data ModelingFlexible work arrangements | Global collaboration | Private medical coverage | Professional development opportunities | Recognition programsSenior-level Full TimeGeorgetown, Penang, Malaysia10d ago
-
Senior Data Engineer USD 90K-125KAWS | Airflow | Azure | Data Modeling | Data QualityFlexible hours | Health insurance | Professional development | Remote work | Volunteer daysSenior-level Full TimeGeorgetown, Penang, Malaysia10d ago
-
Data Engineer GBP 45K-60KBigQuery | Data Lake | Data Modeling | Data Warehouses | ETLAutonomy | Flat structure | Growth opportunities | Impact | OwnershipMid-level Full TimeMalaysia10d ago
-
Senior GenAI Software Solutions Engineer USD 190K-269KAI | Autogen | C++ | Chroma | ComplianceHybrid work | Medical benefitsSenior-level Full TimeMYS - Penang, Malaysia10d ago
-
Intern, Computer Science USD 62K-93KPython | Relational databases | SQL | StreamlitInclusive work environment | Remote work optionEntry-level InternshipBayan Lepas, Malaysia13d ago
-
GenAI Software Solutions Engineer USD 181K-266KAI | Autogen | C++ | Chroma | DistillationHybrid work | Professional developmentEntry-level Full TimeMYS - Penang, Malaysia13d ago
-
Data Analytics Specialist EUR 49K-65KAzure | Data Governance | Data Modeling | ETL | GitFlexible working | Global travel opportunities | Professional development training | Teamwork culture | Work-life balanceSenior-level Full TimeKuala Lumpur, MY, 5920013d ago
-
Senior Data Engineer USD 101K-188KAgile | Amazon S3 | Bitbucket | CI/CD | ConfluenceCareer development opportunities | Flexible work environment | Inclusive cultureSenior-level Full TimeKuala Lumpur, Malaysia14d ago
-
Analytics Engineer EUR 39K-43KBigQuery | CICD | DBT | Data Documentation | Data GovernanceCareer development | Casual dress | Flexible working | Performance bonusMid-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …16d ago
-
Bash | Data Processing | Docker | GCP | PythonAsynchronous culture | Competitive salary | Fast-growing environment | Flexible work approach | Impactful workMid-level Full TimeKuala Lumpur, Malaysia16d ago