Senior Data Engineer
Tasks
- Build and maintain Docker images
- Configure and manage Azure cloud services
- Deploy and operate workloads on Kubernetes
- Design cloud-native data platforms
- Ensure compliance with enterprise change and release processes
- Ensure secure platform access
- Implement Azure CI/CD pipelines
- Implement and manage Nginx and Ingress controllers
- Implement metadata query and governance workflows
- Manage and automate infrastructure using Linux
- Monitor platforms with Prometheus and Grafana
- Provide production support and troubleshooting
- Support and optimize Apache Spark and Apache Iceberg
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Ranger | Apache Spark | Azure Blob | Azure Blob Storage | Azure DevOps | Azure Kubernetes | Azure Kubernetes Service | Blob Storage | CI/CD | Datahub | Docker | Enterprise governance | Firewall | Grafana | HashiCorp Vault | Ingress Controller | Kubernetes | Kubernetes Service | Linux | Nginx | OAuth | Prometheus | Python | Shell | TLS/SSL | Trino | Virtual Machines | Virtual Network
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Intern, Transformation Automation USD 50K-58KAPI Integration | Agent systems | Artificial Intelligence | Automation | Machine LearningCareer growth | Learning opportunitiesEntry-level Full Time InternshipMY-Kuala Lumpur-IT, Malaysia1d ago
-
Intern, Transformation Automation USD 50K-58KAI Model Monitoring | AI model | API Integration | Agent systems | Language ProcessingCareer development | Learning opportunities | MentorshipEntry-level Full Time InternshipMY-Kuala Lumpur-IT, Malaysia1d ago
-
Intern, Transformation Automation USD 50K-58KAgent systems | Automation frameworks | Enterprise Integration | Machine Learning | Model OptimizationEntry-level Full Time InternshipMY-Kuala Lumpur-IT, Malaysia1d ago
-
AI Staff Software Engineer – AI Agent Development USD 139K-220KAPI Integration | Context handling | Decision Making | Evaluation | ExperimentationSenior-level Full TimeBayan Lepas, Penang, Malaysia1d ago
-
AI Senior Software Engineer – AI Agent Development USD 144K-212KAPI Integration | Decision Making | Evaluation | Language Models | Language ProcessingSenior-level Full TimeBayan Lepas, Penang, Malaysia1d ago
-
AI Senior Software Engineer – AI Agent Development USD 144K-212KAPI Integration | Context handling | Decision Making | Evaluation | GuardrailsSenior-level Full TimeBayan Lepas, Penang, Malaysia1d ago
-
AI Senior Software Engineer – AI Agent Development USD 144K-212KAPI Integration | Agent Orchestration | Context handling | Debugging | Decision MakingSenior-level Full TimeBayan Lepas, Penang, Malaysia1d ago
-
None Full TimePetaling Jaya, Selangor, Malaysia1d ago
-
Data Engineer USD 90K-120KApache Airflow | Apache Kafka | Azure Data | Azure Data Factory | Azure Data LakeAnnual leave | Car loan subsidy | Career development opportunities | Company insurance | Flexi-work hoursMid-level Full TimeBatu Kawan, Penang, Malaysia2d ago
-
Data Engineer (TecRMI) AED 144K-180KAWS | Amazon EC2 | BeautifulSoup | CSS | ETLOnsite work | Training and guidanceMid-level Full TimeKuala Lumpur, Malaysia2d ago
-
AI Lead USD 155K-180KAI strategy | Agentic AI | Data Pipelines | Deep learning | Language ProcessingSenior-level Full TimeSoutheast Asia, Malaysia2d ago
-
Data & AI Engineer USD 139K-196KAI Services | Access Control | Apache Spark | Azure AI | Azure AI ServicesSenior-level Full TimeKuala Lumpur, MY, Malaysia3d ago
-
Machine Learning Engineer - APAC USD 82K-171KA/B | A/B Testing | B testing | CI/CD | CalibrationFamily benefits | Flexible working arrangements | Learning and development resourcesMid-level Full TimeMalaysia-LN Kuala Lumpur3d ago
-
Machine Learning Engineer - APAC USD 82K-158KA/B | A/B Testing | B testing | CI/CD | CalibrationFamily benefits | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeMalaysia-LN Kuala Lumpur3d ago
-
Senior Software Engineer, Data (L3) MYR 168K-185KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | ClickHouseAnnual company offsite | Insurance coverage | Learning allowance | Meal allowance | Parking allowanceSenior-level Full TimeMalaysia5d ago
-
Data Engineer USD 91K-130K.NET | Apache Storm | Azure Data Factory | Bash | CassandraHybrid workingMid-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia6d ago
-
AML | Big Data | Data Modeling | Data Visualization | Deep learningExecutive-level Contract Full Time165 JALAN AMPANG KUALA LUMPUR, Malaysia6d ago
-
Senior Machine Learning Engineer TWD 400K-400KA/B | A/B Testing | AutoGPT | B testing | CI/CDBirthday leave | Confidential Employee Assistance Programme | FlexWork | Medical insurance | Parental leaveEntry-level Full TimePetaling Jaya, Malaysia6d ago
-
Senior Data Platform Engineer MYR 20K-22KAPI Development | AWS S3 | Amazon EKS | Amazon IAM | Apache AirflowBirthday leave | Confidential Employee Assistance Programme | FlexWork | GrabFlex Benefits Package | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia6d ago
-
Senior Specialist, Solution Architect EUR 51K-51K.NET | Analysis Services | Apache Cassandra | Apache Storm | AutomationHybrid workingSenior-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia7d ago
-
Mid-level Full TimeKuala Lumpur, MY7d ago
-
Embedded Software Engineer USD 101K-146KAgile | Bash | C# | C++ | Controller DesignOnsite work locationSenior-level Full TimePenang, Malaysia8d ago
-
C# | Element analysis | Finite Element Analysis | Finite element | GrasshopperEntry-level Full TimeKuala Lumpur, Malaysia8d ago
-
C# | Element analysis | Finite Element Analysis | Finite element | GrasshopperEntry-level Full TimeKuala Lumpur, Malaysia8d ago
-
APIs | Azure Data | Azure Data Factory | BOM | DAXMid-level Full TimeIpoh, Perak, Malaysia8d ago