Big Data Development Engineer
Tasks
- Build and maintain algorithm machine learning platform
- Build and maintain data governance platform
- Build and maintain data pipeline services
- Design big data platform architecture
- Design distributed systems
- Develop big data platform performance optimization
- Develop scalable data infrastructure
- Implement messaging and streaming solutions
- Improve data driven business growth initiatives
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Kafka | Apache Spark | Apache Zookeeper | Caching | Data Governance | Data Pipelines | Design Patterns | Distributed Systems | High Availability | JVM Internals | Java | Microservices | MyBatis | Redis | Scalable Architecture | Spring | Spring MVC
Education
Regions
Countries
States
Related jobs
-
Senior-level Full TimePJC-PJ City, Malaysia1d ago
-
Data Scientist (Analytics) USD 134K-187KA/B | A/B Testing | B testing | Data Modeling | Data PipelinesBirthday leave | FlexWork | Medical insurance | Parental leave | Term life insuranceSenior-level Full TimePetaling Jaya, Malaysia2d ago
-
Senior Software Engineer [Fullstack] - Contract GBP 32K-35KAWS | Angular | Automated testing | CI/CD | CucumberHybrid work model | Mentorship opportunities | Technical documentation supportEntry-level Contract Full TimeCyberjaya, Selangor, Malaysia2d ago
-
Data Engineer MYR 54K-54KAWS | Amazon EMR | Apache Spark | Data Modeling | Data PipelinesCasual dress | Conferences and courses | Hackathons and trivia events | Work from anywhereMid-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, … R2d ago
-
Associate Director, Data & AI Architect USD 107K-159KAI Foundry | AI SDLC | Access Control | Agentic AI | Apache AirflowMid-level Full TimePSA | Kuala Lumpur - Menara …2d ago
-
Data AI Engineer USD 124K-216KAgent Frameworks | Azure OpenAI | Azure OpenAI Service | Chat Completions | Data PipelinesHybrid work arrangementMid-level Full TimeKuala Lumpur, Malaysia2d ago
-
Consultant - Data Engineer USD 132K-180KAWS | Azure Data | Azure Data Factory | Azure Synapse | CI/CDClient-facing experience | Collaborative team | Professional growthSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …3d ago
-
Software Development Engineer USD 115K-195KAPI Development | AWS | Agile | Artificial Intelligence | Automated testingDiversity and inclusion | Hybrid working | Professional growthSenior-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia8d ago
-
Associate AI Solutions Engineer USD 88K-152KAPI Development | Agile | C# | C++ | CI/CDHybrid work environmentMid-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia8d ago
-
Senior Software Engineer – Enterprise AI Solutions USD 115K-207KAPIs | AWS | Agile | Algorithms | Artificial IntelligenceHybrid work environmentSenior-level Full TimeMYS, Petaling Jaya (NDMY), Malaysia9d ago
-
Senior Executive, Data Engineer USD 119K-160KArtificial Intelligence | Cloud Data | Cloud Data Platforms | Data Lake | Data MartSenior-level Full TimeSD Guthrie Tower, Malaysia10d ago
-
Senior Developer, Machine Learning Operations USD 149K-200KAPI Integration | Agentic AI | Amazon Web Services | Artifactory | BashSenior-level Full TimeThe Gardens North Tower, Malaysia10d ago
-
Mid-level Full TimeKuala Lumpur, MY11d ago
-
Senior Data Engineer CAD 142K-190KA/B | A/B Testing | Apache Airflow | B testing | Cloud DataHealth insurance | Hybrid work flexibility | Learning budget | Performance bonusesSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …12d ago
-
Digital Solution Engineer USD 119K-261KAWS | Amazon Redshift | Azure SQL | Big Data | Cloud DataFlexible workSenior-level Full TimeMalaysia, Federal Territory of Kuala Lumpur, …12d ago
-
Senior Data Engineer CAD 142K-190KA/B | A/B Testing | Apache Airflow | B testing | Data GovernanceHealth insurance | Hybrid work flexibility | Learning budget | Performance bonusesSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …12d ago
-
Data Analysis | Data Modeling | Data Pipelines | Data Transformation | PythonCareer development | Hybrid workMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …13d ago
-
Automation | Autosys | Batch Processing | Cause analysis | Data PipelinesMid-level Full TimeMY-Kuala Lumpur-IT, Malaysia15d ago
-
Autosys | Batch scheduling | Cause analysis | Data Pipelines | Data QualityMid-level Full TimeMY-Kuala Lumpur-IT, Malaysia15d ago
-
Data Engineer USD 135K-166KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeKuala Lumpur17d ago
-
AI Engineer (GenAI / RAG / LangGraph / Python) USD 84K-150KAI Agents | Anthropic Claude | Azure OpenAI | CI/CD | ChromaSenior-level Contract Full TimeKuala Lumpur, Federal Territory of Kuala …19d ago
-
Senior Data Engineer USD 99K-187KAccess Controls | Automated testing | CI/CD | Cause analysis | Code reviewSenior-level Full TimeKuala Lumpur, MY19d ago
-
Engineer, Business Analytics Data USD 101K-136KCRM | Data Factory | Data Governance | Data Modeling | Data MonitoringCanteen | Corporate pension plans | Employee discounts | Equity diversity and inclusion | Flexible working hoursSenior-level Full TimePerai/Penang, 07, MY19d ago
-
Data Modeling | Data Pipelines | Data Quality | Database normalization | GitBonus | Hybrid work schedule | Medical benefits | Permanent role | Travel allowanceSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …23d ago
-
AVP, Enterprise AI Solutions Specialist (Azure &M365) USD 130K-240K.NET | AI Services | AI Studio | Access Control | Active DirectoryCareer advancement opportunitiesExecutive-level Full TimeAll Asia Broadcast Centre, Malaysia24d ago