Data Engineer
Tasks
- Build fault tolerant batch pipelines
- Build fault tolerant streaming pipelines
- Deliver clean documented datasets
- Design data models
- Design data pipelines
- Enable self-service analytics
- Enforce data governance best practices
- Ensure data quality and reliability
- Implement monitoring, logging, and alerting
- Ingest data from APIs and databases
- Ingest data from event streams
- Maintain data lineage
- Manage access control and privacy
- Manage data lakes
- Manage data warehouses
Perks/Benefits
Skills/Tech-stack
Alerting | BigQuery | Cloud platform | DBT | Data Governance | Data Lakes | Data Modeling | Data Warehousing | ELT | ETL | Google Cloud | Google Cloud Platform | Kafka | Logging | Monitoring | PubSub | Python | SQL | Snowflake | TypeScript
Education
N/A
Roles
Related jobs
-
API | Azure Data | Azure Data Factory | BOM | DAXMid-level Full TimeIpoh, Perak, Malaysia7h ago
-
Senior Full Stack Engineering Lead-Brokerage Industry MYR 168K-183KC++ | CFD | CRM | Copy Trading | CySECEmployee-centric policies | Entertainment | Fast Paced Career Progression | Food and beverage | Learning opportunitiesSenior-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …9h ago
-
Data Quality Developer USD 99K-135KAzure | Data Architecture | Data Cleansing | Data Enrichment | Data GovernanceSenior-level Full TimeKuala Lumpur, MY12h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Startup-like cultureSenior-level Full TimeKuala Lumpur, Malaysia1d ago
-
Senior-level Full TimeBayan Lepas, MY, 119003d ago
-
Software Enabling and Optimization Engineer USD 100K-172KAI | C# | C++ | Code optimization | GoOn-site workEntry-level Full TimeMYS - Penang, Malaysia3d ago
-
Senior Software Engineer, Customer Data Platform USD 142K-235KAPI Development | AWS | Amazon DynamoDB | Apache Flink | Apache SparkBirthday leave | Employee assistance programme | FlexWork Benefits Package | Flexible work arrangements | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia4d ago
-
Lead Software Engineer, Customer Data Platform USD 140K-207KAPI Development | AWS | Amazon DynamoDB | Apache Flink | Apache HiveBirthday leave | Employee assistance programme | Flex work | Flexible benefits package | Life insuranceSenior-level Full TimePetaling Jaya, Malaysia4d ago
-
Mid-level Full TimeKuala Lumpur4d ago
-
Activiti | BPMN 2.0 | BigQuery | Cloud platform | CollibraMid-level Full TimeKuala Lumpur, MY4d ago
-
Lead Database Engineer USD 110K-177KAmazon Aurora | Amazon DynamoDB | Amazon RDS | Cloud Databases | Database securityMentorshipSenior-level Full TimePetaling Jaya (First Avenue), Malaysia4d ago
-
Director, AI & Chatbot USD 233K-344KAPIs | Conversational AI | Data Annotation | Data Governance | Entity recognitionEmployee recognition program | Growth and promotion opportunities | Insurance coverage | Meal allowance | Monthly team buildingExecutive-level Full TimeKuala Lumpur, Malaysia5d ago
-
AI Developer MYR 68K-113KAWS | Algorithms | Big Data | Databases | Google CloudAnnual health screening | Career development | Company mobile phone | Continuous training | Employee engagement activitiesMid-level Full TimeKelana Jaya, Selangor, Malaysia R5d ago
-
C# | Element analysis | Finite Element Analysis | Finite element | GrasshopperSenior-level Full TimeKuala Lumpur, Malaysia6d ago
-
Senior Data Engineer PLN 206K-328KAWS | Agile | Airflow | Alerting | Apache SparkCareer development planning | Casual dress | Conferences | Courses | Flexible workingSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …6d ago
-
Data Engineer CAD 120K-145KAWS | Amazon ECR | Amazon EKS | Azure | CI/CDDevelopment opportunities | Equal opportunity | Reward and recognition | Volunteering | WellnessSenior-level Full TimeCyberjaya, Selangor, Malaysia6d ago
-
Data Engineer CAD 95K-122KAWS | Airflow | Apache Spark | CI/CD | Code reviewCasual dress | Flexible working | Tailored career development planning | Work from homeMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …6d ago
-
Azure Databricks USD 172K-241KAPI Integration | Access Control | Access Control Lists | Apache Deequ | Apache SparkMid-level Full TimeKuala Lumpur, MY6d ago
-
Senior Data Engineer USD 161K-216KAPI Integration | Airflow DAGs | Airflow operators | Airflow sensors | Apache AirflowSenior-level Full TimePetaling Jaya (First Avenue), Malaysia6d ago
-
Hiring AI / ML Engineer for Leading Client in Malaysia, KL INR 2000K-4800KAWS | Azure | Chatbots | Cloud platform | Data EngineeringEnterprise scale AI initiatives | Hybrid work | Innovation-driven environment | Mentorship and collaboration | Next generation AI projectsSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …6d ago
-
Hiring: Data Engineer for Leading Client in Malaysia, KL INR 1500K-2000KAzure Data | Azure Data Factory | Azure Databricks | Azure Key Vault | Azure SynapseMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …6d ago
-
Senior-level Full TimeKuala Lumpur, MY6d ago
-
Azure Databricks Engineer USD 180K-248KADLS | Apache Deequ | Apache Hadoop | Apache Spark | Azure DataSenior-level Full TimeKuala Lumpur, MY6d ago
-
AWS | Automation | Capacity Planning | Clustering | ComplianceHybrid workSenior-level Full TimeKuala Lumpur, Malaysia6d ago
-
Senior-level Full TimeBatu Kawan, Penang, Malaysia7d ago