Principal Data Engineer
Tasks
- Build data quality controls and remediation workflows
- Build transformation and curated data models
- Collaborate with architects stewards BI and business stakeholders
- Create reusable engineering patterns and automation
- Design and implement data ingestion pipelines
- Develop data product and data contracts
- Drive production reliability and incident response
- Implement observability and monitoring for pipelines
- Lead RCA and preventative improvement actions
- Optimize SQL Python and pipeline performance
- Own technical delivery of data engineering initiatives
- Perform data validation anomaly detection reconciliation and schema drift checks
- Provide technical escalation and mentorship through reviews and guidance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS KMS | AWS Lambda | Access Control | Airbyte | Amazon S3 | Amazon Web Services | Anomaly Detection | Apache Airflow | Bronze Silver Gold | CI/CD | Cause analysis | CloudWatch | DAG | Data Contracts | Data Lineage | Data Quality | Data Validation | ELT | ETL | Fivetran | Medallion Architecture | Monitoring | Observability | Python | RBAC | Role-Based Access | Role-Based Access Control | Root Cause Analysis | Root cause | SQL | SageMaker | Schema drift | Snowflake | Stored Procedures | Streams & Tasks | User Defined Functions | Web Services
Education
N/A
Related jobs
-
Senior Data Engineer CAD 140K-185KAWS | Algorithms | Apache Airflow | Apache Spark | Auto ScalingBirthday leave | Employee assistance programme | FlexWork | GrabFlex | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia11h ago
-
Access Control | Backup and Recovery | Clustering | Database Backup | Database backup and recoveryMid-level Full TimeKuala Lumpur, Malaysia1d ago
-
Azure Data | Azure Data Factory | BaaN | Data Factory | Data ModelingMid-level Full TimeBayan Lepas, Penang, Malaysia1d ago
-
Data Engineer PLN 150K-276KAgile | Authentication | Azure | Azure Functions | DAXAnnual leave | Birthday leave | Career progression | Company pension | Employee assistance programMid-level Full TimeKuala Lumpur, Malaysia1d ago
-
Lead Software Engineer GBP 32K-35KAWS | AWS Lambda | Amazon ECS | Amazon EKS | Auto ScalingHybrid work | Remote work flexibility | Reward and recognition | Volunteering opportunities | Wellness programsEntry-level Full TimeCyberjaya, Selangor, Malaysia R1d ago
-
Software Engineer I GBP 32K-33KAWS | Angular | CI/CD | Git | JavaEmployee benefits | Hybrid work arrangementEntry-level Full TimeCyberjaya, Selangor, Malaysia1d ago
-
Advanced Analytics | Big Data | Data Management | Data Quality | Data pipelineEntry-level Full TimeLocation(s): Kuala Lumpur, Kuala Lumpur, Malaysia1d ago
-
Engineer, Data Analytics Engineering USD 119K-258KAWS | Azure | Data Engineering | Data Governance | Data QualityMid-level Full TimeBatu Kawan, Penang, Malaysia2d ago
-
Senior Data Governance Engineer USD 128K-162KAmazon Web Services | Automation | Azure | Business glossary | CI/CDSenior-level Full TimeKuala Lumpur, MY2d ago
-
Engineer, Data Analytics Engineering USD 119K-258KAWS | Azure | Big Data | Cloud Computing | Data pipelineMid-level Full TimeBatu Kawan, Penang, Malaysia2d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K8D | Artificial Intelligence | Automated testing | Cloud Computing | Data AnalysisFlexible work environment | Remote work optionSenior-level Full TimeShah Alam, Malaysia2d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K8D Problem Solving | Agile | Artificial Intelligence | Automated testing | Cloud ComputingEmployee resource groups | Flexible work environment | Remote work optionSenior-level Full TimeShah Alam, Malaysia2d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K5-why | 8D | Agile | Automated testing | Data GovernanceFlexible work environment | Remote work optionSenior-level Full TimeShah Alam, Malaysia2d ago
-
Data Analytics Quality Engineering Manager USD 162K-200K5 Whys | 8D methodology | Agile | Artificial Intelligence | Automated testingEmployee resource groups | Flexible work environment | Inclusive work environment | Remote work optionSenior-level Full TimeIpoh, Perak, Malaysia2d ago
-
Data Analytics Quality Engineering Manager USD 162K-200K5 Whys | 8D | Agile | Artificial Intelligence | Automated testingFlexible work environment | Remote work optionSenior-level Full TimeBayan Lepas, Penang, Malaysia2d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K5 Whys | 8D | Agile | Artificial Intelligence | Automated testingEmployee resource groups | Flexible work environment | Remote work option | Rotational weekend supportSenior-level Full TimeIpoh, Perak, Malaysia2d ago
-
Senior Data Analytics Quality Engineer USD 156K-190KAgile | Automated testing | Data Governance | Data Modeling | Data PipelinesCareer development opportunities | Employee resource groups | Flexible work environment | Remote work optionSenior-level Full TimeBayan Lepas, Penang, Malaysia2d ago
-
Senior Data Analytics Quality Engineer USD 156K-190K5 Whys | 8D | Agile | Data Governance | Data ModelingFlexible work environment | Remote work optionSenior-level Full TimeShah Alam, Malaysia2d ago
-
Lead AI Engineer PLN 314K-314KAPI Design | Agentic Workflows | Artificial Intelligence | Debugging | EvaluationSenior-level Full TimeMalaysia - Global Development Campus, Johor …2d ago
-
Customer Engineer (AIx Data Analytics-Enabled) USD 74K-102KAI | Anomaly Detection | Corrective Maintenance | Data Visualization | Data analyticsEmployee wellbeing programs | Supportive work culture | Training and developmentEntry-level Full TimeKulim,MYS, Malaysia2d ago
-
Senior Data Engineer PLN 206K-328KBig Data | Big-data frameworks | Cloud platform | Confluence | ContainerizationSenior-level Full TimeKuala Lumpur - RedQ, Malaysia2d ago
-
Senior Specialist AI Engineer Group Digital Transformation INR 4500K-7250KAPIs | Azure | Azure Machine Learning | CI/CD | ContainersSenior-level Full TimeKuala Lumpur, MY, MY2d ago
-
3D Modeling | Csharp | Element analysis | Finite Element Analysis | Finite elementEntry-level Full TimeKuala Lumpur, Malaysia3d ago
-
Data Engineer II USD 160K-215KBig Data | Cloud platform | Code review | Confluence | ContainerizationSenior-level Full TimeKuala Lumpur - RedQ, Malaysia3d ago
-
Lead Data Analyst, Translation Chinese USD 101K-160KAccounting | Excel | Financial statements | Generative AI | Key RatiosSenior-level Full TimeMY - PENANG 38 JALAN SULTAN …3d ago