Principal Data Engineer
Tasks
- Build data quality controls and remediation workflows
- Build transformation and curated data models
- Collaborate with architects stewards BI and business stakeholders
- Create reusable engineering patterns and automation
- Design and implement data ingestion pipelines
- Develop data product and data contracts
- Drive production reliability and incident response
- Implement observability and monitoring for pipelines
- Lead RCA and preventative improvement actions
- Optimize SQL Python and pipeline performance
- Own technical delivery of data engineering initiatives
- Perform data validation anomaly detection reconciliation and schema drift checks
- Provide technical escalation and mentorship through reviews and guidance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS KMS | AWS Lambda | Access Control | Airbyte | Amazon S3 | Amazon Web Services | Anomaly Detection | Apache Airflow | Bronze Silver Gold | CI/CD | Cause analysis | CloudWatch | DAG | Data Contracts | Data Lineage | Data Quality | Data Validation | ELT | ETL | Fivetran | Medallion Architecture | Monitoring | Observability | Python | RBAC | Role-Based Access | Role-Based Access Control | Root Cause Analysis | Root cause | SQL | SageMaker | Schema drift | Snowflake | Stored Procedures | Streams & Tasks | User Defined Functions | Web Services
Education
N/A
Related jobs
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Career growth impact | Inclusive mission | Laid back environment | Remote-friendly teamMid-level Full TimePenang, Malaysia20h ago
-
Senior-level Full TimeMalaysia23h ago
-
Senior Executive, Data Engineer USD 119K-160KArtificial Intelligence | Cloud Data | Cloud Data Platforms | Data Lake | Data MartSenior-level Full TimeSD Guthrie Tower, Malaysia1d ago
-
Data Science Engagement Lead USD 124K-186KAI/ML | AWS | Agile | Artificial Intelligence | AzureFlexible working hours | Paid parental leave | Remote work optionSenior-level Full TimeShell Centre Kuala Lumpur, Malaysia1d ago
-
Senior Developer, Machine Learning Operations USD 149K-200KAPI Integration | Agentic AI | Amazon Web Services | Artifactory | BashSenior-level Full TimeThe Gardens North Tower, Malaysia1d ago
-
Yield Analytics Engineer USD 120K-194KData analytics | JavaScript | Machine Learning | Perl | PythonOnsite workMid-level Full TimeMYS - Penang, Malaysia1d ago
-
Engineer, Manufacturing Engineering USD 81K-108KData Modeling | Generative AI | Machine Learning | Python | SQLDevelopment curriculum | Mentorship | Structured onboardingEntry-level Full TimeBayan Lepas, Penang, Malaysia1d ago
-
Head of Analytics & Market Intelligence USD 178K-240KAnalytics Strategy | Dashboard Development | Data Exploration | Data Governance | Data ManagementCompany car or car allowance | Employee assistance program | Flexible working | Health care | Learning and developmentExecutive-level Full TimeMalaysia - Kuala Lumpur2d ago
-
Senior-level Full TimeKuala Lumpur, Malaysia2d ago
-
Mid-level Full TimeKuala Lumpur, MY2d ago
-
Head of Machine Learning Research & Intelligence GBP 180K-250KAgent systems | Deep learning | GPU Computing | Guardrails | JAXExecutive-level Full TimeEurope2d ago
-
Machine Learning Engineer UAH 1377K-1549KData Preparation | GPU Computing | JAX | Machine Learning | Machine Learning EngineeringSenior-level Full TimeEurope2d ago
-
Senior Data Engineer CAD 142K-190KA/B | A/B Testing | Apache Airflow | B testing | Cloud DataHealth insurance | Hybrid work flexibility | Learning budget | Performance bonusesSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Digital Solution Engineer USD 119K-261KAWS | Amazon Redshift | Azure SQL | Big Data | Cloud DataFlexible workSenior-level Full TimeMalaysia, Federal Territory of Kuala Lumpur, …2d ago
-
Senior Data Engineer CAD 142K-190KA/B | A/B Testing | Apache Airflow | B testing | Data GovernanceHealth insurance | Hybrid work flexibility | Learning budget | Performance bonusesSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …2d ago
-
Lead, Data Scientist EUR 46K-56KData Analysis | Data Mining | Data Science | Data Visualization | EcommerceEmployee Assistance Program (EAP) | Flexible working environment | Hybrid work | LinkedIn Learning | Volunteer time offSenior-level Full TimePetaling Jaya, 10, Malaysia2d ago
-
Senior-level Full TimeKuala Lumpur, Exchange 106, Malaysia3d ago
-
Data Analysis | Data Modeling | Data Pipelines | Data Transformation | PythonCareer development | Hybrid workMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …3d ago
-
Senior Data Analytics Engineer USD 132K-203KAdvanced Process Control | Data Analysis | Exploratory Data Analysis | Fault detection | Industrial IoTSenior-level Full TimeBatu Kawan, Penang, Malaysia5d ago
-
Automation | Autosys | Batch Processing | Cause analysis | Data PipelinesMid-level Full TimeMY-Kuala Lumpur-IT, Malaysia6d ago
-
Autosys | Batch scheduling | Cause analysis | Data Pipelines | Data QualityMid-level Full TimeMY-Kuala Lumpur-IT, Malaysia6d ago
-
AWS | Azure | C# | C++ | CI/CDHybrid work scheduleSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …6d ago
-
C# | C++ | DHCP | Driver Development | Embedded LinuxFlexible home-office days | Hybrid work | Office in KL City | Office in KL SouthSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …6d ago
-
Senior-level Full TimePetaling Jaya (First Avenue), Malaysia7d ago
-
C# | C++ | DHCP | Docker | Embedded LinuxFlexible work location | Hybrid work schedule | Onsite office accessSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …7d ago