Principal Data Engineer
Tasks
- Build data quality controls and remediation workflows
- Build transformation and curated data models
- Collaborate with architects stewards BI and business stakeholders
- Create reusable engineering patterns and automation
- Design and implement data ingestion pipelines
- Develop data product and data contracts
- Drive production reliability and incident response
- Implement observability and monitoring for pipelines
- Lead RCA and preventative improvement actions
- Optimize SQL Python and pipeline performance
- Own technical delivery of data engineering initiatives
- Perform data validation anomaly detection reconciliation and schema drift checks
- Provide technical escalation and mentorship through reviews and guidance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS KMS | AWS Lambda | Access Control | Airbyte | Amazon S3 | Amazon Web Services | Anomaly Detection | Apache Airflow | Bronze Silver Gold | CI/CD | Cause analysis | CloudWatch | DAG | Data Contracts | Data Lineage | Data Quality | Data Validation | ELT | ETL | Fivetran | Medallion Architecture | Monitoring | Observability | Python | RBAC | Role-Based Access | Role-Based Access Control | Root Cause Analysis | Root cause | SQL | SageMaker | Schema drift | Snowflake | Stored Procedures | Streams & Tasks | User Defined Functions | Web Services
Education
N/A
Related jobs
-
Senior Data Engineer – Snowflake Technology USD 165K-216KAgile | Amazon Web Services | Cloud platform | Coalesce | DBTSenior-level Full TimeKuala Lumpur, Malaysia19h ago
-
Engineer, Data Analytics Engineering (AI/ML) USD 70K-110KApache Spark | DVC | Detectron2 | Docker | GitEntry-level Full TimeBatu Kawan, Penang, Malaysia1d ago
-
Mid-level Full TimePetaling Jaya, MY1d ago
-
Mid-level Full TimePetaling Jaya, MY1d ago
-
Machine Learning Engineer - APAC USD 71K-126KA/B | A/B Testing | Agentic development | B testing | CI/CDBenefits for family | Flexible working arrangements | Learning and development resourcesMid-level Full TimeMalaysia-LN Kuala Lumpur1d ago
-
Data Science Engagement Lead USD 124K-186KAWS | Agile | Artificial Intelligence | Azure | CI/CDDiversity and inclusion | Flexible working hours | Growth opportunities | Paid parental leave | Paid time offSenior-level Full TimeCyberjaya-Wisma Shell, Malaysia1d ago
-
None Full TimePenang 15, Penang, Malaysia1d ago
-
Principal Data Platform Engineer INR 3000K-5000KAWS | AWS CDK | AWS CloudFormation | AWS KMS | AWS LambdaSenior-level Full TimePetaling Jaya, MY1d ago
-
Machine Learning Engineer - APAC USD 71K-130KA/B | A/B Testing | B testing | CI/CD | CalibrationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeMalaysia-LN Kuala Lumpur1d ago
-
Senior Machine Learning Engineer (ACE) USD 152K-234KA/B | A/B Testing | B testing | Data Analysis | Data MiningBirthday leave | FlexWork | Medical insurance | Parental leave | Term life insuranceSenior-level Full TimePetaling Jaya, Malaysia2d ago
-
Senior IT Pillar Specialist USD 130K-188KAPI Integration | CI/CD | Cloud deployment | Containerization | Data GovernanceSenior-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, …5d ago
-
Senior Informatica Consultant / Data Analyst Lead USD 114K-162KALDON | Bitbucket | Cause analysis | Change and Release | Change and Release ManagementSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …5d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Laid back environment | Portfolio and LinkedIn submission support | Remote friendly distributed workMid-level Full TimeKuala Lumpur, Malaysia6d ago
-
SAS Viya Production Support /SAS Application Support USD 85K-116KALDON | Bitbucket | Control-M | Jenkins | LinuxSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …6d ago
-
Senior Machine Learning / Data Engineer EUR 46K-62KArgo | BigQuery | Docker | GitLab CI | GrafanaEmployee Assistance Program (EAP) | Exciting work environment | Flexible working environment | Hybrid work | LinkedIn LearningSenior-level Full TimeKuala Lumpur, 14, Malaysia8d ago
-
Machine Learning Engineer (Fulfilment ETA) GBP 77K-92KApache Spark | Data pipeline | Deep learning | ETL | GitBirthday leave | FlexWork | GrabFlex Benefits Package | Insurance assistance programme | Medical insuranceEntry-level Full TimePetaling Jaya, Malaysia8d ago
-
API Development | Agent Orchestration | Agent systems | Batch Processing | BigQueryInclusive work environment | Internship | Learning opportunitiesEntry-level InternshipKuala Lumpur, MY8d ago
-
C# | Design optimization | Element analysis | Finite Element Analysis | Finite elementSenior-level Full TimeKuala Lumpur, Malaysia9d ago
-
Csharp | Element analysis | Finite Element Analysis | Finite element | GrasshopperEntry-level Full TimeKuala Lumpur, Malaysia9d ago
-
Senior AI Engineer USD 197K-291KAPI Gateway | Agent Development Kit ADK | Agent Orchestration | Apigee API | Apigee API GatewaySenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …9d ago
-
Data Engineer USD 100K-141KAWS EMR | Alerting | Amazon S3 | Amazon Web Services | Apache PrestoAnnual performance bonus plan | Career development planning | Flexible working | Work from anywhere for up to 4 weeks per year | Work from homeMid-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, … R12d ago
-
Mid-level Full TimePJC-PJ City, Malaysia13d ago
-
Senior Site Reliability Engineer (Data Platform) USD 144K-223KAWS CloudFormation | Amazon ECS | Amazon EMR | Amazon MSK | Amazon RedshiftSenior-level Full TimeKuala Lumpur Office, Malaysia13d ago
-
Site Reliability Engineer III (Data Platform) USD 144K-222KAWS CloudFormation | Amazon Web Services | Apache Hadoop | Apache Hive | Apache KafkaSenior-level Full TimeKuala Lumpur Office, Malaysia13d ago
-
AI-enabled | AI-enabled workflows | Agentic Workflows | Data Analysis | Data cleaningExecutive-level ContractGelang Patah, Johor, Malaysia14d ago