Senior Data Engineer
Petaling Jaya (First Avenue), Malaysia
USD 161K-216K (estimate) Senior-level Full Time
Tasks
- Assist with schema design clustering partitioning and loading strategies
- Build Python connectors and scripts for data extraction and loading
- Design develop test deploy maintain ELT data pipelines
- Develop dbt transformation pipelines with tests and documentation
- Enforce data governance security RBAC data masking
- Implement batch and streaming ingestion strategies
- Implement change management documentation and data protocols
- Manage and monitor Snowflake resources for cost effectiveness
- Optimize Snowflake warehouse usage and query performance
- Orchestrate schedule data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Airflow DAGs | Airflow operators | Airflow sensors | Apache Airflow | DBT | Data Governance | Data Ingestion | Data Lineage | Data Quality | Data Security | Data masking | Dimensional Modeling | ELT | ETL | External stages | Jinja | Macros | Python | Query Optimization | RBAC | SQL | Snowflake | Snowflake Schema | Snowpipe | Star Schema | Stored Procedure | Stored Procedure Tuning | Stored Procedures | XCOM
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Data Engineer PLN 206K-328KAWS | Agile | Airflow | Alerting | Apache SparkCareer development planning | Casual dress | Conferences | Courses | Flexible workingSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala …7h ago
-
Data Engineer CAD 120K-145KAWS | Amazon ECR | Amazon EKS | Azure | CI/CDDevelopment opportunities | Equal opportunity | Reward and recognition | Volunteering | WellnessSenior-level Full TimeCyberjaya, Selangor, Malaysia9h ago
-
Data Engineer CAD 95K-122KAWS | Airflow | Apache Spark | CI/CD | Code reviewCasual dress | Flexible working | Tailored career development planning | Work from homeMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …12h ago
-
Azure Databricks USD 172K-241KAPI Integration | Access Control | Access Control Lists | Apache Deequ | Apache SparkMid-level Full TimeKuala Lumpur, MY15h ago
-
Hiring: Data Engineer for Leading Client in Malaysia, KL INR 1500K-2000KAzure Data | Azure Data Factory | Azure Databricks | Azure Key Vault | Azure SynapseMid-level Full TimeKuala Lumpur, Federal Territory of Kuala …15h ago
-
AWS | Automation | Capacity Planning | Clustering | ComplianceHybrid workSenior-level Full TimeKuala Lumpur, Malaysia1d ago
-
Senior-level Full TimeBatu Kawan, Penang, Malaysia1d ago
-
T&T Senior Consultant - Artificial Intelligence & Data (Google Cloud Data Engineer) - SG USD 118K-179KAnalytics | BigQuery | Cloud platform | Data Cleansing | Data GovernanceMid-level Full TimeKuala Lumpur, MY1d ago
-
API Integration | Automation Anywhere | Blue Prism | C# | JavaScriptDental benefits | Free snacks | Growth opportunities | Health benefits | Life insuranceMid-level ContractKuala Lumpur, Federal Territory of Kuala …1d ago
-
Mid-level Full TimePetaling Jaya, Selangor, Malaysia1d ago
-
Senior Machine Learning Engineer USD 157K-200KApache Spark | CI/CD | Causal Inference | Deep learning | ETLBirthday leave | Flexwork arrangements | GrabFlex Benefits Package | Life Assistance Programme | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia1d ago
-
Automation | Dashboarding | Data Quality | Data Validation | Data VisualizationMid-level Full TimeKuala Lumpur, Malaysia2d ago
-
Data Engineer USD 118K-165KBigQuery | Cloud platform | DBT | Data Governance | Data LakesAutonomy | Growth opportunities | TrustMid-level Full TimeMalaysia3d ago
-
Senior-level Full TimeKuala Lumpur4d ago
-
Software Developer/ Software Programmer(ETL) USD 110K-155KApache NiFi | Data Governance | Data Warehouse | ETL | Metadata ManagementSenior-level Full TimeKuala Lumpur4d ago
-
Entry-level Full TimeKuala Lumpur - RedQ, Malaysia4d ago
-
AI Engineer CAD 119K-157KAccess Control | Anonymization | Authentication | Authorization | Cloud ComputingMid-level Full TimeMY-Cyberjaya, Malaysia4d ago
-
Senior Machine Learning Engineer USD 154K-200KApache Spark | Causal Inference | Data pipeline | Deep learning | ETLBirthday leave | Employee assistance programme | FlexWork | Flexible benefits plan | Medical insuranceSenior-level Full TimePetaling Jaya, Malaysia5d ago
-
Algorithm Engineer (AME) USD 128K-173KC++ | Computer Vision | Data Modeling | Design of Experiments | Machine LearningSenior-level Full TimePenang, MY, Malaysia5d ago
-
Executive, Group Corporate Assurance (Data Analytics) USD 155K-245KCloud Computing | Data Analysis | Data Mapping | Data Visualization | Data cleaningExecutive-level Full TimeMalaysia | Selangor | Menara Sime …5d ago
-
None Full TimePenang 15, Penang, Malaysia5d ago
-
AWS | Angular | Artificial Intelligence | Azure | Cloud platform100 percent remote work | Employment visa support not availableSenior-level Full TimeKuala Lumpur, Federal Territory of Kuala … R5d ago
-
Senior-level Full TimeCyberjaya, Selangor, Malaysia6d ago
-
Intern, Transformation Automation USD 50K-58KAPI Integration | Artificial Intelligence | Machine Learning | OpenAI | Performance TuningEntry-level Full Time InternshipMY-Kuala Lumpur-IT, Malaysia6d ago
-
Intern, Transformation Automation USD 50K-58KAPI Integration | Agent systems | Artificial Intelligence | Automation | Machine LearningCareer growth | Learning opportunitiesEntry-level Full Time InternshipMY-Kuala Lumpur-IT, Malaysia6d ago