Data Engineer - Zurich Asuransi Indonesia

Tasks

• Build data quality validation frameworks
• Design ETL/ELT pipelines
• Develop dimensional models star schema
• Establish CI/CD pipelines
• Implement SCD and optimize analytical workloads
• Implement data governance security policies
• Maintain technical documentation and data lineage
• Optimize Spark SQL and DataFrame performance

Perks/Benefits

• N/A

Skills/Tech-stack

AWS | Apache Spark | Azure | CI/CD | Cloud platform | Clustering | Column-Level Security | Data Governance | Data Quality | Data Reconciliation | Data Validation | DataFrame | Databricks | Dimensional Modeling | ELT | ETL | Exception Handling | GitHub | Google Cloud | Google Cloud Platform | Integration Testing | Join optimization | Partitioning | PySpark | Python | Row Level Security | SCD | Smoke Testing | Spark SQL | Star Schema | Statistical profiling | Unit Testing | Version control