Data Engineer

Tasks

• Automate data quality monitoring
• Design data pipelines
• Develop data infrastructure
• Document data lineage and ETL ELT processes
• Implement data validation checks
• Implement event-driven data pipelines
• Maintain data models for analytics
• Maintain technical documentation
• Manage database security and RBAC
• Optimize OLAP and OLTP databases
• Support outlier and anomaly detection

Perks/Benefits

• Annual leave
• Health insurance
• Parental leave
• Provident fund
• Sabbatical options
• Staff Savings

Skills/Tech-stack

API Integration | Access Control | Apache Airflow | Bash | Build tool | CI/CD | Change Data Capture | ClickHouse | Data Backup | Data Build Tool | Data Capture | Data replication | Database Encryption | Debezium | Dimensional Modeling | Docker | ELT | ETL | Git | Great Expectations | Kafka | MySQL | OLAP | OLTP | Python | Role-Based Access | Role-Based Access Control | SQL | Webhook