Data Engineering Lead

Tasks

• Automate deployment and scheduling
• Build ETL processes
• Conduct training and knowledge sharing
• Create data documentation and lineage
• Design data pipelines
• Design data warehouses and data lakes
• Develop data models and schemas
• Enforce data security and compliance
• Ensure infrastructure scalability
• Implement data governance best practices
• Implement data quality checks
• Integrate data from multiple sources
• Manage data retention and archiving
• Optimize database performance
• Perform root cause analysis
• Process large data with big data technologies
• Set up monitoring and alerting

Perks/Benefits

• N/A

Skills/Tech-stack

Access Control | Automation | Data Documentation | Data Governance | Data Lakes | Data Lineage | Data Management | Data Modeling | Data Partitioning | Data Pipelines | Data Quality | Data Security | Data Warehousing | Database Design | Database performance | Database performance tuning | Dimensional Modeling | ETL | Encryption | Hadoop | Indexing | Kafka | Master Data | Master Data Management | Metadata Management | Monitoring and Alerting | NoSQL | Performance Tuning | Query Optimization | RDBMS | SQL | Spark