Data Engineer

Tasks

• Apply data governance security and privacy standards
• Automate deployments and task scheduling
• Build ETL/ELT pipelines
• Build physical data marts and databases
• Create unit and systems tests
• Design hybrid data solutions
• Develop data warehouses and data lakes
• Ensure data quality checks validation reconciliation
• Implement streaming data pipelines
• Manage user acceptance testing and signoffs
• Monitor and optimize data workflows performance and cost
• Perform data quality assessments and alerts
• Provision feature stores and model ready datasets
• Set up change scripts for production
• Support data lakes and streaming platform for analytics

Perks/Benefits

• N/A

Skills/Tech-stack

AWS | Automation | Azure | C++ | Cause analysis | Data Governance | Data Lake | Data Modeling | Data Privacy | Data Quality | Data Security | Data Warehousing | ELT | ETL | Excel | GCP | Java | Machine Learning | Message queuing | Microsoft SQL | Microsoft SQL Server | MySQL | Performance Tuning | PostgreSQL | Python | Query Performance Tuning | Query performance | Reconciliation | Root Cause Analysis | Root cause | SQL | SQL Server | SSIS | Scala | Streaming | T-SQL | Task Scheduling