Data Engineer

Tasks

• Build and manage ETL/ELT processes
• Collaborate with stakeholders to define data requirements and quality standards
• Design and maintain data ingestion pipelines
• Implement data validation cleansing and reconciliation
• Maintain Python scripts for extraction transformation and loading
• Maintain documentation of data flows data models and configurations
• Manage version control and CI CD for data codebases
• Monitor pipeline performance and optimize throughput and scalability
• Troubleshoot production data issues

Perks/Benefits

• N/A

Skills/Tech-stack

AWS | Apache Airflow | Azure | CI/CD | Containerization | Data Governance | Data Lake | Data Modeling | Data Quality | ELT | ETL | Git | Kubernetes | Python | SQL