Data Engineer - Senior

Tasks

• Build ETL pipelines to integrate diverse data sources
• Build and optimize data processing with Azure Databricks and Delta Lake
• Collaborate with stakeholders to translate requirements into datasets
• Design data models for scalability and performance
• Design data solutions for digital transformation
• Develop Azure based cloud data solutions
• Manage version control using Git
• Transform data using Python and SQL
• Troubleshoot pipeline issues and improve performance

Perks/Benefits

• Collaboration with multidisciplinary teams
• Fully remote
• Remote work flexibility

Skills/Tech-stack

Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Networking | Azure SQL | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage Gen2 | Delta Lake | ELT | ETL | Git | Python | SQL | Synapse Analytics