Data Engineer - Senior

Tasks

• Build and optimize ETL/ELT pipelines
• Build and optimize data processing and storage with Azure Databricks and Delta Lake
• Collaborate with stakeholders to translate requirements into data engineering solutions
• Design data models and architectures for scalability reliability performance and data quality
• Design, develop, and maintain scalable data solutions
• Develop cloud based data solutions on Microsoft Azure
• Integrate diverse data sources into analytics ready datasets
• Manage version control and engineering best practices with Git
• Transform and process data using Python and SQL
• Troubleshoot data pipeline issues and optimize performance reliability and maintainability

Perks/Benefits

• Flexible work location
• Fully remote
• Large scale digital transformation exposure
• Remote work autonomy and flexibility
• Use AI powered engineering tools
• Work with modern Microsoft Azure data ecosystem

Skills/Tech-stack

Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Networking | Azure SQL | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data Pipeline Development | Data integration | Data pipeline | Delta Lake | ELT | ETL | Git | Microsoft Azure | Pipeline Development | Python | SQL | Synapse Analytics