Principal Software Engineer (Data Platform)
Tasks
- Build and maintain data lakehouse solutions
- Design and develop ETL/ELT pipelines
- Develop data transformation solutions
- Implement secure integrations
- Integrate data using Synapse Event Hub Logic Apps and Function Apps
- Troubleshoot and optimize Spark workloads
- Troubleshoot and optimize data pipelines
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Event | Azure Event Hubs | Azure Functions | Azure Key Vault | Azure Logic | Azure Logic Apps | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage Gen2 | Data Lakehouse | Data Lakehouse Architecture | Delta Lake | Delta Tables | Event Hubs | Key Vault | Lakehouse Architecture | Logic Apps | PySpark | SQL Database | SharePoint integration | Spark SQL | Synapse Analytics
Education
N/A
Related jobs
-
Principal Software Engineer (Data Platform) INR 800K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Hybrid work environmentSenior-level Full TimeIslamabad, Capital2d ago
-
Principal Software Engineer (Data Platform) INR 800K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2UAE business hours schedule | UAE public holiday calendarSenior-level Full TimeKarachi, Sindh2d ago
-
Senior Data Engineer USD 119K-258KApache Spark | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Pakistan12d ago
-
Azure AI Engineer - Pakistan INR 1200K-2500KAI Services | ARM | Agile | App Service | Application InsightsMid-level Full TimeIslamabad, Pakistan14d ago
-
ARM | Azure | Azure Blob | Azure Blob Storage | Azure DataMid-level Full TimeKarachi, Pakistan R19d ago
-
Data Engineer INR 2000K-2500KAzure | Azure Data | Azure Data Factory | Data Factory | Data ModelingChild care facility | Conveyance allowance | Home internet subsidy | Leave encashment | Life benefitMid-level Full TimePER - Lahore, PK, Pakistan20d ago
-
Principal Data Engineer USD 126K-170KApache Delta | Apache Delta Lake | Apache Spark | Azure Blob | Azure Blob StorageSenior-level Full TimeLahore, Pakistan1mo ago
-
Staff Data Engineer - (.NET / Angular / PostgresSQL) USD 135K-199KAgile | Amazon Redshift | Angular | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Karachi, Islamabad1mo ago
-
Senior Data Engineer - Azure USD 119K-258KApache Spark | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Pakistan1mo ago
-
Data Engineer USD 103K-122KAzure Data | Azure Data Factory | Azure Databricks | Azure Functions | Azure Key VaultAccess to in house gym | Complimentary meals | Health insurance | Life insurance | Voluntary pension schemeEntry-level Full TimePakistan1mo ago
-
Lead Data Engineer (AWS Data Platform) INR 1500K-2750KAWS Glue | Agile | Amazon EMR | Amazon Redshift | CI/CDHybrid work schedule | Remote collaboration | UAE business hours alignmentSenior-level Full TimeKarachi, Sindh1mo ago
-
Lead Data Engineer (AWS Data Platform) INR 1500K-2750KAWS Glue | AWS IAM | AWS Lambda | AWS Step Functions | AgileSenior-level Full TimeLahore, Punjab1mo ago
-
Lead Data Engineer (AWS Data Platform) INR 1500K-2750KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon CloudWatchHybrid work schedule | UAE business hours collaborationSenior-level Full TimeIslamabad, Federal Territory1mo ago