Technical Architect-SME-Analytics
Tasks
- Build PySpark data processing pipelines
- Build and optimize Power BI reports
- Design analytics architecture
- Develop Delta Lake based data flows
- Develop data ingestion and transformation workflows
- Document architecture processes and data flows
- Ensure security and governance compliance
- Implement CI/CD pipelines and version control
- Implement analytics solutions
- Integrate Azure Databricks with Azure services
- Lead data pipeline and ETL development
- Manage Databricks clusters and notebooks
- Optimize Databricks SQL query layers
- Oversee end-to-end data solution implementation
- Provide technical mentorship to data engineering team
Perks/Benefits
- N/A
Skills/Tech-stack
ARM Templates | Auto Loader | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Resource | Azure Resource Manager | Azure Security | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage Gen2 | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Delta Tables | Git | Hadoop | Microsoft Fabric | NoSQL | Power BI | PySpark | Resource manager | SQL | Spark | Spark Streaming | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Success Architect - Tableau JPY 7500K-9700KAmazon Redshift | Cloud Computing | Dashboarding | Data Governance | Data LakeSenior-level Full TimeJapan - Tokyo11d ago
-
Advisory Solution Consultant - Data & Analytics JPY 8600K-9700KBigQuery | Capacity Planning | Data Engineering | Data Modeling | Data integrationSenior-level Full TimeTokyo, Japan15d ago
-
Technical Architect - Tableau JPY 8000K-10000KAWS | Agile | Azure | Cloud Migration | Dashboard DevelopmentSenior-level Full TimeJapan - Tokyo - Remote R18d ago
-
Quality Assurance Architect - Robotics & Automation JPY 8000K-10000KAPI Testing | Acceptance criteria | Agile | C++ | CI/CDSenior-level Full TimeTokyo, Tokyo, Japan18d ago
-
Resident Solutions Architect JPY 8600K-9700KAWS | Big Data | CI/CD | Cloud platform | Continuous DeliverySenior-level Full TimeTokyo, Japan29d ago
-
Senior-level Full TimeKochi, IN1mo ago
-
Technical Account Manager - Japan JPY 8600K-10000KAWS | Access Management | Active Directory | Azure | Cloud platformSenior-level Full TimeJapan, Tokyo1mo ago
-
SAP BDC Data Architect JPY 8600K-9700KData Architecture | Data Governance | Data Lineage | Data Management | Data ModelingSenior-level Full TimeTokyo, Tokyo, JP, 100-00041mo ago
-
Amazon Redshift | Data Governance | Data Modeling | Data Security | Data WarehousingSenior-level Full TimeTokyo, Japan1mo ago