Technical Architect-SME-Analytics
Tasks
- Build PySpark data processing pipelines
- Build and optimize Power BI reports
- Design analytics architecture
- Develop Delta Lake based data flows
- Develop data ingestion and transformation workflows
- Document architecture processes and data flows
- Ensure security and governance compliance
- Implement CI/CD pipelines and version control
- Implement analytics solutions
- Integrate Azure Databricks with Azure services
- Lead data pipeline and ETL development
- Manage Databricks clusters and notebooks
- Optimize Databricks SQL query layers
- Oversee end-to-end data solution implementation
- Provide technical mentorship to data engineering team
Perks/Benefits
- N/A
Skills/Tech-stack
ARM Templates | Auto Loader | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Resource | Azure Resource Manager | Azure Security | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage Gen2 | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Delta Tables | Git | Hadoop | Microsoft Fabric | NoSQL | Power BI | PySpark | Resource manager | SQL | Spark | Spark Streaming | Synapse Analytics
Education
N/A
Roles
Related jobs
-
SAP BDC Data Architect JPY 8600K-9700KData Architecture | Data Governance | Data Lineage | Data Management | Data ModelingSenior-level Full TimeTokyo, Tokyo, JP, 100-00041d ago
-
Cloud Solution Architect - Data Analytics JPY 7500K-10870KAmazon Redshift | Apache Spark | Azure AI | Azure ML | Azure OpenAISenior-level Full TimeTokyo, Tokyo, JP3d ago
-
BigQuery | Business Process | Business Process Analysis | Cloud Technology | Data ArchitectureSenior-level Full TimeTokyo, Japan5d ago
-
Amazon Redshift | Data Governance | Data Modeling | Data Security | Data WarehousingSenior-level Full TimeTokyo, Japan5d ago
-
ソリューションアーキテクト (プリセールス) JPY 6000K-8000KAI | AWS | Azure | Big Data | CassandraFlexible work hours | Health insurance | Professional development supportSenior-level Full TimeJapan27d ago
-
Solutions Architect (Pre-sales) - Financial Services JPY 6500K-9500KAI | Analytics | Apache Spark | Big Data | CassandraSenior-level Full TimeTokyo, Japan27d ago
-
Solutions Architect (Pre-sales) - Kansai Region JPY 8000K-10500KAI | Apache Spark | Big Data | Cassandra | Cloud ArchitectureSenior-level Full TimeJapan27d ago
-
Solutions Architect (Pre-sales) - Retail/CPG JPY 8000K-9700KAI | Analytics | Apache Spark | Big Data | CassandraInclusive culture | Professional developmentSenior-level Full TimeTokyo, Japan27d ago
-
Solutions Architect (Pre-sales) - Digital Native JPY 8000K-9700KAI | AWS | Analytics | Apache Spark | AzureFlexible work arrangements | Professional Development BenefitsSenior-level Full TimeTokyo, Japan27d ago
-
Delivery Solutions Architect JPY 8000K-9700KCloud Computing | Customer Success | Data Engineering | Project Management | PythonFlexible work arrangements | Health insurance | Professional development resourcesSenior-level Full TimeTokyo, Japan27d ago
-
デリバリーソリューションアーキテクト JPY 6500K-9000KAI | Cloud Computing | Data Engineering | Distributed Systems | Program ManagementFlexible work hours | Health insurance | Professional development opportunitiesSenior-level Full TimeTokyo, Japan27d ago
-
Cloud Solution Architect - Data Analytics JPY 6000K-9000KAI | Advanced Analytics | Artificial Intelligence | Azure | Azure AISenior-level Full TimeTokyo, Tokyo, JP1mo ago
-
Resident Solutions Architect JPY 7000K-9700KAWS | Azure | Cloud platform | Cloud platform knowledge | Continuous integrationComprehensive benefits | Diversity and inclusion focusSenior-level Full TimeTokyo, Japan1mo ago