Technical Architect-SME-Analytics
Tasks
- Build PySpark data processing pipelines
- Build and optimize Power BI reports
- Design analytics architecture
- Develop Delta Lake based data flows
- Develop data ingestion and transformation workflows
- Document architecture processes and data flows
- Ensure security and governance compliance
- Implement CI/CD pipelines and version control
- Implement analytics solutions
- Integrate Azure Databricks with Azure services
- Lead data pipeline and ETL development
- Manage Databricks clusters and notebooks
- Optimize Databricks SQL query layers
- Oversee end-to-end data solution implementation
- Provide technical mentorship to data engineering team
Perks/Benefits
- N/A
Skills/Tech-stack
ARM Templates | Auto Loader | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Resource | Azure Resource Manager | Azure Security | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage Gen2 | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Delta Tables | Git | Hadoop | Microsoft Fabric | NoSQL | Power BI | PySpark | Resource manager | SQL | Spark | Spark Streaming | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Resident Solutions Architect JPY 8600K-9700KAWS | Big Data | CI/CD | Cloud platform | Continuous DeliverySenior-level Full TimeTokyo, Japan8d ago
-
Senior-level Full TimeKochi, IN15d ago
-
Technical Account Manager - Japan JPY 8600K-10000KAWS | Access Management | Active Directory | Azure | Cloud platformSenior-level Full TimeJapan, Tokyo21d ago
-
SAP BDC Data Architect JPY 8600K-9700KData Architecture | Data Governance | Data Lineage | Data Management | Data ModelingSenior-level Full TimeTokyo, Tokyo, JP, 100-000422d ago
-
Amazon Redshift | Data Governance | Data Modeling | Data Security | Data WarehousingSenior-level Full TimeTokyo, Japan25d ago
-
ソリューションアーキテクト (プリセールス) JPY 6000K-8000KAI | AWS | Azure | Big Data | CassandraFlexible work hours | Health insurance | Professional development supportSenior-level Full TimeJapan1mo ago
-
Solutions Architect (Pre-sales) - Financial Services JPY 6500K-9500KAI | Analytics | Apache Spark | Big Data | CassandraSenior-level Full TimeTokyo, Japan1mo ago
-
Solutions Architect (Pre-sales) - Kansai Region JPY 8000K-10500KAI | Apache Spark | Big Data | Cassandra | Cloud ArchitectureSenior-level Full TimeJapan1mo ago
-
Solutions Architect (Pre-sales) - Retail/CPG JPY 8000K-9700KAI | Analytics | Apache Spark | Big Data | CassandraInclusive culture | Professional developmentSenior-level Full TimeTokyo, Japan1mo ago
-
Solutions Architect (Pre-sales) - Digital Native JPY 8000K-9700KAI | AWS | Analytics | Apache Spark | AzureFlexible work arrangements | Professional Development BenefitsSenior-level Full TimeTokyo, Japan1mo ago
-
Delivery Solutions Architect JPY 8000K-9700KCloud Computing | Customer Success | Data Engineering | Project Management | PythonFlexible work arrangements | Health insurance | Professional development resourcesSenior-level Full TimeTokyo, Japan1mo ago
-
デリバリーソリューションアーキテクト JPY 6500K-9000KAI | Cloud Computing | Data Engineering | Distributed Systems | Program ManagementFlexible work hours | Health insurance | Professional development opportunitiesSenior-level Full TimeTokyo, Japan1mo ago