Senior Data Architect
Tasks
- Architect Kafka to Fabric ingestion pipeline
- Build data sharing architecture with OneLake shortcuts and Delta Sharing
- Define data governance policies and access controls
- Define data models and dimensional schemas
- Design analytical warehouse architecture on Microsoft Fabric
- Design semantic layer for business metrics
- Implement lakehouse storage strategy with OneLake
- Migrate batch extracts to Kafka sourced Parquet Delta pipelines
- Optimize query performance with partitioning and materialized views
- Plan Apache Iceberg migration roadmap on OneLake
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Kafka | Avro | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lineage | Data Quality | Data Vault | Delta Lake | Delta Sharing | Dimension tables | Dimensional Modeling | Fabric SQL | Fact tables | Great Expectations | Kafka Connect | Kimball | Materialized views | Microsoft Fabric | Microsoft Purview | OneLake | Partition Pruning | SQL | Soda | Star Schema | Synapse Analytics | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Amaze - Cloud Data Architect INR 1200K-2000KApache Airflow | Azure | Integration Services | Java | Power BISenior-level Full TimeIndia7h ago
-
Amaze - Cloud Data Architect INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia7h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure | Azure Databricks | Data Engineering | Data Factory | Data MigrationSenior-level Full TimeIndia7h ago
-
CLOUD AMAZE - DW Lead (Practice) INR 1500K-2500KAzure | Azure Databricks | Cloud Computing | Data Architecture | Data EngineeringSenior-level Full TimeIndia7h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure Databricks | Data Engineering | Data Factory | Data Migration | Data ModelingSenior-level Full TimeIndia7h ago
-
Senior-level Full TimeIndia8h ago
-
Sr. Delivery Solutions Architect INR 2500K-3100KBusiness Analysis | Consulting | Customer Success | Data Engineering | Distributed SystemsHybrid work | Travel 30 percentSenior-level Full TimeBengaluru, India13h ago
-
Lead Data Architect INR 1500K-2500KAWS | Agile | Amazon Redshift | Apache Spark | BigQueryRelocationSenior-level Full TimeIND - Bangalore, India17h ago
-
Solution Architect – Power BI Migration INR 3000K-4200KAPI permissions | Admin Consent | Authentication methods | Azure Entra | Azure Entra IDBe Well programs | Certification support | Coaching | Hybrid work | Learning opportunitiesSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India17h ago
-
Architect, Data Management INR 1500K-2800KAWS | Cloud platform | Data Modeling | Data Quality | Data SecuritySenior-level Full TimeBangalore, India1d ago
-
Data Architect INR 2600K-3380KAgile | Architecture governance | Architecture standards | Behavior-Driven Development | CI/CDDiversity and inclusion | Remote WorkingSenior-level Full Timehyderabad, India1d ago
-
Solution Architect - Data Platform Modernization INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, KA, IN1d ago
-
Data Engineering Lead Analyst -= HIH - Evernorth INR 1500K-2500KAWS Glue | AWS RDS | Access Control | Amazon Athena | Amazon RedshiftMentorship | Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R1d ago
-
Data Architect INR 2400K-3000KApache Airflow | Asset bundles | Auto Loader | Bronze Silver Gold | CI/CDSenior-level Full TimeBengaluru, BDC6F, India1d ago
-
Senior-level Full TimeBengaluru, BDC6F, India1d ago
-
Senior-level Full TimeBengaluru, BDC6F, India1d ago
-
Senior-level Full TimeBengaluru, BDC6F, India1d ago
-
Senior-level Full TimeHyderabad, HDC4A, India1d ago
-
Data Architect INR 3000K-4000KCloud Data | Cloud Data Platforms | Data Governance | Data Modeling | Data integrationSenior-level Full TimeIndore, INDC1A, India1d ago
-
Senior-level Full TimeBengaluru, BDC11A, India1d ago
-
Senior-level Full TimeBengaluru, BDC11A, India1d ago
-
Senior-level Full TimeBengaluru, BDC11A, India1d ago
-
Senior-level Full TimeBengaluru, BDC11A, India1d ago
-
Senior-level Full TimeBengaluru, BDC11A, India1d ago
-
Data Architect INR 2400K-3000KApache Spark | Asset bundles | Auto Loader | CI/CD | DLT ExpectationsSenior-level Full TimeBengaluru, BDC6F, India1d ago