Principle Data Architect
Tasks
- Architect Kafka to Fabric ingestion pipelines
- Architect data sharing with Fabric Data Sharing and Delta Sharing
- Define OneLake storage and lakehouse strategy
- Define dimensional data models and schemas
- Design analytical warehouse architecture on Microsoft Fabric
- Design query performance strategies for analytical workloads
- Design semantic layer for governed business metrics
- Establish standards naming documentation and code review processes
- Implement data governance policies and data contracts
- Migrate batch extracts to Kafka sourced Parquet and Delta
- Plan Apache Iceberg roadmap for time travel and multi engine access
Perks/Benefits
- N/A
Skills/Tech-stack
ACID transactions | Access Control | Apache Iceberg | Apache Parquet | Avro | Azure CI | Azure CI/CD | Azure Data | Azure Data Governance | Azure Synapse | Azure Synapse Analytics | CI/CD | Caching | Data Access Control | Data Catalog | Data Governance | Data Lineage | Data Quality | Data Vault | Data access | Delta Lake | Delta Sharing | Dimensional Modeling | Fabric SQL | Great Expectations | Kafka | Kafka Connect | Kafka Schema Registry | Kimball | Materialized views | Microsoft Fabric | Microsoft Purview | OneLake | Partition Pruning | Performance Tuning | Query Performance Tuning | Query performance | SQL | Schema Registry | Schema evolution | Soda | Star Schema | Synapse Analytics | Time Travel | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Associate Director- AI Engineer - Solution Architect INR 1800K-2500KAI Governance | Agent systems | App Service | Azure | Azure AppMid-level Full TimeBangalore, Karnataka, India7h ago
-
Senior-level Full TimeMumbai, Maharashtra, India14h ago
-
EY - GDS Consulting - AI And DATA -Snowflake Architect -Manager INR 3000K-4000KAgile | Batch Processing | Cloud Data | Cloud Data Warehouse | DBTCareer development | Coaching and feedback | Flexible work arrangementSenior-level Full TimeHyderabad, TG, IN, 50008114h ago
-
Digital Next IA :: Manager - Gen AI INR 1800K-2500KAWS | AWS Bedrock | Agile | Azure | Azure OpenAIMid-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer Architect. INR 1500K-2400KAPI Development | AWS | Agentic Engineering | Database optimization | FastAPISenior-level Full TimeIN-MH-Pune1d ago
-
AI/ML | AWS | Azure | Azure Data | Azure Data FactoryFlexible working hours | Remote WorkingSenior-level Full TimeIndia R1d ago
-
Assistant Manager - SA2 (AI Hub - GDC) INR 1400K-2200KAWS | Agent Development | Apache Kafka | Autogen | AzureMid-level Full TimeHyderabad, Telangana, India1d ago
-
Sr Data Engineer I INR 3000K-4000KAWS | Automation | Big Data | Cloud Computing | Data ArchitectureSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Large Language Model Architect INR 2500K-4000KAI Search | App Service | Azure AI | Azure AI Search | Azure AppSenior-level Full TimePune, PDC3B, India1d ago
-
Associate Architect - SD INR 1800K-2525KAgile | Azure OpenAI | Behavior-Driven Development | CD | CIMid-level Full TimeIN KA Bengaluru, India1d ago
-
Data Architect Advisory, AVP INR 3000K-4000KAPI Integration | Access Control | Azure Data | Azure Data Lake | BigQueryAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Flexible leave policySenior-level Full TimePune - Margarpatta, India1d ago
-
Data Architect Advisory, AVP INR 3000K-4000KAPI Integration | Access Control | Auditability | Azure Data | Azure Data LakeAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Education sponsorship | Employee assistance programSenior-level Full TimePune - Margarpatta, India1d ago
-
Principal Engineer - .NET Core / GenAI INR 2000K-3307K.Net Core | AI Pipelines | Agile | Angular | AutomationSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …1d ago
-
Principal Engineer - Java, GenAI INR 2100K-3500KAI Pipelines | Artificial Intelligence | CI/CD | Cloud Native | ContainersSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Sr Lead Data Engineer With GCP INR 2000K-3500KAPI Integration | Apache Spark | Batch Processing | BigQuery | CI/CDHybrid workSenior-level Full TimeINDIA - BENGALURU - BIRLASOFT OFFICE, …1d ago
-
Senior-level Full TimeIndia2d ago
-
Senior-level Full TimeHyderabad, India2d ago
-
Data Architect INR 2400K-3380KAI/ML | AWS | Alation | Azure | Azure DataCompetitive benefits | Continuous training | Remote workSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeIndia2d ago
-
Sr. Specialist Solutions Architect INR 3000K-3880KAmazon Web Services | Analytics | Application development | Cloud Computing | Cloud platformSenior-level Full TimeBengaluru, India2d ago
-
Architect - Data Platform and Engineering INR 500K-831KAmazon Web Services | Artificial Intelligence | Automation | CI/CD | ComplianceSenior-level Full TimeHyderabad (SEZ), India2d ago
-
Data Solution Architect INR 1500K-2800KAPIs | Apache Spark | Azure | Azure Data | Azure Data FactoryInclusive collaborative workplace | Mentorship | Structured learning | Work-life balance | Workplace safety and collaborationSenior-level Full TimeRMZ Ecoworld 32, India2d ago
-
Staff Architect, Software INR 2000K-3000KAPI Design | AWS | Access Control | Agent Orchestration | Architecture ReviewSenior-level Full TimeIndia - Bangalore - 5th floor, …2d ago
-
ServiceNow Data Architect - Vice President INR 1500K-2250KCMDB | CSDM | Cloud Computing | Data Governance | Data IngestionSenior-level Full TimeBangalore, India2d ago
-
Platform Architect - Data Platforms INR 3000K-4000KAccess Control | Amazon Redshift | Amazon Web Services | Artificial Intelligence | Conversational AnalyticsSenior-level Full TimePune DIA, India2d ago