Senior Data Architect
Tasks
- Architect Kafka to Fabric ingestion pipeline
- Build data sharing architecture with OneLake shortcuts and Delta Sharing
- Define data governance policies and access controls
- Define data models and dimensional schemas
- Design analytical warehouse architecture on Microsoft Fabric
- Design semantic layer for business metrics
- Implement lakehouse storage strategy with OneLake
- Migrate batch extracts to Kafka sourced Parquet Delta pipelines
- Optimize query performance with partitioning and materialized views
- Plan Apache Iceberg migration roadmap on OneLake
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Kafka | Avro | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lineage | Data Quality | Data Vault | Delta Lake | Delta Sharing | Dimension tables | Dimensional Modeling | Fabric SQL | Fact tables | Great Expectations | Kafka Connect | Kimball | Materialized views | Microsoft Fabric | Microsoft Purview | OneLake | Partition Pruning | SQL | Soda | Star Schema | Synapse Analytics | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimeMumbai, Maharashtra, India13h ago
-
EY - GDS Consulting - AI And DATA -Snowflake Architect -Manager INR 3000K-4000KAgile | Batch Processing | Cloud Data | Cloud Data Warehouse | DBTCareer development | Coaching and feedback | Flexible work arrangementSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
AI/ML | AWS | Azure | Azure Data | Azure Data FactoryFlexible working hours | Remote WorkingSenior-level Full TimeIndia R1d ago
-
Assistant Manager - SA2 (AI Hub - GDC) INR 1400K-2200KAWS | Agent Development | Apache Kafka | Autogen | AzureMid-level Full TimeHyderabad, Telangana, India1d ago
-
Sr Data Engineer I INR 3000K-4000KAWS | Automation | Big Data | Cloud Computing | Data ArchitectureSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Large Language Model Architect INR 2500K-4000KAI Search | App Service | Azure AI | Azure AI Search | Azure AppSenior-level Full TimePune, PDC3B, India1d ago
-
Associate Architect - SD INR 1800K-2525KAgile | Azure OpenAI | Behavior-Driven Development | CD | CIMid-level Full TimeIN KA Bengaluru, India1d ago
-
Data Architect Advisory, AVP INR 3000K-4000KAPI Integration | Access Control | Azure Data | Azure Data Lake | BigQueryAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Flexible leave policySenior-level Full TimePune - Margarpatta, India1d ago
-
Data Architect Advisory, AVP INR 3000K-4000KAPI Integration | Access Control | Auditability | Azure Data | Azure Data LakeAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Education sponsorship | Employee assistance programSenior-level Full TimePune - Margarpatta, India1d ago
-
Principal Engineer - .NET Core / GenAI INR 2000K-3307K.Net Core | AI Pipelines | Agile | Angular | AutomationSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …1d ago
-
Principal Engineer - Java, GenAI INR 2100K-3500KAI Pipelines | Artificial Intelligence | CI/CD | Cloud Native | ContainersSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Sr Lead Data Engineer With GCP INR 2000K-3500KAPI Integration | Apache Spark | Batch Processing | BigQuery | CI/CDHybrid workSenior-level Full TimeINDIA - BENGALURU - BIRLASOFT OFFICE, …1d ago
-
Senior-level Full TimeIndia1d ago
-
Senior-level Full TimeHyderabad, India1d ago
-
Data Architect INR 2400K-3380KAI/ML | AWS | Alation | Azure | Azure DataCompetitive benefits | Continuous training | Remote workSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeIndia2d ago
-
Sr. Specialist Solutions Architect INR 3000K-3880KAmazon Web Services | Analytics | Application development | Cloud Computing | Cloud platformSenior-level Full TimeBengaluru, India2d ago
-
Architect - Data Platform and Engineering INR 500K-831KAmazon Web Services | Artificial Intelligence | Automation | CI/CD | ComplianceSenior-level Full TimeHyderabad (SEZ), India2d ago
-
Data Solution Architect INR 1500K-2800KAPIs | Apache Spark | Azure | Azure Data | Azure Data FactoryInclusive collaborative workplace | Mentorship | Structured learning | Work-life balance | Workplace safety and collaborationSenior-level Full TimeRMZ Ecoworld 32, India2d ago
-
Staff Architect, Software INR 2000K-3000KAPI Design | AWS | Access Control | Agent Orchestration | Architecture ReviewSenior-level Full TimeIndia - Bangalore - 5th floor, …2d ago
-
ServiceNow Data Architect - Vice President INR 1500K-2250KCMDB | CSDM | Cloud Computing | Data Governance | Data IngestionSenior-level Full TimeBangalore, India2d ago
-
Platform Architect - Data Platforms INR 3000K-4000KAccess Control | Amazon Redshift | Amazon Web Services | Artificial Intelligence | Conversational AnalyticsSenior-level Full TimePune DIA, India2d ago
-
Data Architect Analyst INR 2520K-3500KAI Data | AI data readiness | Data Governance | Data Lineage | Data QualityPaid time off | Performance bonus | Relocation assistanceSenior-level Full TimePune, MH, IN2d ago
-
Sr. Full Stack AI Engineer INR 2000K-4500KCSS Modules | Data Governance | Data integration | GraphQL | LLMSenior-level Full TimeHyderabad (Office), India2d ago
-
Data Migration Architect-6A INR 1500K-2040KData Integrity | Data Migration | Data Quality | Data Transformation | Data extractionStakeholder training | Team leadershipSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …2d ago