Principle Data Architect
Tasks
- Architect Kafka to Fabric ingestion pipeline
- Conduct architecture reviews
- Define OneLake storage architecture
- Define dimensional models and star schemas
- Design analytical warehouse architecture
- Design data sharing architecture
- Design query performance for analytical workloads
- Design semantic layer for business metrics
- Establish standards naming conventions and documentation
- Implement data governance and contracts
- Migrate batch extract to Kafka sourced Parquet Delta
- Plan migration to Apache Iceberg roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Apache Iceberg | Apache Spark | Atlan | Avro | Azure Data | Azure Data Engineer | Azure Synapse | Azure Synapse Analytics | CI/CD | Caching | Confidential compute | DP 203 | Data Catalog | Data Engineer | Data Governance | Data Lineage | Data Vault | Delta Lake | Delta Sharing | Differential Privacy | Dimensional Modelling | Exactly once | Fabric Lakehouse | Fabric SQL | Fabric SQL endpoints | Federated Analytics | Flink | Great Expectations | Kafka | Kafka Connect | Kafka Exactly Once | Kimball Method | Materialized views | Microsoft Fabric | Microsoft Purview | OneLake | OneLake shortcuts | Partition Evolution | Partition Pruning | SQL | SQL endpoints | Schema Registry | Schema evolution | Soda | Star Schema | Synapse Analytics | Time Travel | Trino | Z-Order
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Architect, ML Engineering INR 2500K-4500KAWS | Agentic Workflows | Async Programming | Azure | Circuit BreakersSenior-level Full TimePune, Maharashtra, India13h ago
-
Senior-level Full TimePune, Maharashtra, India16h ago
-
Senior-level Full TimeIndia17h ago
-
Data Architect - Enterprise Data Modernization (AWS) INR 1500K-2040KAWS | AWS Glue | Amazon Athena | Amazon S3 | Apache SparkHybrid workSenior-level Full TimeBangalore North, India22h ago
-
Snowflake Data Architect INR 1500K-2400KAWS Lambda | AWS S3 | AWS SQS | Amazon EC2 | Amazon RDSHybrid work scheduleSenior-level Full TimeBangalore North, India22h ago
-
Data Architect- Microsoft Fabrics INR 1500K-2800KAzure | Azure Data | Azure Data Factory | Batch Processing | CDCFast-paced growth environment | High ownership and impact | Work on cutting-edge data platformsSenior-level Full TimeBangalore North, India22h ago
-
Data Architect - Databricks INR 1800K-2400KAWS DMS | AWS EMR | AWS Glue | AWS Lake Formation | AWS LambdaHybrid work (3 days in office) | Immediate join or within 2 weeks availability prioritizedSenior-level Full TimeBangalore North, India22h ago
-
Data Modeler INR 2000K-2040KAlation | Amazon Redshift | Apache Airflow | Business glossary | CollibraHybrid work scheduleSenior-level Full TimeBangalore North, India22h ago
-
Staff Data Platform Architect INR 1500K-2040KAmazon Web Services | Big Data | Data Lake | Data Warehouse | Data pipelineCareer growth opportunities | Collaborative work environment | Innovation-driven environmentSenior-level Full TimeIndia - Hyderabad - 12th FLOOR, …22h ago
-
Data Engineering Professional I INR 933K-1600KData Governance | Data Modeling | Data Quality | Data integration | Healthcare DataBereavement leave | Diversity, equity, & inclusion programs | Employee assistance program | Employee referral program | Group accident insuranceMid-level Full TimeIND - Bengaluru, India22h ago
-
Associate Director AI Solutions Architect INR 1800K-2500KAI Act | AI Foundry | AWS Bedrock | AWS Lambda | Agent OrchestrationMid-level Full TimeHyderabad (Office), India22h ago
-
GCP Data Engineer _Senior Consultant INR 1500K-2500KApache Airflow | Batch Processing | BigQuery | Cloud Composer | Cloud platformSenior-level Full TimeBengaluru, KA, India1d ago
-
Data Governance Lead or Architect INR 1500K-2250KAtlan | Collibra | Cycle management | Data Catalog | Data CataloguingSenior-level Full TimeBengaluru, KA, India1d ago
-
AI Ops | API Integration | Agile | Automation Anywhere | Blue PrismWFH | Work from homeSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
GCP Data Engineer INR 2000K-3065KBigQuery | Cloud Architecture | Cloud Computing | Cloud Networking | Cloud OptimizationContractor or FTE | Remote workSenior-level Full TimeHyderabad, TS, India1d ago
-
Sr. Resident Solutions Architect INR 3000K-3900KAWS | Apache Hadoop | Apache Ranger | Apache Spark | AzureTravel for onsite customer engagementsSenior-level Full TimeBengaluru, India1d ago
-
Data & Databricks Practice Lead (India - Remote) INR 2000K-2400KAmazon EMR | Amazon Redshift | Apache Iceberg | Apache Spark | Audit complianceSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
Associate Director Data Architecture INR 700K-1000KAPI LED | API-led connectivity | AWS Redshift | Apache Hudi | Apache IcebergFlexible benefits | Health and life insurance | Hybrid work model | Paid time off | Pension and retirement benefitsMid-level Full TimeHyderabad, India R1d ago
-
Senior Director of Software Engineering - Data Governance, AWS Data Analytics, Data Platform Architectures INR 1500K-2000KAWS Glue | AWS Lake Formation | AWS Redshift | Amazon Athena | Amazon EMRSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Machine Learning Engineer Expert INR 2475K-4500KAPIs | Artificial Intelligence | CI/CD | Cloud Native | Cloud Native ArchitectureSenior-level Full TimeBangalore, KA, IN, 5621491d ago
-
Amazon Web Services | Autogen | CI/CD | Cloud Computing | Cloud platformCutting-edge technology projects | Global exposure | Inclusive culture | Professional developmentSenior-level Full TimeBengaluru, KA, IN, 5600481d ago
-
Senior Data Architect INR 2000K-2400K.NET | AI machine learning | AWS | Azure | C#Company sponsored transportation | Exponential career growth | Flexible work environment | Generous paid time off | Rapid growth opportunitiesSenior-level Full TimeHyderabad Atria, India1d ago
-
Senior Data Architect INR 2000K-2400K.NET | Ardoq | C# | Data Architecture | Data CatalogCompany sponsored transportation | Exponential career growth | Flexible work environment | Generous paid time off | Growth mentoringSenior-level Full TimeHyderabad Atria, India1d ago
-
Senior Technical Architect - Databricks INR 2000K-2040KAPI | AWS | AWS CodeCommit | AWS Glue | AWS LambdaSenior-level Full TimeIN KA Bengaluru, India1d ago