Data Platform Architect (Microsoft Fabric)
Tasks
- Apply DataOps and CI CD for pipeline automation
- Apply data vault modeling
- Build data pipelines using Data Factory
- Build data pipelines using Dataflow Gen2
- Catalog data assets
- Define data platform architecture
- Design Snowflake schemas
- Design scalable, secure data solutions
- Design star schemas
- Develop ETL ELT full loads
- Develop ETL ELT incremental loads
- Develop semantic models for Power BI
- Ensure regulatory compliance
- Implement data governance security compliance
- Implement medallion architecture
- Implement partitioning and indexing strategies
- Integrate and transform data into lakehouse and data warehouse
- Manage metadata and data lineage
- Optimize cost for data platforms
- Optimize semantic models for analytics
- Provide AI ML integration guidance
- Support AI ML readiness for feature stores and model pipelines
- Support batch and real-time processing
- Tune pipeline storage and query performance
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | CI/CD | Cost Optimization | Data Factory | Data Governance | Data Lineage | Data Quality | Data Security | Data Vault | Data Warehouse | DataOps | Dataflow Gen2 | Delta Lake | Dimensional Modeling | ELT | ETL | GDPR | HIPAA | Indexing | Kimball | Lakehouse | Medallion Architecture | Metadata Management | Microsoft Fabric | Parquet | Partitioning | Power BI | PySpark | SQL | Spark
Education
N/A
Related jobs
-
Data Engineering Manager INR 1500K-2500KADLS | Access Management | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India7h ago
-
GCP Data Engineer - Associate Director INR 800K-2000KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CDMid-level Full TimeHyderabad, Telangana, India7h ago
-
Staff Engineer, Data Analytics Engineering INR 2500K-3500KAPIs | AWS Glue | AWS Lambda | AWS S3 | Amazon BedrockSenior-level Full TimeBengaluru, KA, India10h ago
-
Data Engineer (GCP) INR 1500K-2040KAPIs | Airflow | Authentication | Authorization | BigQueryAgile collaboration | Autonomy | Flexible environmentMid-level Full TimePune, Maharashtra, India12h ago
-
Associate Specialist - Cloud & Application Engineering INR 800K-1000KAWS | Azure | Cloud Data | Cloud Data Platforms | Cloud platformMid-level Full TimeMumbai, Maharashtra, India13h ago
-
Associate Principal Engineer, Data Engineer (Enterprise Data Architecture- Banking domain) INR 1500K-2500KArdoq | Cloud Data | Cloud Data Platforms | Collibra | Data ArchitectureMid-level Full TimeRemote, India R13h ago
-
Ardoq | Bird | CCR | Collibra | Data ArchitectureMid-level Full TimeRemote, India R13h ago
-
Data Engineer INR 850K-1500KAirflow | Apache Spark | Cloud Computing | Data Modeling | Data WarehousingEasy public transit access | Generous paid leave | In office collaboration culture | Insurance and health benefitsMid-level Full TimeBengaluru14h ago
-
Senior Software Engineer, Data Engineering INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Data Modeling | Data PipelinesAccident insurance | Commuter benefits | Dental benefits | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India15h ago
-
Senior-level Full TimeBengaluru, KA, India15h ago
-
Data Platform Engineer INR 1000K-2000KAWS | Data Modeling | Data Warehouse | Data integration | ETLMid-level Full TimeBengaluru, BDC7A, India19h ago
-
Mid-level Full TimeBengaluru, BDC14A, India19h ago
-
Infra Tech Support Practitioner INR 1000K-1820KAKS | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSMid-level Full TimePune, PDC3C, India19h ago
-
Data Engineer INR 1000K-2000KAWS | Agile | Azure | Cloudera | Data ModelingFlexible work options | Inclusive cultureMid-level Full TimeNoida, UP, IN19h ago
-
Data Engineer INR 1500K-2000KBuild tool | Data Build | Data Build Tool | Data Pipeline Architecture | Data QualityMid-level Full TimeHyderabad, HDC3B, India19h ago
-
Data Engineer INR 3000K-4000KAgile | Azure Data | Azure Data Factory | Bash | CollibraFlexible working options | Health and wellbeing services | Hybrid work | Workplace inclusionSenior-level Full TimeBengaluru, IN19h ago
-
Data Engineer INR 1500K-2000KBuild tool | Cloud Data | Cloud Data Storage | Data Build | Data Build ToolMid-level Full TimePune, PDC2C, India19h ago
-
Data Platform Engineer INR 1400K-2000KCypher | Data Governance | Data Modeling | Data Retrieval | Data SecurityMid-level Full TimePune, PDC3C, India19h ago
-
DE-RCE-Risk Data Engineer Sr-GDSN02 INR 1500K-2700KAWS | Agile methodologies | Azure | CI/CD | Data EngineeringCoaching | Continuous learning | Inclusive cultureMid-level Full TimeBengaluru, KA, IN, 56001619h ago
-
Data Engineer – Specialist INR 1500K-2500KAWS | AWS Glue | Amazon Kinesis | Amazon S3 | Apache AirflowEmployee assistance programme | Flexible schedules | Health insurance | Holiday purchase scheme | Parental leaveSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …19h ago
-
Data Engineer – Specialist INR 2000K-3000KAWS | Ataccama | Atlan | CI/CD | Data CatalogEmployee assistance programme | Flexible schedules | Health insurance | Holiday purchase scheme | Parental leaveSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …19h ago
-
Apache Airflow | Apache Spark | BigQuery | CI/CD | Cloud FunctionsAccident insurance | Best in class leave policy | Childcare assistance reimbursement | Employee assistance program | Gender neutral parental leaveExecutive-level Full TimePune - Margarpatta, India19h ago
-
Principal Data Engineer, Data Products INR 3000K-4200KAWS | AWS Athena | AWS EMR | AWS Glue | AWS TerraformSenior-level Full TimePune, India19h ago
-
Mid-level Full Time(HE)Office Commerzone, India19h ago
-
Sr Data Engineer (Bangalore candidates only) INR 2040K-3380KAgile methodology | Apache Spark | Azure Data | Azure Data Explorer | Azure Data FactorySenior-level Full TimeIN Virtual, India R19h ago