Data Architect
INR 2400K-3000K (estimate) Senior-level Full Time
Tasks
- Build Delta Lake transformations and validation logic
- Build Gen AI compatible datasets with vector embeddings
- Build secure and observable DLT pipelines
- Configure Unity Catalog access and masking
- Create Power BI Tableau Looker dashboards
- Define data requirements and structure
- Develop ETL/ELT pipelines
- Implement Auto Loader ingestion with schema evolution
- Integrate Delta Sharing for data exchange
- Model and design data storage and integration
- Package and deploy pipelines with Databricks Asset Bundles
- Troubleshoot and optimize jobs for cost and SLA
Perks/Benefits
- N/A
Skills/Tech-stack
Asset bundles | Auto Loader | CI/CD | DLT Expectations | Data Modeling | Data Warehousing | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks DLT | Databricks Feature Store | Delta Lake | Delta Live Tables | Delta Live) | Delta Sharing | Feature Store | JDBC | Looker | MLflow | Medallion Architecture | ODBC | Photon Engine | Power BI | PySpark | Python | SQL | Serverless computing | Tableau | Unity Catalog | Unity Catalog External Locations | Unity Catalog Volumes | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Architect, Data Management INR 1500K-2800KAWS | Cloud platform | Data Modeling | Data Quality | Data SecuritySenior-level Full TimeBangalore, India12h ago
-
Data Architect INR 2600K-3380KAgile | Architecture governance | Architecture standards | Behavior-Driven Development | CI/CDDiversity and inclusion | Remote WorkingSenior-level Full Timehyderabad, India22h ago
-
Solution Architect - Data Platform Modernization INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, KA, IN22h ago
-
Data Engineering Lead Analyst -= HIH - Evernorth INR 1500K-2500KAWS Glue | AWS RDS | Access Control | Amazon Athena | Amazon RedshiftMentorship | Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R22h ago
-
Staff AI Solution Architect INR 2000K-4500KAWS | Artificial Intelligence | Automation | Cloud Computing | Data analyticsRelocation assistance providedSenior-level Full TimeBengaluru, India22h ago
-
Data Architect INR 2400K-3000KApache Airflow | Asset bundles | Auto Loader | Bronze Silver Gold | CI/CDSenior-level Full TimeBengaluru, BDC6F, India22h ago
-
Data Architect INR 3000K-4000KCloud Storage | Data Modeling | Data integration | Databricks | PythonSenior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Data Architect INR 3000K-4000KCloud Computing | Data Architecture | Data Modeling | Data Pipelines | Data StorageSenior-level Full TimePune, PDC3C, India22h ago
-
Senior-level Full TimeHyderabad, HDC4A, India22h ago
-
Data Architect INR 3000K-4000KCloud Data | Cloud Data Platforms | Data Governance | Data Modeling | Data integrationSenior-level Full TimeIndore, INDC1A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Data Architect INR 2400K-3000KApache Spark | Asset bundles | Auto Loader | CI/CD | DLT ExpectationsSenior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago