Data Architect
Bengaluru, BDC6F, India
INR 2400K-3000K (estimate) Senior-level Full Time
Tasks
- Build SQL dashboards for KPIs and pipeline monitoring
- Build data transformation and validation logic
- Configure Delta Lake medallion layering
- Define data requirements and structure
- Develop ETL ETL pipelines using Databricks
- Implement ingestion patterns with Auto Loader
- Implement secure access with external locations and volumes
- Integrate analytics tools with Databricks using JDBC and ODBC
- Model and design data storage and integration
- Package and deploy pipelines with Databricks Asset Bundles and CI CD
- Prepare Gen AI compatible datasets with vector search and feature store
- Set up Unity Catalog for secure data governance
- Troubleshoot and optimize jobs for performance and cost efficiency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Spark | Asset bundles | Auto Loader | Azure | CI/CD | DLT | Data Modeling | Data Warehousing | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Vector Search | Delta Lake | Delta Sharing | Feature Store | GCP | GitHub | GitLab | JDBC | Looker | MLflow | ODBC | PII masking | Photon | Power BI | PySpark | Python | Serverless computing | Tableau | Unity Catalog | Vector Search
Education
N/A
Roles
Related jobs
-
Architect, Data Management INR 1500K-2800KAWS | Cloud platform | Data Modeling | Data Quality | Data SecuritySenior-level Full TimeBangalore, India12h ago
-
Data Architect INR 2600K-3380KAgile | Architecture governance | Architecture standards | Behavior-Driven Development | CI/CDDiversity and inclusion | Remote WorkingSenior-level Full Timehyderabad, India22h ago
-
Solution Architect - Data Platform Modernization INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, KA, IN22h ago
-
Data Engineering Lead Analyst -= HIH - Evernorth INR 1500K-2500KAWS Glue | AWS RDS | Access Control | Amazon Athena | Amazon RedshiftMentorship | Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R22h ago
-
Staff AI Solution Architect INR 2000K-4500KAWS | Artificial Intelligence | Automation | Cloud Computing | Data analyticsRelocation assistance providedSenior-level Full TimeBengaluru, India22h ago
-
Data Architect INR 2400K-3000KApache Airflow | Asset bundles | Auto Loader | Bronze Silver Gold | CI/CDSenior-level Full TimeBengaluru, BDC6F, India22h ago
-
Data Architect INR 3000K-4000KCloud Storage | Data Modeling | Data integration | Databricks | PythonSenior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Data Architect INR 3000K-4000KCloud Computing | Data Architecture | Data Modeling | Data Pipelines | Data StorageSenior-level Full TimePune, PDC3C, India22h ago
-
Senior-level Full TimeHyderabad, HDC4A, India22h ago
-
Data Architect INR 3000K-4000KCloud Data | Cloud Data Platforms | Data Governance | Data Modeling | Data integrationSenior-level Full TimeIndore, INDC1A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Data Architect INR 2400K-3000KApache Spark | Asset bundles | Auto Loader | CI/CD | DLT ExpectationsSenior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Data Architect INR 2400K-3000KAsset bundles | Auto Loader | CI/CD | DLT Expectations | Data ModelingSenior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago
-
Senior-level Full TimeBengaluru, BDC6F, India22h ago
-
Senior-level Full TimeBengaluru, BDC11A, India22h ago