Data Architect
INR 2400K-3000K (estimate) Senior-level Full Time
Tasks
- Build data transformation and validation logic
- Build secure, observable DLT pipelines
- Configure Unity Catalog for secure access and PII masking
- Define data requirements and structure
- Develop ETL ELT pipelines with Databricks
- Implement ingestion patterns with Auto Loader
- Integrate BI tools with Databricks using Unity Catalog security
- Model and design data storage and integration
- Package and deploy pipelines with Databricks Asset Bundles CI CD
- Prepare Gen AI compatible datasets with vector embeddings
- Troubleshoot and optimize data processing jobs for cost and SLA
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Kafka | Auto Loader | Azure | CI/CD | DLT Expectations | Data Modeling | Data Warehousing | Databricks | Databricks Feature Store | Delta Lake | Delta Live Tables | Delta Live) | Delta Sharing | Feature Store | GCP | GitHub | GitLab | JDBC | Looker | MLflow | Medallion Architecture | ODBC | PII masking | Photon | Power BI | PySpark | Python | SQL | Serverless computing | Tableau | Unity Catalog | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Architect, Data Management INR 1500K-2800KAWS | Cloud platform | Data Modeling | Data Quality | Data SecuritySenior-level Full TimeBangalore, India10h ago
-
Data Architect INR 2600K-3380KAgile | Architecture governance | Architecture standards | Behavior-Driven Development | CI/CDDiversity and inclusion | Remote WorkingSenior-level Full Timehyderabad, India21h ago
-
Solution Architect - Data Platform Modernization INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, KA, IN21h ago
-
Data Engineering Lead Analyst -= HIH - Evernorth INR 1500K-2500KAWS Glue | AWS RDS | Access Control | Amazon Athena | Amazon RedshiftMentorship | Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R21h ago
-
Staff AI Solution Architect INR 2000K-4500KAWS | Artificial Intelligence | Automation | Cloud Computing | Data analyticsRelocation assistance providedSenior-level Full TimeBengaluru, India21h ago
-
Data Architect INR 2400K-3000KApache Airflow | Asset bundles | Auto Loader | Bronze Silver Gold | CI/CDSenior-level Full TimeBengaluru, BDC6F, India21h ago
-
Data Architect INR 3000K-4000KCloud Storage | Data Modeling | Data integration | Databricks | PythonSenior-level Full TimeBengaluru, BDC6F, India21h ago
-
Senior-level Full TimeBengaluru, BDC6F, India21h ago
-
Senior-level Full TimeBengaluru, BDC6F, India21h ago
-
Senior-level Full TimeBengaluru, BDC6F, India21h ago
-
Data Architect INR 3000K-4000KCloud Computing | Data Architecture | Data Modeling | Data Pipelines | Data StorageSenior-level Full TimePune, PDC3C, India21h ago
-
Senior-level Full TimeHyderabad, HDC4A, India21h ago
-
Data Architect INR 3000K-4000KCloud Data | Cloud Data Platforms | Data Governance | Data Modeling | Data integrationSenior-level Full TimeIndore, INDC1A, India21h ago
-
Senior-level Full TimeBengaluru, BDC11A, India21h ago
-
Senior-level Full TimeBengaluru, BDC11A, India21h ago
-
Senior-level Full TimeBengaluru, BDC11A, India21h ago
-
Senior-level Full TimeBengaluru, BDC11A, India21h ago
-
Senior-level Full TimeBengaluru, BDC11A, India21h ago
-
Data Architect INR 2400K-3000KApache Spark | Asset bundles | Auto Loader | CI/CD | DLT ExpectationsSenior-level Full TimeBengaluru, BDC6F, India21h ago
-
Senior-level Full TimeBengaluru, BDC6F, India21h ago
-
Senior-level Full TimeBengaluru, BDC6F, India21h ago
-
Data Architect INR 2400K-3000KAsset bundles | Auto Loader | CI/CD | DLT Expectations | Data ModelingSenior-level Full TimeBengaluru, BDC11A, India21h ago
-
Senior-level Full TimeBengaluru, BDC11A, India21h ago
-
Senior-level Full TimeBengaluru, BDC6F, India21h ago
-
Senior-level Full TimeBengaluru, BDC11A, India21h ago