Data Architect
Tasks
- Build data engineering pipelines using Databricks
- Collaborate with business and data teams
- Configure clusters jobs workflows and repos
- Define medallion architecture
- Design Databricks Lakehouse architecture
- Design batch and streaming pipelines
- Develop PySpark and SQL transformations
- Implement CI CD pipelines for Databricks deployments
- Implement Delta Lake based data models
- Implement Unity Catalog governance model
- Lead code reviews and architecture reviews
- Optimize Databricks performance and cost
- Provide hands on support during development
Perks/Benefits
- N/A
Skills/Tech-stack
Batch Processing | CI/CD | Cluster management | Cost Optimization | Data Engineering | Data Modeling | Databricks | Delta Lake | Governance | Lakehouse | Medallion Architecture | Performance Tuning | PySpark | SQL | Streaming | Unity Catalog | Version control | Workflow Orchestration
Education
N/A
Roles
Related jobs
-
AI Solution Architect INR 2000K-4500KAPI Integration | AWS | Agentic Orchestration | Async workflows | AutogenSenior-level Full TimeBangalore North, India9h ago
-
Gen AI Developer Specialist INR 1800K-3000KA2A protocol | AI Governance | AWS Bedrock | Agent patterns | AutogenMid-level Full TimeIndia12h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-4500KAI Foundry | Agent Builder | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India16h ago
-
Sr Technical Lead-Data Engg INR 1500K-2040KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeINDIA - HYDERABAD - BIRLASOFT OFFICE, …22h ago
-
Data Architect, Master Data Management INR 3000K-4000KAPI Integration | Cloud Data | Cloud Data Architecture | Cloud Native | Cloud Native ArchitectureEmployee incentive programs | Flexible vacation | Flexible work arrangements | Headspace app access | Hybrid work modelSenior-level Full TimeIndia, Bengaluru, Karnataka R22h ago
-
Solution Architect - Data Engineer INR 1500K-2400KAWS | Apache Spark | CI/CD | Data Governance | Data LakehouseSenior-level Full TimePune, India22h ago
-
Principal Engineer - Data path - HPE Alletra Storage MP X10000 (Object Storage product development) INR 2486K-4000KAlgorithms | Block Storage | C# | C++ | CIFSSenior-level Full TimeBengaluru, Karnātaka, India22h ago
-
Senior-level Full TimePune, India22h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Functions | Azure OpenAIFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India22h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Functions | Branch ProtectionsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing support | Work-life balance programsSenior-level Full TimeBengaluru Millenia, India22h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Functions | CI/CDFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India22h ago
-
AI Platform Architect INR 2200K-4500KAI Foundry | AI ethics | API Integration | Agent Orchestration | Agentic AICollaborative culture | Hybrid working setup | Professional growth opportunitiesSenior-level Full TimeIND - Pune, India22h ago
-
Platform Architect - Data Platforms INR 3000K-5000KAWS | Access Control | Amazon Redshift | Compliance | Data GovernanceSenior-level Full TimePune DIA, India22h ago
-
Principal Engineer - Data path - HPE Alletra Storage MP X10000 (Object Storage product development) INR 2486K-4000KAlgorithms | Block Storage | C# | C++ | CIFSSenior-level Full TimeBengaluru, Karnātaka, India23h ago
-
Principal Engineer - Data path - HPE Alletra Storage MP X10000 (Object Storage product development) INR 2486K-4000KAlgorithms | Block Storage | C# | C++ | CIFSSenior-level Full TimeBengaluru, Karnātaka, India1d ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-4500KAI Foundry | Agent Orchestration | Ansible | Azure | Azure AISenior-level Full TimeBangalore, Karnataka, India1d ago
-
Solution Architect – Data & AI Solutions INR 3000K-4398KABAC | API Gateway | Access Management | Artificial Intelligence | Asynchronous WorkflowsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Gen AI Architect (ATC) INR 2000K-4000KAWS | Access Management | Amazon Bedrock | Amazon SageMaker | CI/CDSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior Data Architect INR 1500K-2800KAWS | AWS Database | AWS Database Migration Service | AWS database migration | Agentic AISenior-level Full TimeIN-AP-Hyderabad1d ago
-
Salesforce Agentforce AI Leads INR 2000K-4500KAPI Integration | Agentforce | Code review | Conversation Design | Data ModelingSenior-level Full TimeIndia1d ago
-
Data Architect INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Purview | Azure SynapseFlexible remote work 20 percent | Inclusive workplace | Office-first collaborationSenior-level Full TimeIN - Hyderabad, India R1d ago
-
Senior-level Full TimeIND19-01-Bengaluru-EPIP 122 (Phase II), India1d ago
-
Lead Java Big Data Engineer Vice President INR 2000K-3500KAWS | AWS Glue | Amazon EMR | Amazon S3 | Apache KafkaProfessional development resourcesSenior-level Full TimePLOT NO-1, S.NO. 77, India1d ago
-
Data Architect INR 3000K-4000KAWS | Agile | Azure | Behavior-Driven Development | CI/CDRemote WorkingSenior-level Full Timehyderabad, India1d ago
-
Principal Digital Architect INR 2000K-4800KArtificial Intelligence | Cloud Architecture | Cost Optimization | Generative AI | IntegrationSenior-level Full TimeChennai, Tamil Nadu, India1d ago