Databricks & GCP Data Platform Architect

Hyderabad, //TS, India

INR 1500K-2040K (estimate) Senior-level Full Time

@ S...

Apply Save

Found 1mo ago

Tasks

Build CI CD pipelines for Databricks notebooks jobs and configs
Build Delta Lake bronze silver gold data layers
Build Spark jobs and Databricks notebooks
Build batch pipelines using Spark and Databricks
Build streaming pipelines using Spark and Databricks
Conduct architecture and code reviews
Configure access control with GCP IAM
Design end to end Databricks Lakehouse architecture on GCP
Enable audit logging lineage and data classification
Implement Databricks workspaces clusters jobs workflows
Implement Unity Catalog governance
Implement infrastructure as code with Terraform
Implement ingestion pipelines from PubSub and Kafka
Implement ingestion pipelines from databases and enterprise applications
Mentor data engineers with code level support
Optimize Spark performance and Databricks costs
Provide production support and root cause analysis
Set up VPC and private endpoints
Set up monitoring alerting and dashboards
Translate business requirements into implemented solutions
Troubleshoot pipeline failures and production issues

Perks/Benefits

Skills/Tech-stack

Education

N/A

Roles

Apply Save

Language: en Views:

2 Clicks:

3 Saves: 0

Related jobs

SSE_Analytics Enablement INR 2250K-5000K

AI/ML | Alteryx | Analytics engineering | Architecture Review | Automation

Senior-level Full Time

110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India

10h ago
SSE_Analytics Enablement INR 2250K-5000K

Alteryx | Architecture Review | Artificial Intelligence | CI/CD | Code Automation

Senior-level Full Time

110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India

10h ago
Data Engineer INR 1500K-2000K

AWS | Access Control | Airflow | CI/CD | DBT

Senior-level Full Time

Pune

10h ago
Data Engineer INR 1000K-1000K

Apache Airflow | Apache Spark | BigQuery | CI/CD | Cloud Build

Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time off

Mid-level Full Time

Chennai, TN, India

11h ago
Data Engineer INR 1500K-3000K

API Development | AWS | Amazon Kinesis | Amazon Redshift | Azure

Community volunteering opportunities | Discounted gym memberships | Flexible working | Life assurance | Medical insurance

Mid-level Full Time

Hyderabad, India

15h ago
ML Engineer (Must have- Python & R), Pune candidates preferred INR 2500K-3356K

AWS | Azure | Code Documentation | Confluence | Distributed Systems

Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off

Senior-level Full Time

Pune, MH, India

15h ago
GCP Data Engineer / Consultant Specialist INR 1500K-2000K

Airflow | Alerting | Apache Beam | Automation | BigQuery

Flexible working | Inclusive workplace | Opportunities for growth | Professional development

Mid-level Full Time

Pune, Maharashtra, India R

17h ago
Senior AI Testing Engineer (Generative AI) INR 2000K-3300K

AI Agents | API Testing | AWS | Azure | CI/CD

Senior-level Full Time

Bangalore North, India

17h ago
Data Architect INR 1500K-2500K

Batch Processing | CI/CD | Cluster management | Cost Optimization | Data Engineering

Senior-level Full Time

Coimbatore, India

18h ago
AI Engineer INR 2500K-5000K

AWQ | Access Control | Air Gapped Computing | Air-gapped | Autogen

Senior-level Full Time

IN-KA-Bangalore

18h ago
AI Engineer INR 2500K-5000K

AWQ | Autogen | C++ | CI/CD | CUDA

Senior-level Full Time

IN-KA-Bangalore

18h ago
Data Science and Tech Lead AMEA INR 2000K-3500K

AWS | Agile | Amazon Bedrock | Amazon SageMaker | CI Pipelines

Senior-level Full Time

Pune, ASIA, India

18h ago
Assistant Manager- AI Engineer INR 1500K-2800K

AWS | Autogen | Azure | Claude | Cloud platform

Mid-level Full Time

Bangalore, Karnataka, India

19h ago
Assistant Manager- AI Engineer INR 1500K-2800K

AWS | Autogen | Azure | Claude | Cloud platform

Mid-level Full Time

Bangalore, Karnataka, India

19h ago
Assistant Manager- AI Engineer INR 1500K-2800K

Amazon Web Services | Anthropic Claude | Autogen | Azure | Cloud platform

Mid-level Full Time

Bangalore, Karnataka, India

19h ago
Consultant - Python Developer with Gen AI INR 1500K-2200K

AI Search | Agile | Azure | Azure OpenAI | CSS

Mid-level Full Time

Bangalore, Karnataka, India

19h ago
Practice Customer Engineer, Gen AI, Telecom or FSI INR 1800K-3300K

AI Agent Development Kit | API Gateway | Agent Development Kit | Agentic AI | Audit Logging

Senior-level Full Time

Mumbai, Maharashtra, India

19h ago
Senior Software Engineer, AI/ML, AI Garage INR 2500K-4800K

Apache Beam | BigQuery | Cause analysis | Data Processing | Dataflow

Senior-level Full Time

Hyderabad, Telangana, India

19h ago
Data Engineer, YouTube INR 800K-1400K

Apache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data Architecture

Mid-level Full Time

Bengaluru, Karnataka, India

19h ago
Practice Customer Engineer, GenAI, Public Sector, Google Cloud INR 2000K-3300K

APIs | Agentic AI | Audit Logging | Cloud Networking | Cloud infrastructure

Senior-level Full Time

Gurgaon, Haryana, India; Bengaluru, Karnataka, India

19h ago
Practice Customer Engineer, GenAI, Manufacturing, Google Cloud INR 2000K-3300K

AI Agents | Audit Logging | Cloud Architecture | Cloud Computing | Distributed tracing

Conference participation | Professional development | Technical stakeholder exposure | Travel opportunities

Senior-level Full Time

Mumbai, Maharashtra, India

19h ago
Forward Deployed Engineer, Generative AI, Google Cloud INR 1800K-3000K

API Integration | Agent systems | Cloud platform | CrewAI | Data Pipelines

Mid-level Full Time

Mumbai, Maharashtra, India; Bengaluru, Karnataka, India

19h ago
Senior Software Engineer, Cloud Bigtable INR 2000K-2500K

Bigtable | C++ | CI/CD | Cassandra | Consensus Protocols

Senior-level Full Time

Bengaluru, Karnataka, India

19h ago
Sr Devops Engineer INR 2000K-3200K

AWS | AWS CloudFormation | Access Control | Airflow | Amazon ECS

Documentation and standards | On-call rotation

Senior-level Full Time

Pune, Maharashtra, India

19h ago
Engineer - Embedded Automation QA INR 480K-1000K

API Testing | Agile | Azure DevOps | BACnet | Behavior-Driven Development

Mid-level Full Time

Hadapsar, Pune, Maharashtra, IND, 411013

20h ago

Databricks & GCP Data Platform Architect

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs