Databricks & GCP Data Platform Architect

Hyderabad, //TS, India

INR 1500K-2040K (estimate) Senior-level Full Time

@ S...

Apply Save

Found 4d ago

Tasks

Build CI CD pipelines for Databricks notebooks jobs and configs
Build Delta Lake bronze silver gold data layers
Build Spark jobs and Databricks notebooks
Build batch pipelines using Spark and Databricks
Build streaming pipelines using Spark and Databricks
Conduct architecture and code reviews
Configure access control with GCP IAM
Design end to end Databricks Lakehouse architecture on GCP
Enable audit logging lineage and data classification
Implement Databricks workspaces clusters jobs workflows
Implement Unity Catalog governance
Implement infrastructure as code with Terraform
Implement ingestion pipelines from PubSub and Kafka
Implement ingestion pipelines from databases and enterprise applications
Mentor data engineers with code level support
Optimize Spark performance and Databricks costs
Provide production support and root cause analysis
Set up VPC and private endpoints
Set up monitoring alerting and dashboards
Translate business requirements into implemented solutions
Troubleshoot pipeline failures and production issues

Perks/Benefits

Skills/Tech-stack

Education

N/A

Roles

Apply Save

Language: en | Views: 2 | Clicks: 2 | Saves: 0

Related jobs

Python Developer INR 300K-420K

Agile | CSS | Git | HTML | JavaScript

Career growth | Health insurance | Performance bonuses | Professional development

Entry-level Full Time

Ahmedabad, India

20h ago
Data Engineer INR 1800K-2040K

API | Airflow | BigQuery | CI/CD | Composer

Hybrid work

Mid-level Full Time

Hyderabad, Telangana, India

20h ago
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-5000K

API Integration | Agent Development | Agent Development Kit | Agent systems | Cloud platform

Senior-level Full Time

Mumbai, Maharashtra, India; Bengaluru, Karnataka, India

22h ago
AWS With GenAI INR 1300K-1700K

API Gateway | AWS Fargate | AWS Glue | AWS IAM | AWS KMS

Remote Working | Work-life balance

Mid-level Full Time

Bangalore, KA, IN, 560100

1d ago
SR. DEVOPS ENGINEER and MLOps Engineer INR 2500K-3880K

AI Agents | AWS | Alerting | CI/CD | Chatbots

Community outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentives

Senior-level Full Time

Bangalore, KA, IN, 560076

1d ago
EY - GDS Consulting - AI And DATA - Azure Data Engineer - Senior INR 2520K-3500K

Agile | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory

Career development opportunities | Flexible working | Support coaching feedback

Senior-level Full Time

Hyderabad, TG, IN, 500081

1d ago
Data Engineer II - Hyderabad (Hybrid) INR 1500K-1890K

API Design | Azure Data | Azure Data Factory | Azure Databricks | CI/CD

Mid-level Full Time

IND-Hyderabad-Hybrid, India R

1d ago
Data Engineer I -Hyderabad (Hybrid) INR 1500K-1500K

Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Data Factory

Mid-level Full Time

IND-Hyderabad-Hybrid, India R

1d ago
Sr Software Engineer (Distributed Systems) INR 2000K-2400K

Apache Iceberg | Apache Spark | C++ | Go | Java

Senior-level Full Time

IND.Chennai, India

1d ago
Data Scientist INR 2040K-2900K

BigQuery | CI/CD | Classification | Data Analysis | Databricks

Senior-level Full Time

Noida Berger Tower, India

1d ago
AVP, Model Ops Engineer (L10) INR 300K-400K

AWS | Airflow | Amazon Redshift | Apache Spark | Audit trails

Career advancement | Flexible work hours | Regional engagement hub workspace | Upskilling opportunities | Work from home

Executive-level Full Time

Remote Central Region IN, India R

1d ago
Senior DevOps Engineer (CI/CD & AI-Enabled Platform) INR 2542K-3500K

Agent systems | Bash | CI/CD | Cloud platform | Developer platforms

Buddy program | Internal mobility | International projects | Team events | Training opportunities

Senior-level Full Time

Pune

1d ago
Senior DevOps Engineer (CI/CD & AI-Enabled Platform) INR 2542K-3500K

Bash | CI/CD | Cloud platform | Distributed Systems | Docker

Buddy program | Internal mobility | International projects | Team events | Training opportunities

Senior-level Full Time

Pune

1d ago
DevOps Engineer (CI/CD & AI-Enabled Platform) INR 1800K-2800K

APIs | Bash | CI/CD | Certificates | Cloud platform

Buddy program | Internal mobility | International projects | Team events | Training opportunities

Mid-level Full Time

Pune

1d ago
DevOps Engineer (CI/CD & AI-Enabled Platform) INR 1800K-2800K

APIs | Artifactory | Bash | Bitbucket | CI/CD

Buddy program | Internal mobility | International projects | Team events | Training opportunities

Mid-level Full Time

Pune

1d ago
Senior Data Engineer (QA AI Automation) INR 2000K-2500K

Azure DevOps | CI/CD | CSS | Cypress | Defect Reporting

Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time off

Senior-level Full Time

Pune, MH, India

1d ago
Data Scientist INR 2500K-4000K

Artificial neural networks | Chunking | Data Structures | Deep learning | Embeddings

Senior-level Full Time

India

1d ago
Senior Data Engineer INR 2520K-4000K

AWS | Business Intelligence | Cloud platform | Data Modeling | Data Quality

Hybrid work | Professional development | Remote work

Senior-level Full Time

Delhi NCR/Remote R

1d ago
ML Ops INR 2500K-3000K

AWS | CI/CD | Datadog | Distributed Systems | Docker

Mid-level Full Time

Chennai, India

1d ago
Senior ML Engineer INR 2500K-3000K

AWS | Cloud Computing | Cloud platform | Data Pipelines | Docker

Senior-level Full Time

Chennai, India

1d ago
GenAI Engineer INR 1800K-2500K

AWS | Apache Spark | Artificial neural networks | Azure | Chunking

Mid-level Full Time

Noida, Uttar Pradesh, India

1d ago
Senior Data Engineer INR 3000K-4000K

AWS | AWS Data | AWS Data Services | Amazon Aurora | Apache Spark

Accreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount

Senior-level Full Time

Mumbai, MH, India

1d ago
Lead Data Engineer INR 2520K-3880K

API Integration | APIs | Airflow | Alerting | Attribution Models

Day off on third Friday monthly | Monthly office commute reimbursement | Monthly wellness reimbursement | Paid Maternity Leave | Paid paternity leave

Senior-level Full Time

Mumbai, MH, India

1d ago
Lead Consultant, ETL Data Engineer and Python INR 2520K-4000K

Data Governance | Data Modeling | Data Quality | Data Warehousing | Data integration

Senior-level Full Time

India-Bangalore

1d ago
Backend Engineer INR 1800K-4000K

AWS | Aggregation Framework | Apache Kafka | Azure | CAP Theorem

Senior-level Full Time

IN-TN-Chennai

1d ago

Databricks & GCP Data Platform Architect

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs