Databricks architect
Tasks
- Build CI/CD pipelines
- Conduct customer solution workshops
- Define lakehouse architecture
- Design data pipelines
- Ensure operational excellence
- Establish data governance and security
- Implement data pipelines using Spark and Delta Lake
- Integrate Databricks with enterprise systems
- Mentor engineering teams
- Optimize Databricks performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Azure | Azure Event | Azure Event Hubs | CI/CD | Data Engineering | Data Lineage | Data Pipelines | Data Quality | Data orchestration | Databricks | Delta Lake | Event Hubs | Git | Infrastructure as Code | Kafka | Lakehouse Architecture | MLflow | PySpark | RBAC | SRE | Spark SQL | Structured Streaming | Unity Catalog | “as-code”
Education
Related jobs
-
Amaze - Cloud Data Architect INR 1200K-2000KApache Airflow | Azure | Integration Services | Java | Power BISenior-level Full TimeIndia9h ago
-
Amaze - Cloud Data Architect INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia9h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure | Azure Databricks | Data Engineering | Data Factory | Data MigrationSenior-level Full TimeIndia9h ago
-
CLOUD AMAZE - DW Lead (Practice) INR 1500K-2500KAzure | Azure Databricks | Cloud Computing | Data Architecture | Data EngineeringSenior-level Full TimeIndia9h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure Databricks | Data Engineering | Data Factory | Data Migration | Data ModelingSenior-level Full TimeIndia9h ago
-
API Design | API Security | Data Pipelines | Docker | FaissSenior-level Full TimeChennai, TN, India15h ago
-
Sr. Delivery Solutions Architect INR 2500K-3100KBusiness Analysis | Consulting | Customer Success | Data Engineering | Distributed SystemsHybrid work | Travel 30 percentSenior-level Full TimeBengaluru, India15h ago
-
Lead Data Architect INR 1500K-2500KAWS | Agile | Amazon Redshift | Apache Spark | BigQueryRelocationSenior-level Full TimeIND - Bangalore, India19h ago
-
AlmaLinux | Application development | Automation | C# | C++Senior-level Full TimeIND Bangalore, India - WR19h ago
-
IN_Manager_Data Analyst_Digital Integration_Advisory_Kolkata INR 1400K-2300KAlation | Azure Data | Azure Data Services | Azure Purview | CollibraFlexible working | Inclusive benefits programs | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India19h ago
-
Director Data Engineering INR 3000K-6000KAPI Management | APIs | Azure API | Azure API Management | Azure DataExecutive-level Full TimeBangalore, India19h ago
-
IN_Manager_Data Analyst_Digital Integration_Advisory_Kolkata INR 1400K-2300KAlation | Azure Purview | Collibra | DBT | Data ModelingEmployee wellbeing support | Flexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India19h ago
-
AI | AWS | Analytics architecture | Azure | Cloud ArchitectureSenior-level Full TimeHyderabad, TG, IN, 50008119h ago
-
Techno Functional Data & Analytics Lead INR 1500K-2600KAI | AWS | Business Intelligence | Cloud platform | Customer SegmentationHybrid work model | Open to relocationSenior-level Full TimePerungudi, India1d ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileHybrid work modelSenior-level ContractShaikpet, India1d ago
-
Data Engineer II INR 1200K-1800K.NET | AWS | Azure | C# | CDISCClient onboarding support | Technical trainingMid-level Full TimeBangalore1d ago
-
Architect, Data Management INR 1500K-2800KAWS | Cloud platform | Data Modeling | Data Quality | Data SecuritySenior-level Full TimeBangalore, India1d ago
-
Data Architect INR 2600K-3380KAgile | Architecture governance | Architecture standards | Behavior-Driven Development | CI/CDDiversity and inclusion | Remote WorkingSenior-level Full Timehyderabad, India1d ago
-
Solution Architect - Data Platform Modernization INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, KA, IN1d ago
-
Senior-level Full TimeIND Bengaluru, India1d ago
-
Data Engineering Lead Analyst - HOH - Evernorth INR 1500K-2500KAWS Glue | AWS RDS | Amazon Athena | Amazon Redshift | Amazon S3Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R1d ago
-
Data Engineering Analyst - HIH - Evernorth INR 1000K-1500KAWS | Data Governance | Data Lake | Data Modeling | Data QualityFlex schedule N/A | Remote work flexibilityMid-level Full TimeHIH - Hyderabad, India R1d ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Associate Manager Data Engineering INR 1019K-1593KApache NiFi | Data Governance | Data Pipelines | Data Warehousing | Distributed SystemsMid-level Full TimeIN319 - IND Bangalore Electronic City …1d ago
-
AlmaLinux | Automation | BSP | C# | C++Senior-level Full TimeIND Bangalore, India - WR1d ago