Databricks architect
Tasks
- Build CI/CD pipelines
- Conduct customer solution workshops
- Define lakehouse architecture
- Design data pipelines
- Ensure operational excellence
- Establish data governance and security
- Implement data pipelines using Spark and Delta Lake
- Integrate Databricks with enterprise systems
- Mentor engineering teams
- Optimize Databricks performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Azure | Azure Event | Azure Event Hubs | CI/CD | Data Engineering | Data Lineage | Data Pipelines | Data Quality | Data orchestration | Databricks | Delta Lake | Event Hubs | Git | Infrastructure as Code | Kafka | Lakehouse Architecture | MLflow | PySpark | RBAC | SRE | Spark SQL | Structured Streaming | Unity Catalog | “as-code”
Education
Related jobs
-
Technical Architect - (Java,AWS) INR 3740K-6500KAWS | AWS Lambda | AWS Step Functions | Amazon ECS | Amazon EKSFamily wellbeing benefits | Health insurance | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India15h ago
-
Knowledge Graph Engineering Lead INR 3500K-5000KAgile | Amazon Neptune | CI/CD | Data Governance | Data LineageFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R16h ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Apache Kafka | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R17h ago
-
Manager - Data Engineering INR 700K-1500KAWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache KafkaCareer growth | Flexible benefits | Health and wellbeing support | Training opportunitiesMid-level Full TimeBengaluru, KA, India17h ago
-
A/B | A/B Testing | API | Arbitration | B testingCareer development | Flexible working | Inclusive cultureMid-level Full TimeHyderabad, Telangana, India R19h ago
-
AI Solution Architect INR 4000K-6000KAI Ops | API Integration | Access Management | Agent Ops | Agent evaluationEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Vacation and holiday leaveSenior-level Full TimePUNE, MAHARASHTRA, India22h ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN23h ago
-
Amazon Web Services | Analytics Cloud | Apache Hadoop | Apache Spark | Big DataSenior-level Full TimeBangalore, IN, 5600661d ago
-
EY - GDS Consulting - AI And DATA -AI Architect - Manager INR 4000K-5449KAI Foundry | AWS Bedrock | Access Control | Agentic AI | Artificial IntelligenceCareer development | Coaching | Feedback | Flexible work arrangements | Training opportunitiesSenior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Technical Architect - Azure/AWS + Snowflake Job INR 1500K-2500KAWS | Agile | Apache Spark | Azure Data | Azure Data FactoryAgile work environment | Flexible work arrangements | Learning and developmentSenior-level Full TimeHyderabad, IN1d ago
-
Lead Engineer, Data & AI Engineering INR 1500K-2500KAmazon Redshift | Amazon S3 | Amazon Web Services | DBT | Data ModelingAgile team collaboration | Work from homeSenior-level Full TimeBangalore, India1d ago
-
IN-Manager_ Data Architect_D&A_Advisory_PAN India INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Executive-level Full TimePune, India1d ago
-
Lead AI Platform & Automation Engineer - GCP, Vertex AI, IBM Watsonx, MLFlow, Terraform INR 2500K-5000KC++ | CI/CD | Cloud Security | Cloud platform | Computer VisionSenior-level Full TimeIN - TDC 1 (IN110), India1d ago
-
Data Engineering Lead Analyst - HIH - Evernorth INR 1500K-2500KAWS IAM | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon RDSSenior-level Full TimeHIH - Hyderabad, India1d ago
-
Architect - python, nodejs, AI/ML INR 3584K-6000KAKS | Asynchronous Communication | Azure | Azure Monitor | CI/CDSenior-level Full TimePrimary location: Noida, Uttar Pradesh1d ago
-
Data Engineering Consultant INR 2520K-3500KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure SQLSenior-level Full TimePrimary location: Hyderabad, Telangana1d ago
-
Senior Data Engineering Lead - Oracle Exadata DMA, ZDLRA INR 1500K-2700KASM | AWS | Ansible | Azure | Capacity PlanningCareer development opportunities | Comprehensive benefits | Inclusion-focused culture | On-call support | Shift workSenior-level Full TimePrimary location: Bengaluru, Karnataka1d ago
-
Tech Lead - Data Solutions & Data Products INR 2000K-2700KAWS | Access Control | Alerting | Batch Processing | CI/CDEmployee assistance programme | Flexible schedule | Health insurance | Parental leave | Professional developmentSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …1d ago
-
Sr. Spclst , Data Engineering INR 1971K-3220KAPI based ingestion | Amazon S3 | Batch Ingestion | Change Management | DBTHybrid work arrangementSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …1d ago
-
AWS Data Architect INR 1500K-2700KAWS Glue | AWS Lambda | Amazon EMR | Amazon RDS | Amazon RedshiftSenior-level Full TimeBengaluru, India2d ago
-
Data Engineering Consultant INR 980K-2000KAirflow | Apache Kafka | Azure Data | Azure Data Factory | Azure DatabricksCareer development opportunities | Comprehensive benefits | Inclusion-focused cultureMid-level Full TimePrimary location: Chennai, Tamil Nadu2d ago
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India3d ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R3d ago
-
Senior-level Full TimePune, MH, India3d ago