Chief Lakehouse Architect – Databricks CoE
Tasks
- Advise leadership and clients on Databricks cost strategies
- Define Databricks FinOps framework
- Define Databricks reference architectures
- Define Unity Catalog standards
- Design multi workspace Databricks platform architectures
- Lead Databricks migrations from legacy warehouses
- Mentor architects and senior engineers
- Optimize DBU usage
- Optimize cluster policies and auto scaling
- Optimize job scheduling
- Own Delta Lake standards
- Own medallion architecture standards
- Perform performance to cost optimization
- Review and approve Databricks deal architectures
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Amazon Web Services | Apache Spark | CI/CD | Cloud Computing | Cloud platform | Cluster autoscaling | Cost Optimization | DBU pricing | Data compaction | Databricks | Databricks Jobs | Databricks Workflows | Delta Lake | Google Cloud | Google Cloud Platform | Infrastructure as Code | Medallion Architecture | Microsoft Azure | Performance Tuning | Unity Catalog | Web Services | Z-Order | “as-code”
Education
N/A
Roles
Related jobs
-
Technical Architect - (Java,AWS) INR 3740K-6500KAWS | AWS Lambda | AWS Step Functions | Amazon ECS | Amazon EKSFamily wellbeing benefits | Health insurance | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India14h ago
-
Knowledge Graph Engineering Lead INR 3500K-5000KAgile | Amazon Neptune | CI/CD | Data Governance | Data LineageFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R15h ago
-
A/B | A/B Testing | API | Arbitration | B testingCareer development | Flexible working | Inclusive cultureMid-level Full TimeHyderabad, Telangana, India R18h ago
-
AI Solution Architect INR 4000K-6000KAI Ops | API Integration | Access Management | Agent Ops | Agent evaluationEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Vacation and holiday leaveSenior-level Full TimePUNE, MAHARASHTRA, India21h ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN22h ago
-
Amazon Web Services | Analytics Cloud | Apache Hadoop | Apache Spark | Big DataSenior-level Full TimeBangalore, IN, 5600661d ago
-
Technical Architect - Azure/AWS + Snowflake Job INR 1500K-2500KAWS | Agile | Apache Spark | Azure Data | Azure Data FactoryAgile work environment | Flexible work arrangements | Learning and developmentSenior-level Full TimeHyderabad, IN1d ago
-
IN-Manager_ Data Architect_D&A_Advisory_PAN India INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Lead AI Platform & Automation Engineer - GCP, Vertex AI, IBM Watsonx, MLFlow, Terraform INR 2500K-5000KC++ | CI/CD | Cloud Security | Cloud platform | Computer VisionSenior-level Full TimeIN - TDC 1 (IN110), India1d ago
-
Architect - python, nodejs, AI/ML INR 3584K-6000KAKS | Asynchronous Communication | Azure | Azure Monitor | CI/CDSenior-level Full TimePrimary location: Noida, Uttar Pradesh1d ago
-
Tech Lead - Data Solutions & Data Products INR 2000K-2700KAWS | Access Control | Alerting | Batch Processing | CI/CDEmployee assistance programme | Flexible schedule | Health insurance | Parental leave | Professional developmentSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …1d ago
-
AWS Data Architect INR 1500K-2700KAWS Glue | AWS Lambda | Amazon EMR | Amazon RDS | Amazon RedshiftSenior-level Full TimeBengaluru, India2d ago
-
Architect (Java, Kubernetes, AWS, Gen AI, Agentic AI) INR 3715K-5449KAPI Gateway | Advanced Analytics | AgenticAI | Amazon Web Services | Big DataFlexible work environment | Internal mobility | Volunteering opportunities | Well-being focus | Work-life balanceSenior-level Full TimeKA Bangalore, India3d ago
-
Senior AI Solution Architect INR 2500K-5000KAgent Orchestration | Agent systems | Agentic AI | Amazon Web Services | Bias detectionSenior-level Full TimeBengaluru, Karnataka, IND3d ago
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India3d ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R3d ago
-
GenAI LLM Python/Sr. Associate Director, Software Engineering INR 1500K-3000KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformFlexible working | Inclusive and diverse environment | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R3d ago
-
Mid-level Full TimeHyderabad, Telangana, India3d ago
-
Director-GTS - Build AI INR 1500K-6000KAWS | Adversarial Networks | Apache Kafka | Autogen | Autoregressive modelsExecutive-level Full TimeHyderabad, Telangana, India3d ago
-
Mid-level Full TimeHyderabad, Telangana, India3d ago
-
Senior-level Full TimeIND-Pune-Smartworks, India4d ago
-
AWS Bedrock | AWS Machine Learning | AWS Machine Learning Specialty | AWS Professional Solution Architect | Amazon RDSFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India4d ago
-
AWS Bedrock | AWS Professional Solution Architect | Amazon Aurora | Amazon RDS | Amazon SageMakerFlexible work arrangements | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India4d ago
-
AWS | AWS Bedrock | Amazon DynamoDB | Amazon SageMaker | AuroraFlexibility program | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India4d ago
-
AWS | AWS Bedrock | Amazon RDS | Amazon SageMaker | AuroraSenior-level Full TimeBengaluru Millenia, India4d ago