Databricks COE Lead
Hyderabad, Telangana, India
INR 2000K-3900K (estimate) Senior-level Full Time
Tasks
- Build reusable lakehouse frameworks accelerators
- Conduct technical reviews capability assessments skill development
- Define CoE vision roadmap governance operating model
- Define data modeling lakehouse marts feature engineering layers
- Define governance data lineage access control compliance
- Design batch and streaming data ingestion transformation
- Enable GenAI capabilities with Mosaic AI
- Enable ML and MLOps capabilities with MLflow Feature Store
- Establish Databricks CoE
- Implement scalable data pipelines with Spark Delta Lake Databricks workflows
- Implement security best practices RBAC IAM encryption secrets management
- Lead client workshops architecture reviews solution roadmaps
- Lead end to end Databricks lakehouse architecture
- Mentor engineering and architecture teams
- Optimize compute and storage cost performance
- Provide stakeholder advisory and executive communication
- Set up CI CD DevOps DataOps practices
- Standardize architecture patterns coding practices delivery methodologies
Perks/Benefits
- N/A
Skills/Tech-stack
Active Directory | Amazon Web Services | Apache Airflow | Apache Spark | Azure | Azure Active Directory | Azure Data | Azure Data Factory | Azure Event | Azure Event Hubs | Batch Processing | CI/CD | Cloud platform | DBT | Data Factory | Data Modeling | Data Pipelines | DataOps | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | DevOps | Encryption | Event Hubs | Feature Store | Google Cloud | Google Cloud Platform | IAM | Kafka | Lakehouse Architecture | Language Models | Large Language Models | MLOps | MLflow | PySpark | RBAC | SQL | Scala | Secrets management | Streaming processing | Structured Streaming | Terraform | Unity Catalog | Vector Databases | Web Services
Education
N/A
Related jobs
-
Technical Architect - (Java,AWS) INR 3740K-6500KAWS | AWS Lambda | AWS Step Functions | Amazon ECS | Amazon EKSFamily wellbeing benefits | Health insurance | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India16h ago
-
Knowledge Graph Engineering Lead INR 3500K-5000KAgile | Amazon Neptune | CI/CD | Data Governance | Data LineageFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R17h ago
-
Deputy Manager - Fraud Analytics & Monitoring INR 800K-1250KData Science | Data analytics | Excel | Machine Learning | PythonAnnual health checkup | Dental benefits | Group term life insurance | Inclusive health benefits | Learning and development programMid-level Full TimeGurugram, India18h ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Apache Kafka | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R19h ago
-
Manager - Data Engineering INR 700K-1500KAWS Glue | AWS S3 | Amazon EMR | Amazon Redshift | Apache KafkaCareer growth | Flexible benefits | Health and wellbeing support | Training opportunitiesMid-level Full TimeBengaluru, KA, India19h ago
-
Manager - Data and Analytics INR 700K-2000KCloud Computing | Data Analysis | Data Modeling | Data segmentation | ForecastingContinuous professional development | Flexible workingMid-level Full TimeBangalore, Karnataka, India R21h ago
-
Mid-level Full TimeBangalore, Karnataka, India22h ago
-
AI Solution Architect INR 4000K-6000KAI Ops | API Integration | Access Management | Agent Ops | Agent evaluationEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Vacation and holiday leaveSenior-level Full TimePUNE, MAHARASHTRA, India23h ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN1d ago
-
Senior Manager - Data Governance & Management INR 2817K-4132KAgile | Automation | Backlog Management | Compliance | Data GovernanceSenior-level Full TimeGurugram, HR, India1d ago
-
Senior Software Engineer – Data Platform (Tech Lead) INR 3000K-4000KAPI Design | Application Programming | Application Programming Interfaces | Automated testing | AzureFlexible working models | Sabbaticals | Training opportunitiesSenior-level Full TimeBengaluru, KA, India1d ago
-
Data Engineer INR 1200K-2500KAcceptance criteria | Business Process | Business Process Mapping | Business glossary | Data ModelingMid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Amazon Web Services | Analytics Cloud | Apache Hadoop | Apache Spark | Big DataSenior-level Full TimeBangalore, IN, 5600661d ago
-
EY - GDS Consulting - AI And DATA -AI Architect - Manager INR 4000K-5449KAI Foundry | AWS Bedrock | Access Control | Agentic AI | Artificial IntelligenceCareer development | Coaching | Feedback | Flexible work arrangements | Training opportunitiesSenior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Technical Architect - Azure/AWS + Snowflake Job INR 1500K-2500KAWS | Agile | Apache Spark | Azure Data | Azure Data FactoryAgile work environment | Flexible work arrangements | Learning and developmentSenior-level Full TimeHyderabad, IN1d ago
-
Manager Data Analytics INR 800K-1100KAI enablement | Artificial Intelligence | Automation | CAPA | Dashboard DevelopmentMid-level Full TimeBengaluru Luxor North Tower, India1d ago
-
Lead Data Engineer / Developer - Manager INR 2500K-4064KAWS | Airflow | Autosyss | Azure | CI/CDEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Senior Manager - Data Scientist (AMVC) INR 2500K-4400KAI Assistants | Actuarial valuation | Automation | Business Rules | Control OptimizationSenior-level Full TimeMumbai Central Avenue, India1d ago
-
Lead Engineer, Data & AI Engineering INR 1500K-2500KAmazon Redshift | Amazon S3 | Amazon Web Services | DBT | Data ModelingAgile team collaboration | Work from homeSenior-level Full TimeBangalore, India1d ago
-
Business Intelligence | Data Analysis | Data Integrity | Data Modeling | Data QualityFlexible work setting | Hybrid work model | Mentorship | Professional development | Work-life balanceSenior-level Full TimeGurugram 10 C, India1d ago
-
IN-Manager_ Data Architect_D&A_Advisory_PAN India INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Vice President - Data Architect INR 3000K-4000KData Architecture | Data Dictionary | Data Flow | Data Glossary | Data GovernanceSenior-level Full TimePune, Gera Commerzone SEZ, India1d ago
-
Executive-level Full TimePune, India1d ago
-
Lead AI Platform & Automation Engineer - GCP, Vertex AI, IBM Watsonx, MLFlow, Terraform INR 2500K-5000KC++ | CI/CD | Cloud Security | Cloud platform | Computer VisionSenior-level Full TimeIN - TDC 1 (IN110), India1d ago
-
Manager, Sofware Engineering, ITC INR 3520K-5500KAPI Development | AWS | Agentic coding | Amazon RDS | Apache AirflowSenior-level Full TimeINDIA TECHNOLOGY CENTER, India1d ago