Databricks Architect
IN319 - IND Bangalore Electronic City - INA7, INES, INET (IN319), India
INR 1500K-2400K (estimate) Senior-level Full Time
Tasks
- Architect and implement Databricks data platforms
- Build ingestion patterns for APIs streaming and batch
- Build scalable ETL ETL pipelines with Spark and Delta Lake
- Design Lakehouse solutions on Azure
- Enforce schema and partition strategies
- Establish CI CD and infrastructure as code with Terraform
- Implement cluster sizing autoscaling and job scheduling
- Implement data governance access control and lineage with Unity Catalog and Azure Purview
- Implement incremental and CDC strategies and idempotent pipelines
- Mentor engineering teams on best practices and operational runbooks
- Model data using medallion architecture
- Optimize Spark jobs for performance and cost
- Set up monitoring and observability for Databricks pipelines
Perks/Benefits
- Flexible work model
- In-person collaboration
- Inclusive environment
- Productivity support
- Wellbeing support
Skills/Tech-stack
Access Control | Azure | Azure Data | Azure Data Governance | Azure Purview | Batch Processing | CI/CD | Change Data Capture | DBT | Data Capture | Data Governance | Data Lineage | Databricks | Delta Lake | ELT | ETL | Idempotent Pipelines | Incremental processing | Infrastructure as Code | Lakehouse | Medallion Architecture | Monitoring | Observability | Python | SQL | Spark | Streaming Data | Terraform | Unity Catalog | “as-code”
Education
N/A
Roles
Related jobs
-
AVP, GenAI Enterprise Architect INR 2000K-4800KAI Governance | API Integration | Adversarial attack | Adversarial attack mitigation | Attack mitigationSenior-level Full TimeGurugram, Haryana, India1d ago
-
Assoc. Dir ,SAP Data and Analytics Tech Architecture INR 3000K-4000KABAP Core Data Services | AI machine learning | APIs | Analytics Cloud | Batch Data ProcessingSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …1d ago
-
Solutions Architect INR 8000K-15000KAI orchestration | API Design | Agent-based | Agent-based systems | CI/CDSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Build_MS_AG_CA_AI_1 INR 1500K-2500KAWS Glue | AWS Lambda | AWS Redshift | Amazon S3 | CI/CDFlexible work arrangements | In-person collaboration | Inclusive work environment | Productivity support | Wellbeing supportSenior-level Full TimeIND Noida - A-44/45 Noida Towers …1d ago
-
Senior-level Full TimeIN-TN-Chennai2d ago
-
Cloud Data Architect (With AI experience) INR 2000K-5000KAWS | Access Control | Attribute-Based Access Control | Attribute-based access | Audit LoggingSenior-level Full TimeIndia2d ago
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Azure | CassandraBootcamp training | Broadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certificationsSenior-level Full TimeIndia - Remote R2d ago
-
Solutions Architect (Lakebase) INR 1500K-2500KAWS | Azure | Backup and Recovery | Cloud platform | Data EngineeringSenior-level Full TimeBengaluru, India2d ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | C#Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India2d ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | C#Flexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeGurugram 10 C, India2d ago
-
EY - GDS Consulting - AIA -Generative AI - Senior INR 1960K-3300KAWS CloudFormation | Amazon Web Services | Apache Spark | Azure | Azure DevOpsCoaching and Mentorship | Continuous learning | Diverse and inclusive culture | Tools and flexibilitySenior-level Full TimeKolkata, WB, IN, 7000912d ago
-
Technical Architect - Cloud - MariaDB DBA, MySQL, Oracle, Backup/Restore, Patching, Performance Troubleshooting INR 1500K-2750KBackup and Recovery | Disaster Recovery | Galera Cluster | High Availability | IndexingSenior-level Full TimeBangalore, India2d ago
-
Large Language Model Architect INR 2500K-4800KAgentic Workflow | Cost estimation | Data Preprocessing | Deep learning | Distributed SystemsSenior-level Full TimeHyderabad, HDC3C, India2d ago
-
Amazon Web Services | Apache Spark | Azure Data | Azure Data Engineering | Code reviewExecutive-level Full TimeBengaluru Millenia, India2d ago
-
A/B | A/B Testing | Agentic AI | AutoGPT | B testingFlexible Working Program | Inclusive benefits | Mentorship | Wellbeing supportExecutive-level Full TimeMumbai Goregaon, India2d ago
-
Architect / Consultant in Data Analytics, Datasphere & AI Domain - Bangalore/Gurgaon INR 2000K-3300KAmazon Web Services | Analytics | Analytics Cloud | Artificial Intelligence | Big DataSenior-level Full TimeGurgaon, IN, 1220022d ago
-
Analytics & GenAI Architect-Life Sciences Technology INR 2500K-5000KAPI Development | Agent systems | CI/CD | Embeddings | Function CallingCompetitive compensation | Flexible benefits packageSenior-level Full TimeGH Office: Hyderabad, India2d ago
-
Lead Product AI Data Engineer & Architect INR 2000K-4000KAWS | Apache Airflow | Cloud platform | DBT | Data WarehousingEqual employment opportunity | Full-time employment | Hybrid working environmentSenior-level Full TimeR131-Bangalore, India2d ago
-
Cloud & Data Platform Architect INR 2000K-4000KAWS | Alerting | Audit controls | Automated testing | AzureFlexible benefits packageSenior-level Full TimeGH Office: Hyderabad, India2d ago
-
AWS | Amazon Web Services | Azure | Data Architecture | Data EngineeringFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportExecutive-level Full TimeBengaluru Millenia, India2d ago
-
AI Architect INR 3000K-5000KAI Safety | API Integration | Agentic Workflows | Artificial Intelligence | CI/CDSenior-level Full TimeGurugram, Haryana, India2d ago
-
Senior-level Full TimeIN-TN-Chennai3d ago
-
AWS Data Engineer INR 1500K-6000KAWS | Automation | Cloud Architecture | Data Governance | Data IngestionExecutive-level Full TimeHyderabad, Telangana, India3d ago
-
EY-GDS Consulting-AI And DATA-Data Engineering-Manager INR 1500K-2000KAWS | AWS Glue | AWS Lambda | AWS Secrets | AWS Secrets ManagerMid-level Full TimeTrivandrum, KL, IN, 6955813d ago
-
IN_Manager_Agentic + Gen AI__AI-50_ Advisory_ Bangalore INR 1500K-2500KAgentic AI | AutoGPT | C# | C++ | CI/CDMid-level Full TimeBengaluru Millenia, India3d ago