Senior Technical Specialist -Databricks (CTR)
Mumbai, Maharashtra, India
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Build CDC and incremental load pipelines
- Build conformed dimensions and fact tables
- Design dimensional models
- Develop data pipelines on Azure Databricks
- Ensure data reconciliation and audit accuracy
- Implement Delta Lake tables
- Implement change data capture pipelines
- Implement incremental processing
- Optimize distributed processing performance
- Translate SQL Server logic into Spark transformations
- Write PySpark transformations
- Write Spark SQL queries
Perks/Benefits
Skills/Tech-stack
Azure Databricks | CDC | Change Data Capture | DBT | Data Capture | Data Modeling | Data Warehousing | Declarative Pipelines | Delta Lake | Dimensional Modeling | Distributed Systems | Hash Key | Incremental processing | Performance optimization | PySpark | SQL Server | Spark SQL | Star Schema | Stored Procedures | Surrogate Key | Unity Catalog
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science
Roles
Related jobs
-
Mid-level Full TimeLocations: Hyderabad, Telangana, India7h ago
-
Staff Software Engineer, AI/ML and Moma Agentic INR 2500K-5000KArtificial Intelligence | C# | C++ | Database technologies | Distributed SystemsMentorshipSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Senior Staff Software Engineer, Google Cloud Storage INR 3200K-4000KArtificial Intelligence | Benchmarking | C++ | Cloud Storage | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Senior Manager of Software Engineering Analytics Platform INR 3000K-5000KAgile | Artificial Intelligence | CI/CD | Cloud Native | DatabricksSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Senior-level Full TimeHyderabad, TS, India10h ago
-
Data Engineer Advisor INR 3200K-4200KAlerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TG, IN12h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 1500K-3000KAI Governance | AI architecture | AI orchestration | APIs | AWSMid-level Full TimeIndia, India13h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2700KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India14h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2500KAPIs | Alerting | Data Augmentation | Data Lineage | Data ModelingSenior-level Full Timebangalore, India14h ago
-
Senior-level Full TimeMumbai, Maharashtra, India14h ago
-
AI Data Engineering and Sr Cloud Specialist INR 1500K-2500KApache Airflow | Apache Kafka | Apache Spark | Azure | CI/CDSenior-level Full Timebengaluru, India14h ago
-
Data Engineering and Cloud INR 1500K-2500KApache Airflow | Apache Kafka | Apache Spark | Azure | CCPASenior-level Full Timebengaluru , India14h ago
-
Senior Software Engineer INR 2475K-3465KCI/CD | Data Modeling | Exception Handling | FastAPI | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India15h ago
-
Data Scientist Lead - AI Solutions INR 3500K-5000KAWS | Azure | Computer Vision | Data Mining | Data WarehousingSenior-level Full TimeIndia15h ago
-
CDP,Snowflake,SQL,Java, API,AWS - (6-9 Yrs) - BLR INR 1500K-3500KAPI | AWS | Audience Activation | Audience Management | Customer DataSenior-level Full TimeIndia17h ago
-
Senior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …19h ago
-
Data Modeler INR 2520K-4000KAWS | Access Control | Azure | Cloud Data | Cloud data platformFlexible work arrangementsMid-level Full TimeNoida / Gurgaon, DL, IN19h ago
-
Mid-level Full TimeBengaluru, KA, IN19h ago
-
Senior-level Full TimeBangalore, KA, IN19h ago
-
SEI - Data Migration Engineer (IMS) (Expanded Resources) INR 2520K-3880KAirflow | Bulk Insert | CI/CD | Cx Oracle | DBT CoreSenior-level Full TimeBangalore, KA, IN19h ago
-
Technical Solution Consultant INR 2400K-3380KCloud platform | Data Modeling | Data integration | ELT | ETLEntry-level Full TimeBangalore, KA, IN19h ago
-
Databricks Engineer INR 2040K-3000KCloud Data | Cloud Data Engineering | Data Engineering | Data Pipeline Development | Data ReconciliationSenior-level Full TimeBangalore, KA, IN19h ago
-
Senior-level Full TimeBangalore, KA, IN19h ago
-
Data Engineer Senior Consultant INR 2400K-3380KBatch Processing | DBT | Data Engineering | Data Validation | Data WarehousingSenior-level Full TimeBangalore, KA, IN19h ago
-
AI Engineer INR 2000K-4000KAI Agents | AWS | Agent systems | Autogen | AzureEquity | Flexible work options | Wellness benefitsMid-level Full TimeBengaluru, Karnataka, India19h ago