Senior Technical Specialist -Databricks (CTR)
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Build CDC and incremental load pipelines
- Build conformed dimensions and fact tables
- Design dimensional models
- Develop data pipelines on Azure Databricks
- Ensure data reconciliation and audit accuracy
- Implement Delta Lake tables
- Implement change data capture pipelines
- Implement incremental processing
- Optimize distributed processing performance
- Translate SQL Server logic into Spark transformations
- Write PySpark transformations
- Write Spark SQL queries
Perks/Benefits
Skills/Tech-stack
Azure Databricks | CDC | Change Data Capture | DBT | Data Capture | Data Modeling | Data Warehousing | Declarative Pipelines | Delta Lake | Dimensional Modeling | Distributed Systems | Hash Key | Incremental processing | Performance optimization | PySpark | SQL Server | Spark SQL | Star Schema | Stored Procedures | Surrogate Key | Unity Catalog
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science
Roles
Related jobs
-
Senior-level Full TimePune, India4h ago
-
Mid-level Full TimeLocations: Hyderabad, Telangana, India8h ago
-
Staff Software Engineer, AI/ML and Moma Agentic INR 2500K-5000KArtificial Intelligence | C# | C++ | Database technologies | Distributed SystemsMentorshipSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Senior Staff Software Engineer, Google Cloud Storage INR 3200K-4000KArtificial Intelligence | Benchmarking | C++ | Cloud Storage | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Senior Manager of Software Engineering Analytics Platform INR 3000K-5000KAgile | Artificial Intelligence | CI/CD | Cloud Native | DatabricksSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Senior Software Engineer INR 2475K-5000K.NET | Agile | Artificial Intelligence | Azure Functions | Cloud servicesSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad10h ago
-
Senior-level Full TimeHyderabad, TS, India11h ago
-
Senior-level Full TimeHyderabad, Telangana, India11h ago
-
Mid-level Full TimeGurgaon, Haryana, India12h ago
-
Data Engineer Advisor INR 3200K-4200KAlerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TG, IN13h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 1500K-3000KAI Governance | AI architecture | AI orchestration | APIs | AWSMid-level Full TimeIndia, India14h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2700KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India15h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2500KAPIs | Alerting | Data Augmentation | Data Lineage | Data ModelingSenior-level Full Timebangalore, India15h ago
-
Senior-level Full TimeMumbai, Maharashtra, India15h ago
-
AI Data Engineering and Sr Cloud Specialist INR 1500K-2500KApache Airflow | Apache Kafka | Apache Spark | Azure | CI/CDSenior-level Full Timebengaluru, India15h ago
-
Data Engineering and Cloud INR 1500K-2500KApache Airflow | Apache Kafka | Apache Spark | Azure | CCPASenior-level Full Timebengaluru , India15h ago
-
Senior-level Full TimeIndia, Telangana, Hyderabad15h ago
-
Principal Consultant - Data & AI INR 3000K-4800KAgile | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeIndia, Telangana, Hyderabad; India, Karnataka, Bangalore; …15h ago
-
Senior Software Engineer INR 2475K-3465KCI/CD | Data Modeling | Exception Handling | FastAPI | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India16h ago
-
Site Reliability Engineer INR 3000K-4500KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeHyderabad16h ago
-
Data Scientist Lead - AI Solutions INR 3500K-5000KAWS | Azure | Computer Vision | Data Mining | Data WarehousingSenior-level Full TimeIndia16h ago
-
CDP,Snowflake,SQL,Java, API,AWS - (6-9 Yrs) - BLR INR 1500K-3500KAPI | AWS | Audience Activation | Audience Management | Customer DataSenior-level Full TimeIndia18h ago
-
Senior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …20h ago
-
Data Modeler INR 2520K-4000KAWS | Access Control | Azure | Cloud Data | Cloud data platformFlexible work arrangementsMid-level Full TimeNoida / Gurgaon, DL, IN20h ago
-
Mid-level Full TimeBengaluru, KA, IN20h ago