Databricks - Technical Specialist-Data Engg
INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Apply RBAC ABAC access controls
- Architect data quality checks
- Build ADF orchestration workflows
- Build ingestion frameworks
- Collaborate with IT and business teams
- Design Gold dimensional models
- Develop ELT/ETL pipelines
- Enforce Unity Catalog standards and metadata policies
- Handle backward compatibility and impact analysis
- Implement Bronze to Silver transformations
- Implement Delta Lake features
- Implement PySpark transformations
- Implement data quality checks and validation
- Implement surrogate keys and SCD handling
- Integrate data from APIs and third party sources
- Manage Databricks clusters jobs notebooks CI CD
- Perform performance tuning and optimization
- Provide guidance and mentoring to engineers
- Translate Silver datasets into analytics ready models
Perks/Benefits
- N/A
Skills/Tech-stack
ABAC | ACID | Azure Data | Azure Data Factory | CI/CD | Caching | Data Factory | Data Quality | Data Validation | Databricks | Delta Lake | Dimension tables | Dimensional Modeling | ELT | ETL | Fact tables | Partitioning | PySpark | RBAC | SCD | SQL | Schema Enforcement | Schema evolution | Snowflake Schema | Star Schema | Surrogate keys | Time Travel | Unity Catalog
Education
N/A
Roles
Related jobs
-
Senior Software Engineer - Data Platform INR 2500K-3584KAWS | Agentic AI | Apache Airflow | Apache Druid | Apache FlinkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India R13h ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India1d ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE)1d ago
-
Senior-level Full TimeHyderabad, Noida, Chennai, India1d ago
-
Lead Salesforce Full Stack AI Engineer INR 3715K-5449KAPI Design | Agile | Apex | Automated testing | Azure DevOpsFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeBangalore, India1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India1d ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Senior-level Full TimeGurugram, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
AI Transformation Engineer INR 2000K-4408KAPI Integration | Agent Frameworks | Agents SDK | Automated testing | Backend DevelopmentMid-level Full TimeBengaluru, India1d ago
-
Senior Forward Deployed Engineer INR 1500K-2800KAI APIs | AWS | Apache Spark | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeBengaluru, India1d ago
-
Senior Data Engineer INR 3000K-4000KAmazon Web Services | Apache Spark | Cloud platform | Continuous Delivery | Data GovernanceSenior-level Full TimeBangalore, India; Chennai, India; Hyderabad, India; …1d ago
-
Data Engineer (GCP, Azure) INR 1500K-2500KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Data PipelinesSenior-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Applied AI/ML Senior Associate INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Engineer - Workflow INR 3715K-5000KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureSenior-level Full TimeIndia (Bengaluru)1d ago
-
Member of Technical Staff INR 3242K-4580KConcurrency | Containerization | Go | Idempotency | KubernetesCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeBangalore, India1d ago
-
Software Engineer, Data Science INR 1000K-2000KD3 | Data Governance | Data Modeling | Data Pipelines | ETLHealth and wellness programs | Time awayMid-level Full TimeBengaluru, KA, India R1d ago
-
Entry-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer 3 INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Continuous integration | Data CatalogMid-level Full TimePune, Maharashtra, India1d ago
-
Senior Consultant - Data Engineering-Data Analysis INR 2400K-3500KAWS Redshift | Confluence | ETL | Git | NumPySenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Lead Software Engineer - Java AWS Kafka INR 2500K-3500KAWS | Agile | Apache Kafka | CI/CD | CachingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN1d ago
-
Senior Database Engineer / Senior Consultant Specialist INR 2000K-3200KAccess Control | Backup and Recovery | BigQuery | CI/CD | CassandraSenior-level Full TimePune, Maharashtra, India R1d ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India1d ago