Databricks - Technical Specialist-Data Engg
INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Architect bronze to silver transformations
- Build ADF orchestration workflows
- Build ingestion pipelines
- Configure RBAC and ABAC access controls
- Design dimensional models
- Develop ELT/ETL workflows
- Develop Gold curated data models
- Enforce Unity Catalog standards
- Handle surrogate keys and SCD
- Implement Delta Lake features
- Implement PySpark transformations
- Implement data quality checks and schema validation
- Implement fact and dimension tables
- Integrate data from APIs and third party sources
- Manage CI/CD integrations
- Optimize Databricks jobs and clusters
- Provide mentoring and guidance
- Tune performance for joins and shuffle operations
Perks/Benefits
- N/A
Skills/Tech-stack
ABAC | APIs | Azure Data | Azure Data Factory | CI/CD | Data Factory | Data Quality | Databricks | Delta Lake | Delta Lake ACID | Dimensional Modeling | ELT | ETL | PySpark | Python | RBAC | SCD Type-2 | SQL | Schema Validation | Schema evolution | Snowflake Schema | Star Schema | Surrogate keys | Type 2) | Unity Catalog
Education
N/A
Roles
Related jobs
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India3h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India3h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India3h ago
-
Databricks Engineer - Senior/ Lead INR 1500K-2800KACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India4h ago
-
Mid-level Full TimeNoida R4h ago
-
AI / ML Data Scientist I INR 1000K-1890KAWS | Apache Spark | Artificial Intelligence | Cloud platform | ConfluenceMid-level Full TimeBengaluru, India5h ago
-
Lead - Data Platform Engineering INR 2500K-4500KAWS | Azure | Cloud Data | Cloud Data Platforms | Customer 360Senior-level Full TimeChennai, India5h ago
-
Software Engineer 2 INR 1500K-2500KAPI Design | AWS | Asynchronous Communication | Data Structures | Distributed SystemsMid-level Full TimeHybrid - Bangalore, India R6h ago
-
Lead Software Engineer (Full Stack) INR 506K.NET | AWS | Angular | Asynchronous programming | AzureRemote work flexibility | Supportive team culture | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India6h ago
-
Senior-level Full TimeBangalore, India R6h ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Managed Airflow | Airflow | Apache Spark | AzureMedical insurance | Remote-first workplace | Term Life and Personal Accident | Wellness allowanceSenior-level Full TimeIndia - Bangalore R6h ago
-
Airflow | Apache Spark | CI/CD | Contextual Bandits | Data DriftExposure to advanced ML technologies | Ownership across full ML lifecycle | Professional development | Supportive collaboration environmentSenior-level Full TimeIndia7h ago
-
Developer III INR 1400K-2500KAgile Scrum | Azure Data | Azure Data Factory | Cloud Storage | Cloud platformSenior-level Full TimeHitech City, TG, India7h ago
-
Senior Software Engineer - Data + AI Observability INR 1500K-3000KAIOps | AWS | Azure | C++ | Cloud platformSenior-level Full TimeBengaluru, India8h ago
-
Senior Data Engineer INR 3000K-4000KAmazon Web Services | Apache Spark | Cloud platform | Continuous Delivery | Data GovernanceSenior-level Full TimeBangalore, India; Chennai, India; Hyderabad, India; …8h ago
-
Data Engineer, Flex Analytics INR 1500K-2400KAWS Glue | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Data ArchitectureInclusive cultureEntry-level Full TimeHyderabad, Telangana, IND11h ago
-
Business Intelligence Engineer, Flex Analytics INR 2000K-2700KAmazon QuickSight | Amazon Redshift | Data Modeling | Data Visualization | Data pipelineEntry-level Full TimeHyderabad, Telangana, IND11h ago
-
Business Intelligence Engineer, Flex Analytics INR 2000K-2700KAWS DynamoDB | AWS EC2 | Amazon QuickSight | Amazon Redshift | Data ModelingMid-level Full TimeHyderabad, Telangana, IND11h ago
-
Data Engineer Sr. Consultant INR 2800K-4200KData Mapping | Data Reconciliation | Data Transformation | Data Validation | Defect TrackingSenior-level Full TimeChennai, TN, IN R11h ago
-
Mid-level Full TimeBengaluru, KA, IN R11h ago
-
Senior Machine Learning Engineer INR 5000K-7000KAgentic Workflows | Benchmarking | Caching | Cloud infrastructure | ContainerizationComprehensive benefits | High ownership | Mission-driven impact | Rapid iterationSenior-level Full TimeNoida, Uttar Pradesh, India11h ago
-
Technical Specialist-App Development INR 1200K-2800KAgentic AI | FastAPI | Graph RAG | Knowledge Graph RAG | Knowledge graphMid-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN11h ago
-
Platform Engineer INR 2500K-5000KAPI Design | Agentic Frameworks | Backend Development | Distributed Systems | Infrastructure as CodeFull autonomy | Remote workSenior-level Full TimeIndia - Remote R11h ago
-
Senior Staff - IT Data Engineering and Analytics INR 3000K-5000K.NET | API Management | ASP.Net Core | AWS | AirflowSenior-level Full TimeBangalore, India R1d ago
-
AI/ML Test Engineer - Immediate Joiners Only INR 400K-480KData Preprocessing | Data pipeline | End to End | End-to-End Testing | F1-scoreEntry-level Full TimeBengaluru, KA, India1d ago