Technical Lead-Data Engg
INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Architect lakehouse and data warehouse
- Build data transformations with PySpark
- Design data solutions
- Develop Databricks jobs notebooks pipelines
- Develop ELT/ETL pipelines
- Implement Delta Lake features
- Implement data ingestion from multiple sources
- Manage Databricks clusters and CI CD integrations
- Optimize performance tuning and resource utilization
- Orchestrate workflows with Azure Data Factory
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data orchestration | Delta Lake | ELT | ETL | JSON | Parquet | PySpark | SQL | Schema Enforcement | Schema evolution | Time Travel
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeIndia Office6h ago
-
Data Engineer INR 2000K-3000K.NET | API Development | Data Ingestion | Data Modeling | Data TransformationSenior-level Full TimeBangalore North, India11h ago
-
Sr. Data Engineer INR 1500K-2400KAWS Glue | Amazon S3 | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore North, India11h ago
-
Specialist, Data Management & Quantitative Analysis II INR 1400K-2000KAmazon S3 | CI/CD | Dashboards | Data APIs | Data VisualizationFlexible benefits | Paid time off | Paid volunteer time | Training and demos | Wellbeing programsMid-level Full TimePune, MH, India12h ago
-
Senior Software Engineer INR 1500K-2500KData Ingestion | Data Lineage | Data Quality | Data Scalability | Data TransformationSenior-level Full TimeIN-KA-Bangalore13h ago
-
Senior-level Full TimeIN-MH-Pune13h ago
-
Lead Data Engineer #3194 INR 3000K-5000KAccess Control | Code Repository | Compute Optimization | Data Governance | Data LineageFlexible working hours | Global collaboration | Learning and development programs | Opportunity for advanced tools and technologies | Performance rewards and recognitionSenior-level Full TimeChennai, India13h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Orchestration | Ansible | Artifact management | AzureBusiness development | Client advisory | Client relationship management | Growth mindset | MentorshipSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Databricks Developer / Data Architect INR 1500K-2500KAWS | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India14h ago
-
SQL,GCP/Consultant Specialist INR 500K-1500KAWS | Agile Scrum | Backup and Recovery | Cloud Computing | Cloud Platform (GCPMid-level Full TimePune, Maharashtra, India R14h ago
-
Data Scientist - Senior INR 3000K-5000KAgile | Amazon Web Services | Anomaly Detection | Azure | Big DataSenior-level Full TimePune, Maharashtra, India15h ago
-
Digital Finance CoE - Azure Data Engineer - Executive INR 1500K-6000KAWS Glue | Azure | Azure Data | Azure Data Factory | Azure DatabricksExecutive-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-level Full TimeIndia15h ago
-
Group Manager - Data Engineering INR 1500K-2500KAgile | Apache Airflow | Apache Spark | BigQuery | CI/CDMid-level Full TimeGurgaon, HR, India17h ago
-
Quality Assurance Engineer III INR 1500K-2500KAgile | Apache Airflow | BigQuery | CI/CD | Cloud platformSenior-level Full TimeChennai, Tamil Nadu, India18h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 1500K-3000KAWS Step Functions | Amazon S3 | Amazon Web Services | Apache Airflow | Apache SparkSenior-level Full TimePune, Maharashtra, India18h ago
-
Azure Senior Data Engineer INR 1500K-2800KADLS2 | Azure | Azure Data | Azure Data Factory | Azure DatabricksSenior-level Full TimeGurugram, Haryana, India18h ago
-
Applied AI Engineer – Engineering Intelligence INR 2000K-4500KAI Safety | API Integration | Agent Orchestration | Agent systems | AutogenEntry-level Full TimeChennai, Tamil Nadu, India19h ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE) R19h ago
-
Senior Software Developer (C++) - StorageGrid INR 2000K-3500KAWS S3 | Agile | C++ | CQL | CassandraSenior-level Full TimeBangalore, India Office (BANGALORE) R20h ago
-
Applied AI ML Lead INR 3500K-5000KAdversarial Testing | Auditability | CI/CD | Continuous Monitoring | FastAPISenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Security Engineer/Backend developer (StorageGRID) INR 2000K-4000KABAC | API Security | Access Management | CI/CD | Code reviewSenior-level Full TimeBangalore, India Office (BANGALORE) R20h ago
-
Analytics Solutions - Associate INR 2857K-5000KAlteryx | Automation | Call Reports | Data Governance | Data LineageSenior-level Full TimeBengaluru, Karnataka, India20h ago