Technical Lead-Data Engg
INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Architect lakehouse and data warehouse
- Build data transformations with PySpark
- Design data solutions
- Develop Databricks jobs notebooks pipelines
- Develop ELT/ETL pipelines
- Implement Delta Lake features
- Implement data ingestion from multiple sources
- Manage Databricks clusters and CI CD integrations
- Optimize performance tuning and resource utilization
- Orchestrate workflows with Azure Data Factory
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data orchestration | Delta Lake | ELT | ETL | JSON | Parquet | PySpark | SQL | Schema Enforcement | Schema evolution | Time Travel
Education
N/A
Roles
Related jobs
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN5h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India6h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R7h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN12h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India12h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R12h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R12h ago
-
Senior Staff Engineer (AI Full-stack Developer) INR 2000K-5000KAWS | Access Controls | Agentic Workflows | Asynchronous programming | Audit LoggingSenior-level Full TimeMumbai, India1d ago
-
Senior Staff Engineer (AI Solution Design) INR 4000K-5500KAlerting | Artificial Intelligence | Data Architecture | Data Lakes | Data PipelinesSenior-level Full TimeMumbai, India1d ago
-
Senior-level Full TimeMumbai, MH, India1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Senior-level Full TimePune, India1d ago
-
AI Engineer INR 2000K-4500KAI Foundry | AI Services | API Development | Azure AI | Azure AI FoundryMid-level Full TimeBangalore, IN1d ago
-
Senior Data Engineer - Consulting INR 2500K-4000KAJAX | AWS ECS | Agile | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, Telangana1d ago
-
Data Engineer - Delivery INR 1500K-2000KAmazon Web Services | Azure Blob | Azure Blob Storage | Blob Storage | Data ManagementCollaborative team | Professional growth | Training completionMid-level Full TimeHyderabad, Telangana1d ago
-
Senior-level Full TimeBengaluru, KA, IN1d ago
-
Sr SDE (Java + AI) INR 3000K-5000KAI orchestration | AWS | Alerting | Automated testing | AzureDesign review leadership | MentorshipSenior-level Full TimePune City, India1d ago
-
AIOps | APIs | AWS | Anomaly Detection | AzureFlexible working hours | Fully remote | Remote collaborationMid-level Full TimeIndia R2d ago
-
Senior-level Full TimeIndia - Bangalore2d ago
-
Staff Software Engineer - Data Platform INR 3000K-4000KAWS | Azure | Bazel | BigQuery | BuildkiteCell phone stipend | Free food | Holidays | In-office collaboration | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India, APAC2d ago
-
Data Engineer INR 2000K-2500KAgile | Cloud Data | Cloud data platform | Data Governance | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India2d ago
-
Lead Data Engineer INR 1500K-2500KApache Airflow | Apache Kafka | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeHyderabad, IND-TG, India2d ago
-
Planview Administration 169576 INR 1500K-2500KData Governance | Data Modeling | Data Pipelines | Data Validation | ELTSenior-level Full TimeHyderabad, IND-TG, India2d ago