Databricks + PySpark - Technical Lead-Data Engg
INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
INR 1500K-2700K (estimate) Senior-level Full Time
Tasks
- Build modern data warehouse solutions
- Collaborate with BI and analytics teams
- Create technical specifications
- Design application interfaces
- Design, develop, and deploy data pipelines
- Develop and maintain scalable data pipelines
- Develop batch processing solutions
- Integrate new data sources
- Process structured and unstructured data
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Batch Processing | Data Factory | Data Lake | PySpark | SQL
Education
N/A
Related jobs
-
Senior Analyst, Analytics Engineer INR 2771K-4000KApplication Monitoring | DBT | Data Compliance | Data Governance | Data ModelingRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN3h ago
-
IT Solution database engineer INR 1500K-2700KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure SQLSenior-level Full TimeBengaluru, KA, India4h ago
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R6h ago
-
Python, Pyspark Developer INR 2800K-4000KAgile | AngularJS | Ansible | Big Data | BootstrapDevelopment courses | Digital wellbeing platform | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeChennai, IN6h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R10h ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R10h ago
-
Mid-level Full TimeKochi, India11h ago
-
SW Engineer (1 - 2 years of exp in .Net / Python, Full-stack development, Angular / React, GenAI) INR 1500K-2500K.NET | API Management | Agile | Angular | Azure DevOpsHybrid work schedule | Limited direction working environmentMid-level Full TimeBengaluru, India R11h ago
-
Mid-level Full TimeHyderabad, TG, IN11h ago
-
DBT/Snowflake Engineer INR 1000K-2000KAzure DevOps | CI/CD | DBT | Data Modeling | Data WarehousingMid-level Full TimeHyderabad, TG, IN11h ago
-
DBT/Snowflake Engineer INR 1000K-2000KCI/CD | DBT | Data Modeling | Data Warehousing | Dimensional ModelingMid-level Full TimeHyderabad, TG, IN11h ago
-
Senior Data Engineer INR 3600K-5000KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFinancial wellness support | Flexible remote work on Fridays | Hybrid work schedule | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R15h ago
-
Data Science - Senior Architect (Healthcare & Life Sciences) INR 2500K-5000KAWS | Amazon SageMaker | CI/CD | Containerization | Data ModelingSenior-level Full TimeChennai, India20h ago
-
Sr. Data Engineer INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimePune City, India20h ago
-
Lead Data Engineer - Fabric INR 1400K-2700KAPI Integration | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure SynapseEmployee referral bonuses | Flexible work options | In-house technology training | Learning and development programs | Medical insuranceSenior-level Full TimePune City, India20h ago
-
Specialist - Data Platform Engineering INR 1500K-2500KAWS | Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeChennai, India22h ago
-
Senior-level Full TimeBangalore - Karnataka - India23h ago
-
GCP Data Engineer INR 2800K-4000KAirflow | Apache Spark | BigQuery | Cloud Composer | Cloud FunctionsSenior-level Full TimeIndia1d ago
-
Lead Data Engineer INR 3000K-4000KBig Data | Continuous Delivery | Data Architecture | Data Engineering | Data GovernanceAutonomy | Coaching and mentoring | Learning and development programs | Onsite workSenior-level Full TimeBangalore, India1d ago
-
Database Engineer - PostGreSQL / MySQL INR 500K-1500KAutomation | Cassandra | Failover | High Availability | Incident ManagementExposure to modern database technologies | On-call rotation | SLA based operationsMid-level Full TimeNoida,Uttar Pradesh,India1d ago
-
AWS | Alerting | Azure | CI/CD | Cost OptimizationCollaboration with cross-functional teams | Exposure to advanced AI infrastructure | Inclusive environment | Innovation and experimentation | Professional growthSenior-level Full TimeIndia1d ago
-
Senior Data Engineer INR 1500K-2700KApache Airflow | Apache Hadoop | Apache Iceberg | Apache Spark | DBTSenior-level Full TimeHyderabad, TS, India1d ago
-
Databricks Engineer INR 1500K-2800KADLS Gen2 | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, TS, India1d ago
-
AWS | AWS Glue | Airflow | Amazon Athena | Amazon AuroraCareer growth | Flexible schedule | Global collaboration | International conference opportunities | Professional developmentMid-level Full TimeIndia1d ago
-
Principal Data Engineer INR 2040K-3000KBigQuery | CDC | Cloud Composer | Cloud Storage | Data FusionSenior-level Full TimeBangalore,INKA,India1d ago