Data Engineering Lead
Primary location: Hyderabad, India
INR 1500K-2700K (estimate) Senior-level Full Time
Tasks
- Build PySpark data transformations
- Deploy AI-powered solutions
- Design scalable data pipelines
- Integrate structured and unstructured data
- Monitor and troubleshoot Databricks workloads
- Optimize Databricks clusters
- Orchestrate and schedule data pipelines
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Functions | Azure SQL | Azure Synapse | Data Factory | Data Lake Storage | Logic Apps | No Code | PySpark | Python | SQL
Education
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
Planview Administration 169576 INR 1500K-2700KData Cleansing | Data Modeling | Data Validation | Data pipeline | Data pipeline orchestrationSenior-level Full TimeHyderabad, IND-TG, India6h ago
-
Mid-level Full TimeHyderabad, IND-TG, India7h ago
-
Senior-level Full TimeBangalore - Karnataka - India Chennai …11h ago
-
Mid-level Full TimeBangalore - Karnataka - India11h ago
-
Staff Data Engineer INR 1500K-2500KAPIs | AWS | Agentic Workflows | Automated testing | Cloud PlatformsSenior-level Full TimeHyderabad, Telangana , India R13h ago
-
Data Engineer, YouTube Business Organization INR 1000K-2000KApache Flume | Apache Spark | Data Governance | Data Lakes | Data ModelingMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Software Engineer, Generative AI, Gaming INR 2500K-5000K3D mathematics | C++ | Computer Graphics | Computer Vision | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Sr Advanced Data Engineer INR 1500K-3000KAWS | Apache Spark | Azure | Data Cleansing | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Data Engineering Lead INR 2000K-4580KAWS | Apache Airflow | Apache Spark | CI/CD | DBTBike to work | Career progression | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeMumbai, MH, India R13h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-5000KAWS | Agile | Azure | Embedding Models | Hugging FaceCompany-paid certifications | Financial consultations | Internal events | Language courses | Legal consultationsSenior-level Full TimeIndia13h ago
-
AI Senior Software Engineer INR 2000K-4500KAI Foundry | AI Search | AI gateway | AWS Bedrock | AngularSenior-level Full TimeBengaluru, India14h ago
-
Software Engineer II - Python INR 1500K-2500KAWS | Automated testing | Cloud | Code Refactoring | Data AnalysisMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Analyst - Data Scientist Machine Learning INR 1200K-2500KArtificial Intelligence | Data Visualization | Database querying | Gradient Boosting Machines | Gradient boostingCareer growth | Health and wellness benefits | Travel opportunitiesMid-level Full TimeGurugram, Haryana, India14h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Apache Spark | CI/CD | DBTBike to work | Career mentorship | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeMumbai, MH, India R14h ago
-
Data Engineer 2 INR 1500K-2500KAgile Development | Cassandra | Cloud Computing | Data Catalog | Data GovernanceSenior-level Full TimePune, Maharashtra, India14h ago
-
Data Engineer Manager - AWS Databricks INR 1500K-2600KAWS | Apache Spark | Automation | CI/CD | Data GovernanceSenior-level Full TimeHyderabad, TS, India15h ago
-
Data Engineer INR 3000K-4000KAmazon S3 | Databricks | ELT | ETL | PythonBike to work | Educational assistance | Employee assistance program | Employee discount | Enhanced parental leaveSenior-level Full TimeBengaluru, KA, India R15h ago
-
Senior Software Engineer INR 1163K-3000KAutomated testing | Batch Processing | CI/CD | DAX | Data GovernanceFlexible work arrangement | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R16h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure Databricks | Azure DevOps | CI/CD | Cloud Security | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India16h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | Airflow | Apache Iceberg | AzureSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | AWS Bedrock | Airflow | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | AWS Bedrock | Apache Airflow | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India17h ago
-
Sr Lead Software Engineer - Java/Python, Data Engineering INR 2500K-4300KAPI Design | AWS | Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeHyderabad, Telangana, India17h ago
-
Assistant Director,Data and Analytics INR 2337K-5199KAnomaly Detection | BigQuery | Cloud Computing | Data Visualization | Fraud analyticsExecutive-level Full TimeBangalore, Karnataka, India R17h ago
-
Apprentice - AI Engineer INR 300K-324KAWS | Anthropic SDK | Azure | Docker | EmbeddingsCareer development | Collaborative team | Exposure to global teams | Holiday allowance | Hybrid work environmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India R18h ago