Lead Data Engineer
Bangalore, Karnataka, India
INR 1500K-2040K (estimate) Senior-level Full Time
Tasks
- Design data solutions on Snowflake or Databricks or BigQuery
- Develop ELT pipelines with Python and Spark
- Develop ETL pipelines with Python and Spark
- Drive data migration from SAP to cloud data lakes and lakehouses
- Enable analytics and BI solutions for supply chain
- Ensure data quality, governance, and security
- Integrate LLMs and advanced ML models into data workflows
- Model data for analytics and BI
- Optimize pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Data Governance | Data Lake | Data Migration | Data Modeling | Data Quality | Data Security | Databricks | ELT | ETL | Google BigQuery | LLM | Lakehouse | Machine Learning | Performance Tuning | Power BI | PySpark | Python | SAP ECC | SAP S4HANA | Snowflake | Tableau
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Senior Data Engineer (Databricks) INR 1200K-2000KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS VPCSenior-level Full TimeMaharashtra, Pune, India1h ago
-
Software Engineer II - Python, Kubernetes, GenAI/ML INR 1000K-2000KAgile | Application Resiliency | CI/CD | Debugging | Development Life CycleMid-level Full TimeBengaluru, Karnataka, India2h ago
-
GEN AI Developer INR 3334K-5000KAI Services | AWS AI | AWS AI Services | AWS Machine Learning | Agentic AISenior-level Full TimeIN-TN-Chennai2h ago
-
Mid-level Full TimeIN-KA-Bangalore2h ago
-
Senior-level Full TimeIN-TN-Chennai2h ago
-
Technical Solutions Engineer, AI/ML INR 1800K-2500KAI/ML Platform | Algorithms | Artificial Intelligence | BigQuery | Cloud Compute EngineMid-level Full TimePune, Maharashtra, India; Bengaluru, Karnataka, India4h ago
-
Senior Software Engineer, AI/ML, AI Garage INR 2500K-4725KApache Beam | BigQuery | Cause analysis | Cloud platform | Data ProcessingSenior-level Full TimeHyderabad, Telangana, India4h ago
-
Data and Analytics Lead, Google Cloud INR 1200K-2000KApache | Apache Hive | Apache Spark | Big Data | Cloud adoptionSenior-level Full TimeBengaluru, Karnataka, India; Gurugram, Haryana, India4h ago
-
Data Engineer, YouTube INR 1500K-2000KApache Flume | Apache Spark | Cloud platform | Data Analysis | Data EngineeringMid-level Full TimeBengaluru, Karnataka, India4h ago
-
Data Engineer, Cross Play Intelligence INR 1500K-2000KAutomation | C++ | Data Analysis | Data Modeling | Data PreparationMid-level Full TimeBengaluru, Karnataka, India4h ago
-
AWS Data Engineer INR 1500K-2000KAWS Glue | AWS S3 | Amazon Athena | Amazon EMR | Apache SparkHybrid workMid-level Full TimeBengaluru, Karnataka, India4h ago
-
AWS | Apache Kafka | Apache NiFi | Apache Spark | Batch ProcessingHybrid workMid-level Full TimeBengaluru, INDIA, India5h ago
-
Sr. SW Test Engineer (3-5 years of experience in Big Data Testing, Pyspark, ETL Testing, SQL) INR 1536K-2500KCI/CD | Data Quality | ETL | Hive | PySparkHybrid workSenior-level Full TimeBengaluru, INDIA, India5h ago
-
Senior Research Engineer - Applied AI/ML INR 2500K-3500KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowSenior-level Full TimeGurugram, India6h ago
-
Data Engineer III - Big Data, Java, Scala INR 2000K-2755KAWS | Agile | Apache Spark | Big Data | CI/CDSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Intigration & Data Governance INR 1500K-2900KAPI | Business Intelligence | Csharp | Data Cleansing | Data GovernanceSenior-level Full TimeAhmedabad, Gujarat, India7h ago
-
Data Scientist- GenAI Engineer INR 2500K-3000KA/B | A/B Testing | B testing | Causal Inference | ClusteringMid-level Full TimeNoida, Uttar Pradesh, India7h ago
-
Assistant Manager-Business Analytics INR 1500K-2000KAI Agents | API Integration | BigQuery | Cloud platform | Data LakesMid-level Full TimeAhmedabad, Gujarat, India7h ago
-
Senior-level Full TimeBengaluru, INDIA, India8h ago
-
Mid-level Full TimeIndia9h ago
-
Databricks & GCP Data Platform Architect INR 1500K-2040KAlerting | Apache Spark | Audit Logging | BigQuery | CI/CDSenior-level Full TimeHyderabad, //TS, India9h ago
-
Senior Data Platform Engineer INR 1244K-4600KCost Optimization | Data Engineering | Data Lake | Data Lifecycle Management | Data ProcessingSenior-level Full TimeChennai9h ago
-
Senior-level Full TimeHyderabad9h ago
-
Lead Software Engineer - Big Data, Spark, Python, AWS INR 2000K-3500KAWS Lambda | Agile | Amazon ECS | Amazon EKS | Amazon EMRSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Staff Engineer - AI Development INR 2400K-3880KAutomation | Benchmarking | C plus plus | CPU GPU data movement | Cache ManagementSenior-level Full TimePune, MH, India11h ago