Big Data Lead
Tasks
- Collaborate across teams for data transition
- Design and develop data ingestion pipelines
- Develop resilient and fault-tolerant code
- Develop, test, and maintain data processes
- Identify and improve data assets
- Research and implement new data methods
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Data Factory | Data Lake | Data Modeling | Data Optimization | Data Pipeline Development | Data Processing | Data integration | Data pipeline | Fault Tolerance | Pipeline Development | PySpark | Python | SQL | Spark | Unstructured Data | Unstructured Data Processing
Education
Roles
Related jobs
-
Technical Lead-Data Engg INR 500K-1200KAPI | Data Modeling | Data Quality | Data Streaming | Data transferSenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN10d ago
-
Azure Data lead INR 2040K-2400KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexible working hours | Hybrid work environment | Professional development budgetSenior-level Full TimeIndia19d ago