Manager
Tasks
- Apply DevOps practices for data engineering
- Build Databricks data pipelines
- Design lakehouse medallion architecture
- Develop Spark jobs with PySpark and Spark SQL
- Enforce data quality frameworks
- Implement Delta Lake solutions
- Ingest structured and unstructured data
- Perform performance tuning
- Set up CI CD for data pipelines
- Use Git for version control
- Write SQL for large scale datasets
Perks/Benefits
Skills/Tech-stack
Apache Spark | CI/CD | Data Modeling | Data Quality | Databricks | Delta Lake | DevOps | Git | Performance Tuning | PySpark | SQL | Spark SQL
Education
Related jobs
-
Manager, Sales & Commission Data Governance INR 1068K-1600KAnaplan | Audit management | CRM | Commercial finance | ConfluenceEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimePune, MH, India7h ago
-
DE&A - Power BI - Senior Developer INR 3000K-4000KAgile | Analytical Functions | Azure Data | Azure Data Factory | BI DesktopSenior-level Full TimePune, Maharashtra, India7h ago
-
Manager, Business Analytics INR 1000K-2000KAgile | Business Intelligence | Business Process | Business Process Mapping | ConfluenceMid-level Full TimeChennai, Tamil Nadu, India9h ago
-
GenAI & Python Developer INR 1800K-3000KAPI Development | Agile | Data Pipelines | Data Preprocessing | Dataset cleaningAgile team collaborationMid-level Full TimeNoida, Uttar Pradesh, India10h ago
-
Azure Data & Fabric Developer / ETL pipeline & SQL ( 5 + yrs Assistant Manager - RNA INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, MH, India10h ago
-
Business Intelligence Engineer - Power BI INR 712K-1200KAgile | DAX | Data Modeling | Data Quality | Data WarehousingFlexible hybrid schedule | Health insurance | Life insurance | Paid time off | Personal/family care leaveMid-level Full TimeHyderabad, India R11h ago
-
Software Engineering Front Line Manager INR 1500K-1910KAvailability Monitoring | BDD | Bug tracking | Cloud Cost Optimization | Code QualityHealthcare package | Hybrid work setting | Online learning platform | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India18h ago
-
API Gateway | Agile | Apache Kafka | Artifactory | CICSSenior-level Full TimeTOWER B, EON FREE ZONE II, …18h ago
-
IN_Manager_Java Developer _Data & Analytics _Advisory _Kolkata INR 1000K-1800KAWS | Azure | CI/CD | Cloud platform | Data JPAMid-level Full TimeKolkata DN 57, India18h ago
-
.NET | ASP.NET | Amazon Web Services | Angular | Apache AirflowFlexible work arrangements | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India18h ago
-
Data Modeling | Data Visualization | Data Warehousing | Performance Tuning | Power BICollaboration | Flexibility programmes | Inclusive benefits | Learning opportunities | MentorshipSenior-level Full TimeHyderabad - Salarpuria, India18h ago
-
IN-Senior Associate_SAP HANA_ Data and Analytics_Advisory_Pune INR 2400K-3500KCMC | Data Analysis | Data Modeling | Data Visualization | Data integrationSenior-level Full TimePune, India18h ago
-
Data Quality Control Vice President INR 1500K-6000KAcceptance Testing | Audit | Control architecture | Data Analysis | Data Control ArchitectureExecutive-level Full TimeNIRLON KNOWLEDGE PARK BLOCK B6, India18h ago
-
Mid-level Full TimePune - Tower 6, India R18h ago
-
Director, Data Pipeline Engineering INR 1500K-6000KAWS | Agile | Apache Airflow | Apache Hadoop | Apache KafkaComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan support | Tuition reimbursementExecutive-level Full TimeM11 - Commers III, 43, 44 … R18h ago
-
Analyst, Data Engineering INR 1500K-2000KAutomation | Azure Data | Azure Data Factory | Azure Databricks | Data FactoryHybrid workMid-level Full TimeIN004 Bangalore, India18h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure Cloud | Azure Databricks | Data WarehousingFlexible work/life support | Hybrid work | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India18h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingFlexible work/life support | Hybrid work | Inclusive development opportunities | Paid volunteer days | Vibrant employee networksSenior-level Full TimeBangalore, India18h ago
-
Talend Data Integration Specialist | ETL, Data Warehousing, Data Governance, SQL, Cloud Integration INR 3000K-4000KAWS S3 | Agile | Apache Spark | Azure Data | Azure Data LakeFlexible work arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeHyderabad, India18h ago
-
Senior-level Full TimePune, India18h ago
-
Vice President, Data Quality and Excellence INR 1500K-6000KBusiness Intelligence | Change Management | Data Management | Data Quality | Data integrationComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeBL4 - KNG Tower 1, Indiqube … R18h ago
-
Senior Lead, Data Science, IT Platform Lead - Data Exploitation INR 2800K-4000KAccess Control | Analytics engineering | Artificial Intelligence | Batch Processing | Business IntelligenceSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India18h ago
-
Java Enterprise Developer | Spring Boot, APIs, Microservices, Cloud (AWS/Azure/GCP), Security & Performance Optimization INR 2500K-4000KAWS | Access Control | Agile | Azure | CI/CDFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India18h ago
-
Engineer Data INR 1500K-2400KAPIs | Agile | Amazon Web Services | Azure | Cloud ComputingFlexible work environment | Internal mobility | Volunteering opportunities | Work-life balance | Workplace well-beingSenior-level Full TimeKA Bangalore, India18h ago
-
Senior Engineer Data INR 1500K-2400KAPIs | AWS | Agile | Azure | Data CleansingFlexible work environment | Internal mobility | Volunteering opportunities | Well-being support | Work-life balanceSenior-level Full TimeKA Bangalore, India18h ago