Lead Data Engineer (Big Data , AI , Snowflake and Databricks)-Assistant Vice President
Location(s): Pune, Maharashtra, India
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Analyze data quality issues
- Build data pipelines for retention cleanup persistence and maintenance
- Define data architecture for risk information
- Deliver metrics reporting
- Design data collection and evaluation methodologies
- Guide data analysis and reporting
- Implement data consistency checks
- Implement data roadmap
- Manage target data architecture
- Optimize data engineering pipelines and queries
- Perform root cause analysis
- Prepare Monthly Operating Reviews and Portfolio Reviews
- Support status reports and presentations
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Big Data | CI/CD | Cloud Migration | Data Architecture | Data Consistency | Data Engineering | Data Migration | Data Modeling | Data Normalization | Data Pipelines | Data Quality | Data Reconciliation | Data Streaming | Data integration | ELT | ETL | HBase | NoSQL | Parallel Run | Project Management | PySpark | Python | SQL | Scala | Spark Streaming
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Mid-level Full TimeNoida,Uttar Pradesh,India R6h ago
-
Senior-level Full TimeHyderabad, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeDedicated budget for education | Dedicated budget for wellness | Legal presence in India | Local connection | Periodic meet upsSenior-level Full TimeKolkata, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIGrowth education budget | Innovative projects | Local connection | Periodic meet ups | Remote workSenior-level Full TimeMumbai, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | FastAPI | Infrastructure as CodeDedicated budgets for growth | Education budget | Global clients | Innovative projects | Local connectionSenior-level Full TimeChennai, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionGrowth education budget | Innovative projects | Local connection | Periodic meet ups | Remote workSenior-level Full TimeJaipur, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIEducation budget | Growth budget | Innovative projects | Local connection | MeetupsSenior-level Full TimeAhmedabad, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIEducation budget | Growth budget | Innovative projects | Periodic team meetups | Remote workSenior-level Full TimeNoida, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | AWS S3 | Anthropic API | CI/CD | Drift DetectionEducation budget | Growth budget | Local connection | Modern technology projects | Periodic meet upsSenior-level Full TimeJalalabad, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIGrowth education budget | Innovative projects | Local legal compliance in India | Local team connection | Remote workSenior-level Full TimeIndore, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeBudgets for growth | Education budget | Innovative projects | Local connection | Remote workSenior-level Full TimeTrivandrum, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | AWS S3 | Anthropic API | CI/CD | Cloud SecurityLocal connection | Remote workSenior-level Full TimeNew Delhi, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIBudget for growth | Education support | Innovative projects | Legal compliance India | Local connectionSenior-level Full TimeHyderabad, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIDedicated budgets for growth | Education budget | Innovative projects | Local team connection | MeetupsSenior-level Full TimePune City, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Cloud Security | FastAPIEducation budget | Growth budget | Innovative projects | Local team connection | Remote workSenior-level Full TimeBangalore North, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIBudgets for education | Budgets for wellness | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeCoimbatore South, India10h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | Cloud Drift Detection | Drift DetectionDedicated budgets for growth | Education support | Innovative projects | Legal presence in India | Local connectionSenior-level Full TimeGurgaon Kty., India10h ago
-
Senior Security Software Engineer ID80139 JPY 8600K-12500KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionEducation budget | Growth budget | Innovative projects | Local connection | Periodic team meet upsSenior-level Full TimeKochi, India10h ago
-
Senior-level Full TimeBangalore, Karnataka11h ago
-
Data Engineer INR 2000K-2700KAWS Redshift | Agile | Azure DevOps | Azure Synapse | Azure Synapse AnalyticsHybrid workingMid-level Full TimeIndia R11h ago
-
Snowflake Developer INR 1500K-2200KAgile | Automated Deployment | CI/CD | Data Ingestion | Data LakeSenior-level Full TimeIN-HR-Gurgaon11h ago
-
Senior-level Full TimeIN-TN-Chennai11h ago
-
DE&A - AIML - Data Science - Machine Learning INR 2500K-5000KAI Agents | AWS | Azure | CI/CD | Cloud ComputingSenior-level Full TimeIndia11h ago
-
Practice Customer Engineer, Data Analytics INR 1500K-3000KApache Spark | Batch Processing | Big Data | C++ | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India13h ago
-
AI Principal Engineer INR 2500K-4800KAPI Development | Agent systems | Agentic AI | Analytics | Artificial IntelligenceEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India13h ago