Lead Big Data Engineer -Assistant Vice President
Location(s): Pune, Maharashtra, India
INR 2000K-4132K (estimate) Senior-level Full Time
Tasks
- Align with data standards
- Analyze data quality issues
- Build and implement technology roadmap
- Conduct data mapping reconciliation and parallel run analysis for system migration
- Define data architecture for risk information
- Define data collection formats
- Deliver metrics reporting
- Design data collection and evaluation methodologies
- Design data pipelines for retention cleanup persistence and maintenance
- Guide data analysis and reporting processes
- Implement data consistency checks
- Manage target data architecture
- Optimize data engineering pipelines and queries
- Perform root cause analysis
- Prepare Monthly Operating Reviews and Portfolio Reviews
- Support status reporting and presentations
Perks/Benefits
- N/A
Skills/Tech-stack
Ab Initio | Apache HBase | Apache Spark | Batch Processing | Cause analysis | Cloud Migration | Data Consistency | Data Migration | Data Pipelines | Data Quality | DataStage | Dataframes | ELT | ETL | Event Streaming | NoSQL | Parallel Run | PySpark | Python | RDD | Root Cause Analysis | Root cause | SQL | Scala | Spark Streaming
Education
Roles
Related jobs
-
ML Developer (with Computer Vision) INR 3000K-5000KAWS | Algorithms | Azure | Computer Vision | Convolutional Neural NetworksMid-level Full TimePune City, India4h ago
-
Senior Agentic AI Engineer ID80140 INR 2000K-5000KAnthropic API | CI/CD | Cloud Security | GenAI | Infrastructure as CodeAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workSenior-level Full TimeJaipur, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic API | Artifact Repositories | Authentication | Automated testing | CI/CDAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimePune City, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | DockerAnnual learning budget | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeKolkata, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | FirewallsFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimeMumbai, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | CI/CD | CMDB | DNS | FirewallsAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeHyderabad, India4h ago
-
Senior AI Engineer ID80139 JPY 8600K-9700KAnthropic | Automated testing | CD pipelines | CI/CD | CI/CD pipelinesFlexible hours | Learning budget | Mentorship | Remote work | Support programsSenior-level Full TimeKochi, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | Automation | CI/CD | DNSAnnual performance reviews | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimeGurgaon Kty., India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | CI/CD | DNS | Git | GitHubFlexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeBangalore North, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automation | CI/CD | DNS | Data ProcessingAnnual performance reviews | Collaborative culture | Flexible hours | Internal TechTalks | Learning budgetSenior-level Full TimeNoida, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | FirewallsAnnual performance reviews | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeNew Delhi, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | FirewallsFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeIndore, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnomaly Detection | Anthropic | Automated testing | CI/CD | DNSFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeJaipur, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | FirewallAnnual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsSenior-level Full TimeTrivandrum, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | FirewallsFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimeChennai, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | CI/CD | DNS | Firewalls | GitAnnual performance reviews | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeCoimbatore South, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | GitFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeJalalabad, India4h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | FirewallsAnnual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsSenior-level Full TimeAhmedabad, India4h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Azure | CI/CD | Cloud Security | Cloud platformAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipSenior-level Full TimeJaipur, India4h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAmazon Web Services | Anthropic | Azure | CI/CD | Cloud SecurityAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipSenior-level Full TimeBengaluru, India4h ago
-
Senior-level Full TimeChennai, India4h ago
-
Apache Spark | Caching | Data Quality | Data Validation | DataFrameSenior-level ContractSeri Lingampally, India6h ago
-
Data Engineer - Solution Expert INR 1500K-2700KBigQuery | CI/CD | Cloud Security | Cloud platform | Data ModelingSenior-level Full TimePune, MH, India7h ago
-
Generative AI Application Developers INR 1800K-4500KC++ | Computer Vision | Debugging | Generative AI | JavaSenior-level Full TimePune, Maharashtra, India7h ago
-
Generative AI Application Developers INR 1500K-2500KAI integration | Deep learning | Generative AI | Language Processing | Machine LearningMid-level Full TimePune, Maharashtra, India7h ago