IN_Manager_Big Data _Data & Analytics _Advisory _Mumbai
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build batch and near real time flows with NiFi
- Build data pipelines
- Create technical design documents
- Design data warehouse models
- Design end-to-end data solutions
- Develop spark jobs
- Enforce data security and governance
- Estimate effort and plan delivery
- Govern data releases
- Ingest streaming data with Kafka
- Manage YARN queues
- Optimize cluster resources
- Perform capacity planning
- Perform integration testing
- Perform unit testing
- Tune query and job performance
- Write Hive and Impala queries
Perks/Benefits
Skills/Tech-stack
AWS EMR | AWS Glue | Amazon S3 | Apache Airflow | Apache Atlas | Apache Flink | Apache Hadoop | Apache Hive | Apache Kafka | Apache NiFi | Apache Oozie | Apache Ranger | Apache Sentry | Apache Spark | Apache Tez | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure HDInsight | Azure Synapse | Azure Synapse Analytics | Bucketing | CI/CD | Cloud Dataproc | Cloudera Data Platform | Cloudera Manager | Data Lake Storage | Data Modeling | Data Warehousing | Data pipeline | Data platform | Dimensional Modeling | Git | GitLab CI | Google BigQuery | Google Cloud | Google Cloud Dataproc | HDFS | Impala | Jenkins | Kerberos | Linux | Microsoft Azure | Microsoft Azure HDInsight | Partitioning | Performance Tuning | PySpark | SQL | SQL Performance | SQL Performance Tuning | Scala | Shell Scripting | Synapse Analytics | YARN
Education
Bachelor of Technology | MBA | Master of Computer Applications
Related jobs
-
Senior Data Engineer INR 1300K-2000KAPI Integration | API Security | Agile | Apigee | Asset ManagementSenior-level Full TimeChennai, Tamil Nadu, India14h ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad14h ago
-
Senior-level Full TimeIN-AP-Hyderabad14h ago
-
Technical Program Manager, AI Agent Prototyping INR 1875K-3000KA/B | A/B Testing | B testing | Cloud Computing | Data QualityMid-level Full TimeBengaluru, Karnataka, India16h ago
-
GCP and Databricks Assistant Manager Hiring INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud FunctionsMid-level Full TimeBangalore, Karnataka, India17h ago
-
Manager - Fraud Analytics & Monitoring (Detection) INR 618K-618KAnomaly Detection | Artificial Intelligence | Behavioral analytics | Decisioning systems | Early WarningAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive and diverse team cultureMid-level Full TimeMumbai, India17h ago
-
DE&A - Core - Big Data Engineering - ETL INR 2040K-2400KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud ArchitectureSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Agentic / GEN AI INR 2500K-4000KAI Foundry | AI Services | Agentic AI | Azure AI | Azure AI ServicesSenior-level Full TimeNoida, Uttar Pradesh, India20h ago
-
Senior-level Full TimeIndia20h ago
-
AI Engineer INR 2000K-2600KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | Agent Development KitMid-level Full TimePune, Maharashtra, India20h ago
-
Mid-level Full TimeHyderabad, India22h ago
-
Sr. Data Engineer INR 3200K-4500KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeBengaluru, India23h ago
-
Associate Data Scientist - AI/ML 1 Job INR 1500K-2000KData Modeling | Data Preprocessing | Data Visualization | Data cleaning | ExcelContinuous learning opportunities | Flexible work arrangements | Inclusive workplace | Stable employmentMid-level Full TimeHyderabad, IN1d ago
-
Abinitio | Agile | Autosys | Cloud platform | Code CoverageSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Senior Software Engineer - Linux, Filesystems & Storage INR 3375K-4590KAgile Scrum | C# | Debugging | Device Drivers | Dm-cryptSenior-level Full TimeBangalore - Carina, India R1d ago
-
Principal Software Engineer - Linux, Filesystems & Storage INR 3375K-4590KAgile Scrum | C# | Device Drivers | Dm-crypt | File SystemSenior-level Full TimeBangalore - Carina, India R1d ago
-
Software Engineer INR 1500K-1700KAWS | Apache Flink | Apache Spark | Data Modeling | ETLEmployee wellness programs | Hybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (IND), India R1d ago
-
Data Engineer II - Decision Analytics INR 800K-1050KAWS Lambda | Agile | Amazon EC2 | Amazon EMR | Amazon KinesisAccess to learning courses | Adoption Assistance | Flexible benefits | Health and welfare insurance | Parental leaveMid-level Full TimeGurgaon, India1d ago
-
Intern - Full stack Software Engineer with AI/ML INR 175K-175KAngular | Database Design | Django | Flask | GitFlexible working arrangements | Inclusive work environmentEntry-level Full Time InternshipBangalore (Airbus), India1d ago
-
Artificial Intelligence | Business Intelligence | Data Quality | Data Science | Data VisualizationFlexibility programme | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_ Associate_Palantir_ Data and Analytics_Advisory_Pan India INR 1800K-2400KIICS | Palantir | Project Management | SQL | ScrumInclusive benefits | Mentorship | Work flexibilitySenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
IN_Senior Associate_GEN AI_AI-50_Advisory_Bangalore INR 2520K-4500KAWS | Amazon Redshift | Apache Airflow | Apache Hadoop | AzureSenior-level Full TimeBengaluru Millenia, India1d ago
-
Cloud - Intelligent Ops - Automation - 20012026 INR 1500K-2000KAI Model Integration | AI model | AI/ML | Automation Account | Azure FunctionsIn person collaboration flexibility | Workplace flexibilityMid-level Full TimeIN319 - IND Bangalore Electronic City …1d ago
-
IN_Senior Associate_AWS_OC - D&A_Advisory_ Bhubaneshwar INR 2000K-2400KAWS Glue | AWS Lambda | AWS Step Functions | Amazon AppFlow | Amazon AthenaSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
Lead AI Engineer – Lead Engineer , VP INR 2500K-4500KAIOps | API Design | Agentic AI | BigQuery | Cloud ComposerAccident insurance | Best in class leave policy | Childcare assistance reimbursement | Comprehensive hospitalization insurance | Employee assistance programSenior-level Full TimePune - Margarpatta, India1d ago