IN_Manager_Big Data _Data & Analytics _Advisory _Mumbai
Mumbai Shivaji Park, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build data pipelines
- Conduct integration testing
- Conduct unit testing
- Create technical design documents
- Design data warehousing models
- Design end-to-end data solutions
- Develop data security and governance
- Enforce release governance
- Estimate and plan stakeholder efforts
- Implement batch near real time pipelines
- Implement streaming ingestion
- Manage HDFS and YARN resources
- Manage stakeholder communication
- Optimize Spark jobs
- Perform SQL performance tuning
- Perform capacity planning
- Support SDLC and Agile delivery
Perks/Benefits
Skills/Tech-stack
AWS | AWS EMR | AWS Glue | Airflow | Amazon S3 | Apache Atlas | Apache Ranger | Apache Sentry | Atlas | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure HDInsight | Azure Synapse | Azure Synapse Analytics | Bucketing | CI/CD | Cloud Dataproc | Cloudera Data Platform | Cloudera Manager | Data Lake Storage | Data Modeling | Data Warehousing | Data pipeline | Data platform | Dimensional Modeling | GCP | Git | GitLab CI | Google BigQuery | Google Cloud | Google Cloud Dataproc | HDFS | Hadoop | Hive | Impala | Jenkins | Kafka | Kerberos | Linux | Nifi | Oozie | Partitioning | PySpark | Ranger | SQL | Scala | Shell Scripting | Spark | Streamsets | Synapse Analytics | Tez | YARN
Related jobs
-
Senior Data Engineer (Databricks) (Remote) INR 1500K-2040KAI | API Keys | AWS Glue | AWS IAM | AWS LambdaCollaboration | Ownership culture | Remote workSenior-level Full TimeMaharashtra, Pune, India R7h ago
-
AI / ML Engineer (Remote) INR 2500K-4500KAWS | Amazon SageMaker | CI/CD | Computer Vision | Data PreprocessingRemote workSenior-level Full TimeMaharashtra, Pune, India R7h ago
-
Fullstack Data Engineer (India) INR 1500K-2300KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Remote work | UK shift hoursSenior-level Full TimeMaharashtra, Pune, India7h ago
-
Principal Consultant, Cloud Data Engineer INR 2800K-4000KApache Spark | Azure | Big Data | CI/CD | Data ModelingAI certifications | Mentorship | World-class trainingSenior-level Full TimeIndia-Bangalore8h ago
-
Big Data -Snowflake INR 1200K-2000KBig Data | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeIN-TN-Chennai8h ago
-
Senior-level Full TimePune, Maharashtra, India9h ago
-
Senior-level Full TimePune, India10h ago
-
Analytics Solutions Manager INR 1234K-1748KAccess Control | Anomaly Detection | Artificial Intelligence | CDC | CI/CDMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Software Engineer II INR 1400K-1700KAPI Development | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DBMid-level Full TimeBengaluru, KA, IN11h ago
-
Associate - Data Scientist INR 1800K-2500KAWS | Agent systems | Apache Spark | Azure | Cloud platformMid-level Full TimeNoida, Uttar Pradesh, India11h ago
-
Senior Data Engineer INR 2800K-3500KAPI Development | AWS | Algorithms | Amazon Kinesis | Amazon RedshiftCharity programs | Discounted gym memberships | Environmental initiatives | Flexible working | Life assuranceSenior-level Full TimeHyderabad, India12h ago
-
Lead Assistant Manager INR 1500K-2000KAWS | Apache Airflow | Azure | Data Governance | Data LakehouseSenior-level Full TimeIndia12h ago
-
Assistant Manager INR 800K-1500KApache Airflow | Data Modeling | Data Processing | Databricks | Distributed dataTraining and developmentSenior-level Full TimeIndia12h ago
-
MET scientist INR 2000K-4000KAPIs | AWS | Artificial Intelligence | Azure | CI/CDBonus system | Canteen | Family-friendly initiatives | Fitness room | Learning and trainingEntry-level Full TimePune, MAHĀRĀSHTRA, India12h ago
-
Data Engineer INR 1500K-2345KAWS | Amazon Kinesis | Amazon Redshift | Azure | BashDiscounted gym memberships | Flexible working | Life assurance | Medical insurance | Pension schemeMid-level Full TimeHyderabad, India13h ago
-
Applied AI/ML Associate Senior - Causal ML INR 1400K-2000KA/B | A/B Testing | Apache Hive | Apache Spark | B testingMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Analytics Solution Associate INR 945K-1496KAI assisted productivity | Alteryx | Anomaly Detection | Artificial Intelligence | Data AnalysisMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Mid-level Full TimeMumbai, Maharashtra, India14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAPI Integration | Agent Frameworks | Agile | Azure | BERTMid-level Full TimePune, Maharashtra, India14h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAgentic Frameworks | Agile | Azure | BERT | DjangoMid-level Full TimeBangalore, Karnataka, India14h ago
-
Senior_AI_developer INR 3125K-4763KAPI Orchestration | CI/CD | CNN | Computer Vision | Data PreprocessingSenior-level Full Timebangalore, India14h ago
-
Senior Data Engineer INR 2520K-3880KAWS CodePipeline | AWS DMS | AWS Glue | AWS Lambda | Amazon KinesisReward and recognition | Volunteering opportunities | Wellness program | Work-life balanceSenior-level Full TimeHyderabad, India14h ago
-
Lead Software Engineer – Python, Terraform, Snowflake, AWS INR 2000K-4000KAWS | Agile | Amazon Web Services | Application Resiliency | By DesignSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Data Engineer INR 3000K-4000KAPI Design | Apache Iceberg | Apache Spark | Cloud Data | Cloud data warehousingSenior-level Full TimeIndia15h ago