IN_Sr Associate_Big Data Developer _Data & Analytics _Advisory _Mumbai
INR 2000K-2400K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Create HLD and LLD
- Design data models
- Develop spark jobs
- Drive data warehousing dimensional modeling
- Implement batch ingestion
- Implement data quality checks
- Implement streaming ingestion
- Perform unit and integration testing
- Provide observability for jobs
- Schedule and orchestrate jobs
- Tune SQL and Spark performance
- Write technical design documents
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Amazon EMR | Amazon S3 | Apache Airflow | Apache Hive | Apache Kafka | Apache NiFi | Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure HDInsight | Azure Synapse | Azure Synapse Analytics | Bucketing | CI/CD | Cloud Dataproc | Cloudera Manager | Data Lake Storage | Data Modeling | Data Warehousing | Dimensional Modeling | GCP | Git | GitLab CI | Google BigQuery | Google Cloud | Google Cloud Dataproc | HDFS | Hadoop | Hadoop Streaming | Impala | Jenkins | Linux | Oozie | Partitioning | PySpark | SQL | Scala | Shell Scripting | Streamsets | Synapse Analytics | Tez | YARN
Education
Bachelor of Engineering | Master of Business Administration | Master of Computer Applications
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer | Software Engineer
Related jobs
-
Custody Product Development - Risk Analytics and Reporting, Analyst/Manager - Officer INR 700K-1050K.NET | Alerting | Audit Trail | Cause analysis | Data GovernanceEducational support | Employee networks | Flexible work/life support | Matching gift programs | Medical insuranceMid-level Full TimeHyderabad, India-1d ago
-
Senior Data Engineer (Databricks) (Remote) INR 1500K-2040KAI | API Keys | AWS Glue | AWS IAM | AWS LambdaCollaboration | Ownership culture | Remote workSenior-level Full TimeMaharashtra, Pune, India R8h ago
-
AI / ML Engineer (Remote) INR 2500K-4500KAWS | Amazon SageMaker | CI/CD | Computer Vision | Data PreprocessingRemote workSenior-level Full TimeMaharashtra, Pune, India R8h ago
-
Fullstack Data Engineer (India) INR 1500K-2300KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Remote work | UK shift hoursSenior-level Full TimeMaharashtra, Pune, India9h ago
-
Power BI & Power Platform Developer INR 1000K-2500KAzure Functions | Azure Logic | Azure Logic Apps | Custom Connectors | Data GatewayMid-level Full TimeBangalore, India9h ago
-
Principal Consultant, Cloud Data Engineer INR 2800K-4000KApache Spark | Azure | Big Data | CI/CD | Data ModelingAI certifications | Mentorship | World-class trainingSenior-level Full TimeIndia-Bangalore9h ago
-
Power Apps and Power BI DEveloper INR 1300K-2209KALM | Azure Functions | BI Dashboards | DAX | Data ModelingSenior-level Full TimeIN-HR-Gurgaon9h ago
-
Tableau Developer INR 1628K-2000KBig Data | Dashboard automation | Data Aggregation | Data Automation | Data BlendingSenior-level Full TimeIN-TN-Chennai9h ago
-
Big Data -Snowflake INR 1200K-2000KBig Data | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeIN-TN-Chennai9h ago
-
Senior-level Full TimePune, Maharashtra, India10h ago
-
Senior-level Full TimePune, India11h ago
-
Analytics Solutions Manager INR 1234K-1748KAccess Control | Anomaly Detection | Artificial Intelligence | CDC | CI/CDMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Software Engineer II INR 1400K-1700KAPI Development | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DBMid-level Full TimeBengaluru, KA, IN12h ago
-
Associate - Data Scientist INR 1800K-2500KAWS | Agent systems | Apache Spark | Azure | Cloud platformMid-level Full TimeNoida, Uttar Pradesh, India12h ago
-
Senior Data Engineer INR 2800K-3500KAPI Development | AWS | Algorithms | Amazon Kinesis | Amazon RedshiftCharity programs | Discounted gym memberships | Environmental initiatives | Flexible working | Life assuranceSenior-level Full TimeHyderabad, India13h ago
-
Lead Assistant Manager INR 1500K-2000KAWS | Apache Airflow | Azure | Data Governance | Data LakehouseSenior-level Full TimeIndia13h ago
-
Assistant Manager INR 800K-1500KApache Airflow | Data Modeling | Data Processing | Databricks | Distributed dataTraining and developmentSenior-level Full TimeIndia13h ago
-
MET scientist INR 2000K-4000KAPIs | AWS | Artificial Intelligence | Azure | CI/CDBonus system | Canteen | Family-friendly initiatives | Fitness room | Learning and trainingEntry-level Full TimePune, MAHĀRĀSHTRA, India13h ago
-
Data Engineer INR 1500K-2345KAWS | Amazon Kinesis | Amazon Redshift | Azure | BashDiscounted gym memberships | Flexible working | Life assurance | Medical insurance | Pension schemeMid-level Full TimeHyderabad, India14h ago
-
Applied AI/ML Associate Senior - Causal ML INR 1400K-2000KA/B | A/B Testing | Apache Hive | Apache Spark | B testingMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Mid-level Full TimeGurugram, Haryana, India14h ago
-
Analytics Solution Associate INR 945K-1496KAI assisted productivity | Alteryx | Anomaly Detection | Artificial Intelligence | Data AnalysisMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Mid-level Full TimeMumbai, Maharashtra, India15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAPI Integration | Agent Frameworks | Agile | Azure | BERTMid-level Full TimePune, Maharashtra, India15h ago