IN_Sr Associate_Big Data Developer _Data & Analytics _Advisory _Mumbai
INR 1960K-2800K (estimate) Senior-level Full Time
Tasks
- Apply observability for Spark jobs
- Build data pipelines
- Develop Spark jobs for batch and streaming
- Develop data models for dimensional modeling
- Implement Kafka and NiFi ingestion patterns
- Perform data quality checks
- Run unit and integration testing
- Schedule data processing workflows
- Tune SQL and Spark for large datasets
- Write HLD and LLD design documents
Perks/Benefits
Skills/Tech-stack
AWS | AWS EMR | AWS Glue | Agile | Amazon S3 | Apache Airflow | Apache NiFi | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure HDInsight | Azure Synapse | Bucketing | CI/CD | Cloud Dataproc | Cloudera Manager | Data Lake Storage | Data Modeling | Dimensional Modeling | Git | GitLab CI | Google BigQuery | Google Cloud | Google Cloud Dataproc | HDFS | Hadoop | Hive | Impala | Integration Testing | Jenkins | Kafka | Linux | Microsoft Azure | Oozie | Partitioning | PySpark | SDLC | SQL | Scala | Shell Scripting | Streamsets | Tez | Unit Testing | Unix | YARN
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
Senior Data Engineer INR 1500K-2500KAlerting | Apache Pinot | BigQuery | Cloud platform | Cost OptimizationSenior-level Full TimeBangalore, India11h ago
-
Mid-level Full TimeGurugram, Haryana, India11h ago
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia13h ago
-
Bootloader | C# | CAN | Configuration Management | DebuggingFlexi benefits | Health insurance | Hybrid working model | Internal job rotation | Life insuranceEntry-level Full TimeBangalore, IN13h ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India14h ago
-
Informatica Developer INR 600K-1500KData Modeling | Data Reconciliation | Data Validation | Data Warehousing | Data integrationWork from office 5 days per weekMid-level Full TimePune, Maharashtra, India15h ago
-
AI Engineer II INR 3000K-5000KAWS | Agile | Apache Hive | Apache Kafka | Apache SparkCareer growth | Holistic well-being support | Learning opportunities | Supportive leadership cultureSenior-level Full TimeBengaluru, KA, India15h ago
-
Lead Data Quality Governance and Strategy Engineer INR 2520K-3380KBI tools | Data Governance | Data Management | Data Modeling | Data QualityFlexible hybrid work model | Health and life insurance | Paid time offSenior-level Full TimeHyderabad, India R16h ago
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru16h ago
-
Senior Quantitative Associate - Front Office INR 1500K-3000KC++ | Data Mining | Java | JavaScript | KDBCareer development | Performance rewards | Support and mentorshipMid-level Full TimeBangalore, Karnataka, India R17h ago
-
Senior Data Engineer I INR 2500K-3380KAgile | Apache Airflow | Apache Hadoop | Apache Hive | Apache KafkaInclusive culture | Professional development time | Supportive team environment | Work-life balanceSenior-level Full TimeGurugram, HR, India17h ago
-
Analytics Engineer INR 1500K-3000KDBT | Data Governance | Data Modeling | Git | MetaplaneCareer developmentMid-level Full TimeIndia17h ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior Analyst-Data Science INR 2500K-4400KA/B | A/B Testing | B testing | Causal Inference | Data PreparationSenior-level Full TimeGurugram, HR, India18h ago
-
IN_Associate_AI Engineer_GCC_Advisory_Hyderabad INR 2500K-4800KAPI Development | Anthropic API | Async Programming | Autogen | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India22h ago
-
Data Engineer (SQL + Python/Java) INR 700K-1500KAWS EMR | Agile Scrum | Amazon Web Services | Apache Spark | Continuous DeliveryHybrid work flexibility | Remote work supportMid-level Full TimeGurgaon - Cyber Park, India22h ago
-
IN_Sr Associate_ AWS Devops With MLOPs Developer_Application Technology_Advisory_ PAN INDIA (early joiners) INR 3000K-4000KAWS | AWS Lambda | Amazon CloudFormation | Amazon EKS | Amazon S3Flexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India22h ago
-
Data Engineer - S/4 Analytics INR 2000K-2400KABAP RAP | AMDP | Access Control | Agile | Analytical ModelsFlexible working hours | Paid parental leave | Paid shift flexibility | Paid training and development programs | Remote work optionMid-level Full TimeBangalore RMZ-ECO WORLD, India22h ago
-
Vice President - Principal Data Engineer INR 3584K-5500KAPI | AWS | Agile | Anomaly Detection | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R22h ago
-
Mid-level Full TimeBangalore, KA, IN22h ago
-
EY - GDS Consulting - AIA - Gen AI - Senior INR 2000K-3300KAWS CloudFormation | Amazon Bedrock | Amazon Web Services | Apache Spark | AuthenticationCoaching | Continuous learning | Inclusive cultureSenior-level Full TimeChennai, TN, IN, 60003222h ago
-
Operations Sr. Assistant I INR 2500K-3500KAWS | Azure | Cloud Computing | Computer Vision | Data PipelinesSenior-level Full TimeIND - Ranjangaon - B200A, India22h ago
-
Software Engineer IV INR 2000K-3000KApache Airflow | Apache Hudi | Apache Iceberg | Apache Spark | AvroMid-level Full TimeIndia - Bangalore-Navigator Bldg22h ago
-
Senior Data Platform Support Engineer -GCP Certified INR 3000K-3500KAirflow | Bash | BigQuery | CI/CD | Cloud ComposerHybrid work modelSenior-level Full TimePune, India R22h ago
-
Associate Consultant - Netapp-Storage (SAN & NAS) Job INR 1000K-1500KActive IQ | Bash | CIFS | Cisco MDS | Dell CloudIQMid-level Full TimeBangalore, KA, IN22h ago