IN_Sr Associate_Big Data Developer _Data & Analytics _Advisory _Mumbai
INR 2000K-2400K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Create ingestion patterns for near real time flows
- Design data models for data warehousing
- Develop Spark batch jobs
- Develop Spark streaming jobs
- Develop robust pipelines with observability
- Implement data quality checks
- Ingest data with Kafka
- Orchestrate batch and streaming workflows
- Perform unit and integration testing
- Schedule and monitor ETL jobs
- Tune SQL and Spark performance
- Write technical design documents
Perks/Benefits
Skills/Tech-stack
AWS EMR | AWS Glue | Amazon S3 | Apache Airflow | Apache Hadoop | Apache Hive | Apache Kafka | Apache NiFi | Apache Oozie | Apache Spark | Apache Tez | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure HDInsight | Azure Synapse | Bucketing | CI/CD | Cloud Dataproc | Cloudera Manager | Data Lake Storage | Data Modeling | Data Warehousing | Dimensional Modeling | Git | GitLab CI | Google BigQuery | Google Cloud | Google Cloud Dataproc | HDFS | Impala | Jenkins | Linux | Microsoft Azure | Microsoft Azure HDInsight | Partitioning | PySpark | SQL | Scala | Shell Scripting | Streamsets | YARN
Education
Bachelor of Engineering | Master of Business Administration | Master of Computer Applications
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R6h ago
-
Manufacturing Data Analytics Technical Expert INR 1628K-2146KApache Hive | Apache Spark | Data Historian | Data analytics | Data integrationSenior-level Full TimeBangalore, Karnataka, IN, 5601007h ago
-
Principal Engineer - Generative AI Infra Capabilities INR 2000K-4600KApigee | Arize | Avi | CI/CD | CUDASenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
Senior Data Engineer INR 1300K-2000KAPI Integration | API Security | Agile | Apigee | Asset ManagementSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Associate, Data Analytics & AI INR 1000K-1800KAmazon SageMaker | Anthropic API | Azure Machine Learning | CRM | CrewAIWellness Fridays | Wellness resources | Work-life balance supportMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Technical Program Manager, AI Agent Prototyping INR 1875K-3000KA/B | A/B Testing | B testing | Cloud Computing | Data QualityMid-level Full TimeBengaluru, Karnataka, India1d ago
-
GCP and Databricks Assistant Manager Hiring INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud FunctionsMid-level Full TimeBangalore, Karnataka, India1d ago
-
Manager - Fraud Analytics & Monitoring (Detection) INR 618K-618KAnomaly Detection | Artificial Intelligence | Behavioral analytics | Decisioning systems | Early WarningAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive and diverse team cultureMid-level Full TimeMumbai, India1d ago
-
Finance - Analytics Finance - Associate INR 1960K-2461KCRM | Data Governance | Data Pipelines | Data Quality | Data StewardshipSenior-level Full TimeBengaluru1d ago
-
DE&A - Core - Big Data Engineering - ETL INR 2040K-2400KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud ArchitectureSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Agentic / GEN AI INR 2500K-4000KAI Foundry | AI Services | Agentic AI | Azure AI | Azure AI ServicesSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Senior-level Full TimeIndia1d ago
-
AI Engineer INR 2000K-2600KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | Agent Development KitMid-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeBangalore1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
Manager Data Reliability Engineering INR 1500K-2000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeHyderabad1d ago
-
Lead, AI Engineer INR 2000K-4500KAI Assistants | API Integration | AWS | AWS Bedrock | AWS CDKBenefits | Bonus eligibility | Competitive pay | Equity | Hybrid work environmentSenior-level Full TimeAhmedabad, Gujarat1d ago
-
Sr. Data Engineer INR 3200K-4500KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeBengaluru, India1d ago
-
Database Engineer I INR 800K-1200KAgile | Amazon Web Services | Automation | Data Modeling | Database AdministrationSenior-level Full TimeIndia1d ago
-
Database Engineer II INR 1000K-1330KAmazon Web Services | Automation | Data Modeling | Database Administration | Database DesignSenior-level Full TimeIndia1d ago
-
Associate Data Scientist - AI/ML 1 Job INR 1500K-2000KData Modeling | Data Preprocessing | Data Visualization | Data cleaning | ExcelContinuous learning opportunities | Flexible work arrangements | Inclusive workplace | Stable employmentMid-level Full TimeHyderabad, IN1d ago
-
Abinitio | Agile | Autosys | Cloud platform | Code CoverageSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago