IN_Sr Associate_Big Data Developer _Data & Analytics _Advisory _Mumbai
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Conduct unit and integration testing
- Create ingestion patterns
- Design dimensional models
- Develop Spark jobs batch and streaming
- Develop data warehousing solutions
- Implement data quality checks
- Implement near real time batch flows
- Ingest streaming data
- Provide observability for Spark jobs
- Schedule and orchestrate jobs
- Support SDLC and Agile delivery
- Tune SQL and Spark performance
- Write technical design documents
Perks/Benefits
Skills/Tech-stack
AWS EMR | AWS Glue | Amazon S3 | Apache Airflow | Apache NiFi | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure HDInsight | Azure Synapse | BigQuery | Bucketing | CI/CD | Cloud Dataproc | Cloudera Manager | Data Lake Storage | Data Modeling | Data Quality | Data Warehousing | Data pipeline | Dimensional Modeling | Git | GitLab CI | Google Cloud | Google Cloud Dataproc | HDFS | Hadoop | Hive | Impala | Jenkins | Kafka | Linux | Oozie | Partitioning | PySpark | SQL | Scala | Shell Scripting | Streamsets | Tez | YARN
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer | Software Engineer
Related jobs
-
Data Warehouse Support Engineer INR 1500K-2000KAPI Integration | APIs | Data Governance | Data Lakes | Data MartsHybrid work | Remote workMid-level Full TimeBangalore R15h ago
-
Data Architect INR 1500K-2400KAWS Glue | Amazon S3 | Apache Spark | Asset bundles | Azure ADFCareer progression | Health & wellness benefits | Hybrid working | Retirement benefits | Training budget for Databricks certificationSenior-level Full TimePune, India16h ago
-
Mid-level Full TimeIN-AP-Hyderabad17h ago
-
Optimizely Frontend INR 1500K-1800KAPI Integration | Bootstrap | Browser testing | CSS | Content ManagementMid-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-TN-Chennai17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIndia18h ago
-
Data and Analytics Lead, Google Cloud INR 1500K-3000KBigQuery | Cloud Migration | Data Modeling | Data Transformation | Database ManagementSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India18h ago
-
Partner Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-4000KAPIs | Agent systems | Artificial Intelligence | Cloud platform | Data PipelinesSenior-level Full TimeMumbai, Maharashtra, India19h ago
-
Senior-level Full TimeBengaluru, Karnataka, India19h ago
-
CCB Risk Strategic Analytics – GenAI INR 1960K-2800KAgentic AI | Control processes | Credit Risk | Data Analysis | Data EngineeringSenior-level Full TimeMumbai, Maharashtra, India19h ago
-
REF101597D_2026252498 - Data Analyst - Python/Pandas/ Power BI - 2 to 4 years experience INR 346K-500KDAX | Data Modeling | Data Transformation | Matplotlib | NumPyRotational shiftsEntry-level Full TimePune, MH, India19h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2500KAWS Glue | AWS Lambda | Airflow | Amazon Athena | Amazon EC2Mid-level Full TimeBangalore, Karnataka, India20h ago
-
Senior-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior Expert INR 3000K-3880KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India20h ago
-
AES - DE - Generative AI Prompt Engineers INR 3000K-4000KCI/CD | Code Analysis | Cypress | DeepEval | DockerSenior-level Full TimePune, Maharashtra, India21h ago
-
Senior Data Engineer INR 2000K-3000KAPI Design | Apache Kafka | Apache Spark | Automated testing | CI/CDSenior-level Full TimeBengaluru, KA, India21h ago
-
Senior Software Engineer 7+ years (Must have- Python, FastAPI (or Flask/Django), Langchain, Mongodb, RestAPI) INR 1960K-2829KAnthropic | Azure OpenAI | CI/CD | Cohere | DjangoEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India21h ago
-
Expert, Analytics Engineering INR 2520K-3880KAWS | Airflow | CI/CD | Cognitive Computing | DBTRelocation assistanceSenior-level Full TimeMumbai, MH, IN22h ago
-
Associate Process Manager INR 800K-1800KBigQueryML | CRM Analytics | Customer Segmentation | Dashboarding | Data ModelingAPAC shift workMid-level Full TimeMumbai, Maharashtra, India22h ago
-
AWS | Alerting | Audit Logging | Azure | CI/CDWork from OfficeSenior-level Full TimePune, MH, India22h ago
-
AES - DE - Generative AI Prompt Engineers INR 2800K-4000KAgent Orchestration | Autogen | Azure DevOps | Azure OpenAI | C SharpSenior-level Full TimeBangalore, Karnataka, India22h ago
-
Senior-level Full TimeChennai, TN, India1d ago
-
Senior Software Engineer I INR 2500K-3500KAPI Design | Agile Development | Airflow | Alerting | Apache SparkCareer growth opportunities | Health and wellness support | Learning opportunities | Mentoring opportunitiesSenior-level Full TimeChennai, TN, India1d ago