Big Data Developer

Bengaluru, Karnataka, India

INR 1500K-2200K (estimate) Mid-level Full Time

@ W...

Apply Save

Found 1d ago

Tasks

Build data pipelines across on prem and AWS
Design batch data pipelines using Apache Spark
Develop reusable data processing frameworks
Ensure data quality consistency reliability
Integrate pipelines with PostgreSQL and downstream systems
Optimize Apache Spark jobs for performance
Orchestrate workloads using HashiCorp Nomad
Process transform high volume datasets in distributed environments
Troubleshoot production issues and perform root cause analysis
Use S3 and MinIO for data access and storage

Perks/Benefits

Skills/Tech-stack

Education

N/A

Apply Save

Language: en Views: 0

Clicks: 0

Saves: 0

Related jobs

Senior AI Platform Engineer INR 4000K-6000K

1Password | AWS | Argo CD | Azure | Blackduck

Senior-level Full Time

Chennai, India

8h ago
Senior Data Engineer INR 1500K-2500K

AWS | AWS Glue | Agile | Amazon Athena | Amazon EMR

Senior-level Full Time

Pune, India

13h ago
Compute-Hyd 169229 INR 2000K-3000K

AI Agents | API Development | Embeddings | LLM orchestration | Language Models

Mid-level Full Time

Hyderabad, IND-TG, India

14h ago
Lead Data Engineer - CDP INR 2500K-4500K

API Gateway | Analytics.js | CCPA | CI/CD | CPRA

Architecture workshops | Client stakeholder management | Technical mentorship

Senior-level Full Time

Hyderabad, TS, India

15h ago
Senior Data Engineer - AWS INR 1500K-4000K

AWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon Redshift

Senior-level Full Time

Bangalore, India

16h ago
Data Engineer INR 1500K-2000K

AWS | AWS Glue | Agile | Automated testing | Azure

Mid-level Full Time

Bangalore - Karnataka - India Pune …

16h ago
Data Engineer INR 2500K-2700K

AWS DataZone | AWS Glue | AWS Lambda | AWS Step Functions | Agile

Mid-level Full Time

Hyderabad, TS, 500032, IN

17h ago
Principal Data Engineer INR 1500K-2500K

Agile | Apache Airflow | Apache Kafka | Automated testing | CI/CD

Senior-level Full Time

IN-MH-Pune

17h ago
Data Architect INR 1500K-2500K

Apache Airflow | CI/CD | Cloud Composer | Cloud Storage | DBT

Senior-level Full Time

IN-MH-Pune

17h ago
Network Data Scientist INR 2500K-4500K

Application Traffic Analysis | CI/CD | DNS | Data Pipelines | GitLab CI

Senior-level Full Time

Pune, IN

17h ago
GBM - EqsFin Inventory Mgmt Strats - Hyderabad - Associate - Quantitative Engineering INR 500K-700K

Algorithm Development | Automated trading | C++ | Electronic Trading | Financial Mathematics

Mid-level Full Time

Hyderabad, Telangana, India

18h ago
GTM & AI Engineer A INR 2000K-3465K

API Design | Anthropic | Automation | CRM Integrations | CrewAI

Distributed work flexibility | Fully remote | High ownership role

Mid-level Full Time

India R

18h ago
Agentic AI Engineer INR 1200K-2500K

Agentic architecture | Distributed Systems | Docker | LLM | Langgraph

Mid-level Full Time

Karnataka, Bengaluru, India

18h ago
Embedded C++ Developer_ECT INR 1000K-2400K

Bootloader | C++ | CAN | CI/CD | Confluence

Entry-level Full Time

hosur road bangalore, India

19h ago
Software Engineer INR 2475K-4500K

.Net Core | API Development | ASP.NET MVC | Agile | Angular

Senior-level Full Time

Bengaluru, India

19h ago
[T] Senior Software Engineer, AI/ML, Google Cloud INR 3000K-5000K

C++ | Data Processing | Data Structures | Data structures algorithms | Debugging

Senior-level Full Time

Bengaluru, Karnataka, India

19h ago
Associate Software Engineer INR 1200K-2800K

Agile | C# | Cloud Development | Containerization | DHTML

Mid-level Full Time

Kolkata, India

19h ago
Software Engineer II - Big Data INR 1500K-2500K

AWS | Ab Initio | Apache Spark | Batch Processing | Data Mining

Mid-level Full Time

Hyderabad, Telangana, India

20h ago
Software Engineer III - Big Data INR 2200K-4200K

AWS | Ab Initio | Apache Spark | Application deployment | Batch Processing

Senior-level Full Time

Hyderabad, Telangana, India

20h ago
Senior AI Engineer – (Land Services) INR 2000K-3400K

AI Foundry | AI Search | APIs | Agentic AI | ArcGIS

Senior-level Full Time

Noida, Uttar Pradesh, India

21h ago
Software Engineer II INR 1600K-2800K

Agile | Application Resiliency | CI/CD | Cloud technologies | Data Analysis

Mid-level Full Time

Mumbai, Maharashtra, India

21h ago
Full Stack Analytics Engineer INR 1500K-3000K

Airflow | Amazon Redshift | Azure Synapse | CI/CD | Cloud Computing

Senior-level Full Time

Mumbai, India

22h ago
Full Stack Analytics Engineer INR 1500K-3000K

Airflow | Amazon Redshift | Amazon Web Services | Azure | Azure Synapse

Senior-level Full Time

Mumbai, India

22h ago
Senior Data Engineer INR 3000K-4000K

AWS | Amazon Aurora | Apache Airflow | Apache Kafka | Apache Spark

Bike to work | Career progression and mentorship coaching | Educational assistance | Employee assistance programme | Employee discount

Senior-level Full Time

Mumbai, MH, India

22h ago
Principal Engineer, Data Analytics Engineering [ 8+ years ] (Java/Python | Kafka | Kubernetes) INR 2000K-3584K

AWS | Agile | Algorithms | Apache Spark | Automation

Senior-level Full Time

Bengaluru, KA, India

22h ago

Big Data Developer

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs