DE&A - Core - Big Data Engineering - ETL
Bangalore, Karnataka, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Architect and develop PySpark applications
- Define migration strategies
- Design target state architectures
- Implement batch and streaming workloads
- Lead big data platform migrations
- Modernize ETL pipelines
- Optimize data pipelines for performance, scalability, and cost
- Refactor Spark Hive or MapReduce jobs for GCP
Perks/Benefits
- N/A
Skills/Tech-stack
Batch Processing | BigQuery | Dataflow | Dataproc | ETL | GCP | GCS | Hadoop | Hive | MapReduce | PySpark | Spark | Streaming
Education
N/A
Roles
Related jobs
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R10h ago
-
Manufacturing Data Analytics Technical Expert INR 1628K-2146KApache Hive | Apache Spark | Data Historian | Data analytics | Data integrationSenior-level Full TimeBangalore, Karnataka, IN, 56010011h ago
-
Mid-level Full TimeIndia1d ago
-
Lead Assistant Manager INR 500K-1500KAWS | Apache Airflow | Cloud platform | Data Governance | Data LakehouseSenior-level Full TimeIndia1d ago
-
Senior Data Engineer INR 1300K-2000KAPI Integration | API Security | Agile | Apigee | Asset ManagementSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Associate, Data Analytics & AI INR 1000K-1800KAmazon SageMaker | Anthropic API | Azure Machine Learning | CRM | CrewAIWellness Fridays | Wellness resources | Work-life balance supportMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Data Analytics-Python Developer INR 2000K-3000KAgile | Dagster | Data Modeling | Dimensional Modeling | DockerMid-level Full TimeBengaluru, Karnataka, India1d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud StorageMid-level Full TimeBangalore, Karnataka, India1d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hadoop | Apache Hive | Apache Spark | Batch Processing | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India1d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud StorageMid-level Full TimeBangalore, Karnataka, India1d ago
-
GCP and Databricks Assistant Manager Hiring INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud FunctionsMid-level Full TimeBangalore, Karnataka, India1d ago
-
Finance - Analytics Finance - Associate INR 1960K-2461KCRM | Data Governance | Data Pipelines | Data Quality | Data StewardshipSenior-level Full TimeBengaluru1d ago
-
DE&A - Core - Big Data Engineering - ETL INR 2040K-2400KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud ArchitectureSenior-level Full TimeBangalore, Karnataka, India1d ago
-
AI Engineer INR 2000K-2600KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | Agent Development KitMid-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
Manager Data Reliability Engineering INR 1500K-2000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeHyderabad1d ago
-
Lead, AI Engineer INR 2000K-4500KAI Assistants | API Integration | AWS | AWS Bedrock | AWS CDKBenefits | Bonus eligibility | Competitive pay | Equity | Hybrid work environmentSenior-level Full TimeAhmedabad, Gujarat1d ago
-
Sr. Data Engineer INR 3200K-4500KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeBengaluru, India1d ago
-
Database Engineer I INR 800K-1200KAgile | Amazon Web Services | Automation | Data Modeling | Database AdministrationSenior-level Full TimeIndia1d ago
-
Abinitio | Agile | Autosys | Cloud platform | Code CoverageSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Software Engineer INR 1500K-1700KAWS | Apache Flink | Apache Spark | Data Modeling | ETLEmployee wellness programs | Hybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (IND), India R1d ago
-
Data Engineer II - Decision Analytics INR 800K-1050KAWS Lambda | Agile | Amazon EC2 | Amazon EMR | Amazon KinesisAccess to learning courses | Adoption Assistance | Flexible benefits | Health and welfare insurance | Parental leaveMid-level Full TimeGurgaon, India1d ago
-
IN_Senior Associate_GEN AI_AI-50_Advisory_Bangalore INR 2520K-4500KAWS | Amazon Redshift | Apache Airflow | Apache Hadoop | AzureSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_Senior Associate_AWS_OC - D&A_Advisory_ Bhubaneshwar INR 2000K-2400KAWS Glue | AWS Lambda | AWS Step Functions | Amazon AppFlow | Amazon AthenaSenior-level Full TimeBhubaneswar - Ihub, India1d ago