DE&A - Core - Big Data Engineering - ETL
Bangalore, Karnataka, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Architect and develop PySpark applications
- Define migration strategies
- Design target state architectures
- Implement batch and streaming workloads
- Lead big data platform migrations
- Modernize ETL pipelines
- Optimize data pipelines for performance, scalability, and cost
- Refactor Spark Hive or MapReduce jobs for GCP
Perks/Benefits
- N/A
Skills/Tech-stack
Batch Processing | BigQuery | Dataflow | Dataproc | ETL | GCP | GCS | Hadoop | Hive | MapReduce | PySpark | Spark | Streaming
Education
N/A
Roles
Related jobs
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai8h ago
-
Senior-level Full TimeIN-TN-Chennai8h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad8h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad8h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad8h ago
-
Mid-level Full TimeMumbai, Maharashtra, India10h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56003715h ago
-
Senior-level Full TimeGurgaon, Haryana, India15h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agent/tool use | Apache Spark | Azure | ContainersContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India21h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India21h ago
-
IN_Manager_SSIS_Data & Analytics_Advisory_Noida INR 1500K-2000KAWS | Azure | CI/CD | Cloud Data | Cloud Data PlatformsFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeNoida, India21h ago
-
EY - GDS Consulting - AI And DATA -Snowflake Architect -Manager INR 3000K-4000KAgile | Batch Processing | Cloud Data | Cloud Data Warehouse | DBTCareer development | Coaching and feedback | Flexible work arrangementSenior-level Full TimeHyderabad, TG, IN, 50008121h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agentic AI | Azure | CI/CD | Code reviewContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India21h ago
-
Sr. Data Engineer, Analytics Engineering INR 3000K-4000KAirflow | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeMumbai, India21h ago
-
Big Data Engineer - (Scala | Spark | Databricks | Cloud) INR 2000K-3000KAWS EMR | Apache Flink | Apache Hadoop | Apache Hive | Apache SparkSenior-level Full TimeIT BUILDING, RAMANUJAN IT SEZ,, India21h ago
-
Mid-level Full TimeChennai (Flexible), India21h ago
-
Senior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …21h ago
-
Profisee MDM Developer Senior Specialist (Databricks/AWS) INR 2755K-3380KData Governance | Data Management | Data Matching | Data Modeling | Data QualityEmployee stock purchase program | Flex day program | Flexible working schedule | Health insurance | Hybrid work modelSenior-level Full TimeBangalore-Affluence, India21h ago
-
Profisee MDM Developer Specialist (Databricks/AWS) INR 2755K-3380KData Governance | Data Management | Data Mapping | Data Matching | Data ModelingAnnual bonus | Flex day program | Flexible work schedule | Health insurance | Hybrid workSenior-level Full TimeBangalore-Affluence, India21h ago
-
Senior Software Engineer - Gen AI INR 2000K-2800KAJAX | AWS | Agile | Angular | AnsibleContinuous learningSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India21h ago
-
AWS | Apache Airflow | Cloud platform | Control-M | Data GovernanceSenior-level Full TimePLOT NO-1, S.NO. 77, India21h ago
-
SMTS/LMTS - AI ML Engineers INR 2000K-4500KCloud Native | Context engineering | Continuous Deployment | Continuous integration | Data Pipelines1 to 1 coaching | Adoption Assistance | Fertility benefits | Generous parental leave | Health and well being reimbursementSenior-level Full TimeIndia - Bangalore21h ago
-
Senior Software Engineer, Global Converse, ITC INR 2000K-3200KAgile | Amazon EMR | Apache Spark | Automated testing | Code ReviewsSenior-level Full TimeINDIA TECHNOLOGY CENTER, India21h ago
-
Azure Data Engineer INR 2000K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBengaluru, India21h ago