DE&A - Core - Big Data Engineering - ETL

Bangalore, Karnataka, India

INR 2040K-2400K (estimate) Senior-level Full Time

@ Z...

Apply Save

Found 6h ago

Tasks

Architect and develop large scale PySpark applications
Define migration strategies for rehost replatform and reengineer
Design target state architectures using BigQuery Dataproc Dataflow and GCS
Implement batch and streaming workloads on GCP
Lead big data platform migrations to GCP
Modernize ETL pipelines using cloud native or Spark based solutions
Optimize data pipelines for performance, scalability, and cost
Refactor Spark Hive and MapReduce jobs for GCP

Perks/Benefits

Skills/Tech-stack

Education

N/A

Apply Save

Language: en | Views: 1 | Clicks: 0 | Saves: 0

Related jobs

AI Engineer INR 950K-1250K

APIs | AWS | Agent Frameworks | Angular | Azure

Hybrid work mode

Mid-level Full Time

Hyderabad, India

9h ago
Sr. Data Engineer INR 3200K-4500K

AWS | Apache Airflow | Apache Spark | Cloud platform | Data Modeling

Commuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insurance

Senior-level Full Time

Bengaluru, India

9h ago
Senior Data Engineer- Spark, Abinitio, Python, SQL, Data warehouse INR 2000K-2400K

Abinitio | Agile | Autosys | Cloud platform | Code Coverage

Senior-level Full Time

110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India

13h ago
Software Engineer INR 1500K-1700K

AWS | Apache Flink | Apache Spark | Data Modeling | ETL

Employee wellness programs | Hybrid work | Remote work | Work-life balance

Mid-level Full Time

Remote (IND), India R

13h ago
Data Engineer II - Decision Analytics INR 800K-1050K

AWS Lambda | Agile | Amazon EC2 | Amazon EMR | Amazon Kinesis

Access to learning courses | Adoption Assistance | Flexible benefits | Health and welfare insurance | Parental leave

Mid-level Full Time

Gurgaon, India

13h ago
Senior Analytics Engineer INR 2500K-2829K

Airflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks

Continuous learning and development | Hybrid working | Inclusive culture | Travel opportunities

Senior-level Full Time

Hyderabad, Telangana, India

22h ago
Applied AI Engineer INR 2040K-4500K

AWS | Agent systems | Authentication | Autonomous Agents | Azure

Company equity | Comprehensive benefits | Counseling | Gym subsidies | Hybrid work options

Senior-level Full Time

Bangalore, India

23h ago
Senior Principal Consultant, Gen_AI Engineer INR 2500K-4000K

AWS | Agentic AI | Azure OpenAI | Cloud Native | Cloud platform

Senior-level Full Time

India-Bangalore

1d ago
Consultant_ GCP Data Engineer INR 1200K-2000K

Airflow | BigQuery | Cloud Composer | Cloud Functions | Cloud Storage

AI certifications | Training and mentorship

Entry-level Full Time

India-Gurugram

1d ago
Lead Consultant, Gen_AI Engineer with MCP server expertise! INR 2500K-4000K

AWS | Agentic AI | Amazon SageMaker | Azure | Azure OpenAI

Senior-level Full Time

India-Bangalore

1d ago
Pyspark Databricks AWS INR 500K-2000K

AWS Glue | Agile | Airflow | Amazon Web Services | Apache Kafka

Senior-level Full Time

IN-TN-Chennai

1d ago
Pyspark Databricks AWS INR 500K-2000K

AWS | Agile | Airflow | Amazon Web Services | Apache Spark

Senior-level Full Time

IN-TN-Chennai

1d ago
Data Engineer, BizTech INR 3050K-4350K

Amazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Processing

Mid-level Full Time

Bangalore, India

1d ago
Data Engineer II INR 1500K-2000K

AWS | AWS Athena | AWS CloudFormation | AWS Glue | AWS S3

Mid-level Full Time

Pune, Maharashtra, India

1d ago
AWS Lead Data Engineer INR 2000K-2040K

AWS | AWS Glue | AWS architecture | Agile methodology | Amazon Aurora

Senior-level Full Time

Gurugram, Haryana, India

1d ago
AI Engineer INR 2000K-4500K

AWS | AWS SageMaker | Azure Machine Learning | Bias detection | CI/CD

Senior-level Full Time

New Delhi, DL, India

1d ago
Senior Data Engineer INR 1800K-2146K

Apache Airflow | BigQuery | Cloud Functions | Cloud SQL | Cloud platform

Senior-level Full Time

Hyderabad; Pune, Maharashtra, India

1d ago
Senior Data Engineer INR 1800K-2146K

Airbyte | Apache Airflow | BigQuery | Cloud Functions | Cloud SQL

Senior-level Full Time

Gurugram, Haryana, India; Hyderabad; Noida, Uttar …

1d ago
Senior Data Engineer INR 2000K-2146K

AWS | Airbyte | Apache Airflow | Buildkite | Cloud Functions

Senior-level Full Time

Gurugram, Haryana, India; Noida, Uttar Pradesh, …

1d ago
DE&A - Core - Cloud Data Engineering - Azure Data Engineering INR 1500K-2000K

Aggregation pipelines | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DB

Mid-level Full Time

Pune, Maharashtra, India

1d ago
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-2450K

AWS | AWS CDK | AWS Lambda | Agile | Airflow

Senior-level Full Time

Hyderabad, Telangana, India

1d ago
Software Engineer III - AWS, PySpark, ETL INR 2000K-2450K

AWS EMR | Agile | Apache Spark | CI/CD | Data Modeling

Senior-level Full Time

Hyderabad, Telangana, India

1d ago
Software Engineer III - PySpark, BigData, AWS INR 2050K-2600K

AWS | Agile | Amazon Web Services | Application Resiliency | Application Security

Senior-level Full Time

Hyderabad, Telangana, India

1d ago
Senior Data Engineer INR 2520K-3380K

AWS | Airflow | Apache Spark | Artifact Repository | Azure

Senior-level Full Time

Bengaluru, Karnataka, India

1d ago
Azure Data Engineer - Associate Consultant INR 1500K-2000K

Azure Data | Azure Data Factory | Azure Data Flow | Azure Data Lake | Azure Databricks

Mid-level Full Time

Bangalore, Karnataka, India

1d ago

DE&A - Core - Big Data Engineering - ETL

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs