Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Bangalore, KA, IN

INR 1500K-2000K (estimate) Mid-level Full Time

@ N...

Apply Save

Found 2d ago

Tasks

Analyze usage patterns to deliver data products
Execute physical data transfer while ensuring data integrity
Perform end to end datastore migration from on prem DataLake to AWS Lakehouse
Reconcile migrated data with production data using reconciliation frameworks
Refactor and migrate extraction logic and job scheduling
Translate and optimize legacy SQL and Spark consumption patterns for Snowflake and Iceberg
Validate migrated data quality and functional equivalence

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Data Engineer ID56374 INR 1500K-2300K

Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CD

Local connection | Periodic meet ups | Remote work | Structured secure work environment | Support for education and wellness

Senior-level Full Time

Jalalabad, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | Cloud Composer | Cloud Dataproc | Cloud Monitoring

Budgets for personal growth education and wellness | Legal Compliance Support | Local connection meetups | Remote work

Senior-level Full Time

Mumbai, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | Bitemporal data modeling | CI/CD | Change Data Capture

Dedicated budgets for education | Dedicated budgets for wellness | Innovative projects | Local connection | Periodic meetups

Senior-level Full Time

Chennai, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | BigQuery | Change Data Capture | ClickHouse

Budget for education | Budget for wellness | Local compliance in India | Periodic team meetups | Personal growth support

Senior-level Full Time

Gurgaon Kty., India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Anomaly Detection | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL

Education budget | Innovative projects | Local connection | Periodic meet ups | Personal growth budget

Senior-level Full Time

Coimbatore South, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | BigQuery | Bitemporal data modeling | CI/CD

Education budget | Innovative projects | Local connection | Periodic meet ups | Personal growth budget

Senior-level Full Time

Jalalabad, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Agentic AI | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL

Education budget | Growth budget | Local meetups | Remote work | Wellness budget

Senior-level Full Time

Gurgaon Kty., India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | BigQuery | CI/CD | Change Data Capture

Education budget | Innovative projects | Local compliance | Local connection | Periodic meetups

Senior-level Full Time

Ahmedabad, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL

Education budget | Innovative projects | Local connection | Periodic meetups | Personal growth budget

Senior-level Full Time

Chennai, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | CI/CD | Change Data Capture | Change Data Capture (CDC)

Education budget | Local compliance in India | Periodic team meetups | Personal growth budget | Remote work

Senior-level Full Time

New Delhi, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | BigQuery | CI/CD | Change Data Capture

Education budget | Local compliance support | Periodic team meetups | Personal growth budget | Remote work

Senior-level Full Time

Kochi, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | CI/CD | Change Data Capture | ClickHouse

Education budget | Innovative projects | Legal presence in India compliance | Local connection meetups | Personal growth budget

Senior-level Full Time

Jaipur, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CD pipelines

Education budget | Innovative projects | Local connection periodic meetups | Personal growth budget | Remote work

Senior-level Full Time

Trivandrum, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | BigQuery | CI/CD | Change Data Capture

Education budget | Local connection meetups | Personal growth budget | Remote work | Structured secure work environment

Senior-level Full Time

Indore, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | Apache pandas | BigQuery | CI/CD

Innovative projects | Legal compliance in India | Local connection meetups | Personal growth education and wellness budget | Remote work

Senior-level Full Time

Kolkata, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CD

Growth education budget | Local connection meetups | Remote work | Secure compliant work environment | Wellness budget

Senior-level Full Time

Kolkata, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL

Education budget | Innovative projects | Local connection meetups | Personal growth budget | Remote work

Senior-level Full Time

Ahmedabad, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Agentic AI | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL

Education budget | Innovative projects | Legal presence in India | Local connection | Periodic team meetups

Senior-level Full Time

Jaipur, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CD

Education budget | Local connection meetups | Professional growth budget | Remote work | Wellness budget

Senior-level Full Time

Kochi, India

13h ago
Data Engineer (GCP) ID56375 INR 2400K-3380K

Apache Airflow | Apache Spark | CI/CD | Cloud Composer | Cloud Monitoring

Education budget | Local compliance support | Local meetups | Personal growth budget | Remote work

Senior-level Full Time

Trivandrum, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL | Bitemporal data modeling

Education budget | Legal Compliance Support | Local connection | Meetups | Professional growth budget

Senior-level Full Time

New Delhi, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL | Bitemporal data modeling

Education budget | Innovative projects | Local connection meetups | Personal growth budget | Remote work

Senior-level Full Time

Mumbai, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CD

Education budget | Innovation projects | Local connection meetups | Personal growth budget | Remote work

Senior-level Full Time

Hyderabad, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Anomaly Detection | Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL

Education budget | Local connection | Meetups | Personal growth budget | Remote work

Senior-level Full Time

Pune City, India

13h ago
Data Engineer ID56374 INR 1500K-2300K

Azure Data | Azure Data Factory | Azure Key Vault | Azure SQL | CI/CD

Education budget | Innovative projects | Local connection | Periodic meetups | Personal growth budget

Senior-level Full Time

Bangalore North, India

13h ago

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs