Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Bangalore, KA, IN

INR 1500K-2200K (estimate) Mid-level Full Time

@ N...

Apply Save

Found 1d ago

Tasks

Apply reconciliation frameworks for functional equivalence
Build confidence migrated data matches production flows
Convert raw and modeled consumption patterns for Snowflake and Iceberg
Execute physical data migration ensuring data integrity
Perform data reconciliation and validation
Perform end to end datastore migration from on prem data lake to AWS lakehouse
Refactor and migrate data extraction logic and job scheduling
Translate and optimize legacy SQL and Spark consumption patterns

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Practice Customer Engineer, Data Analytics INR 1200K-2000K

Apache Spark | Batch Processing | C++ | Cloud platform | DNS

Senior-level Full Time

Bengaluru, Karnataka, India; Mumbai, Maharashtra, India

3h ago
Practice Customer Engineer, Data Analytics INR 1200K-2000K

Apache Spark | C++ | DMZ | DNS | Data Lake

Equal opportunity work environment | Travel as required

Senior-level Full Time

Mumbai, Maharashtra, India; Bengaluru, Karnataka, India

3h ago
Consultant - Python Developer with Gen AI INR 1500K-2000K

AI Search | Agile | Azure OpenAI | CSS | Django

Mid-level Full Time

Bangalore, Karnataka, India

4h ago
Assistant Manager- AI Engineer with Cloude INR 2000K-3000K

AWS | Autogen | Azure | Claude | Cloud platform

Leadership opportunity | Mentorship

Mid-level Full Time

Bangalore, Karnataka, India

4h ago
AWS Data Engineer- Assistant Manager INR 1200K-2000K

AWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake Formation

Senior-level Full Time

Bangalore, Karnataka, India

4h ago
Data Engineer INR 938K-1200K

Azure Data | Azure Data Factory | Azure Databricks | Data Factory | ETL

Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off

Mid-level Full Time

Chennai, TN, India

7h ago
Software Engineer + Gen AI (Fresher) INR 300K-540K

AI Model Integration | AI model | API Integration | Algorithms | Data Structures

Entry-level Full Time

Pune, MH, India

7h ago
Applied AI ML Associate Senior INR 1050K-1250K

AWS | Big Data | CI/CD | Continuous Delivery | Continuous integration

Mid-level Full Time

Hyderabad, Telangana, India

8h ago
Staff Engineer INR 2000K-3100K

AI | Agentic Workflows | BigQuery | Cloud platform | Data Modeling

Senior-level Full Time

Chennai, Tamil Nadu, India

8h ago
Software Engineer III - Data Engineer INR 1500K-2146K

AWS | Apache Airflow | Azure | Big Data | Data Governance

Senior-level Full Time

Mumbai, Maharashtra, India

9h ago
IN-Associate_AI/ML Developer_MS Engg_Advisory_Kolkata INR 1500K-2000K

App Service | Azure App | Azure App Service | Azure Blob | Azure Blob Storage

Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing support

Mid-level Full Time

Kolkata DN 57, India

14h ago
IN_Senior Associate_Java/Python Developer_Risk Analytics-GRC_Advisory_Gurgaon INR 2500K-4000K

CI/CD | Couchbase | Design Patterns | Docker | Guice

Senior-level Full Time

Gurugram 8 B, India

14h ago
Sr. Azure Data Engineer INR 1500K-2000K

AWS | Azure | Azure Data | Azure Data Factory | Azure Data Lake

Senior-level Full Time

INDIA - BENGALURU - HP, IN

14h ago
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000K

Agile | Azure | Azure Data | Azure Data Factory | Azure Data Lake

Mid-level Full Time

Bhubaneswar - Ihub, India

14h ago
Machine Learning Engineer INR 2500K-3500K

Agentic AI | CI/CD | Data Science | Generative AI | Go

Mid-level Full Time

Bangalore, KA, IN, 562149

14h ago
Data Engineer INR 2000K-2000K

API | API Integration | AWS | Apache Airflow | Apache Spark

Mid-level Full Time

India - Hyderabad

14h ago
Sr Data Engineer INR 2400K-2800K

API Integration | AWS | Apache Airflow | Apache Spark | CCPA

Senior-level Full Time

India - Hyderabad

14h ago
Data Engineer INR 2000K-2000K

API | AWS | Apache Airflow | Apache Spark | Caching

Mid-level Full Time

India - Hyderabad

14h ago
Data Engineer INR 2000K-2000K

API Integration | AWS | Apache Airflow | Apache Spark | Caching

Mid-level Full Time

India - Hyderabad

14h ago
Sr Data Engineer INR 2400K-2800K

APIs | AWS | Apache Airflow | Apache Spark | CCPA

Senior-level Full Time

India - Hyderabad

14h ago
Data Engineer INR 2000K-2000K

APIs | AWS | Apache Airflow | Apache Spark | CCPA

Mid-level Full Time

India - Hyderabad

14h ago
Senior Engineer Data - MDM INR 1628K-2146K

Agile | Amazon Web Services | Azure | Cloud Platforms | Cloud platform

Flexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balance

Senior-level Full Time

KA Bangalore, India

14h ago
Lead Engineer Data - MDM INR 1500K-2040K

APIs | Agile | Amazon Web Services | Azure | Cloud platform

Flexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balance

Senior-level Full Time

KA Bangalore, India

14h ago
Lead Engineer Data INR 2156K-2400K

Agile methodology | Automation | Azure | Azure Data | Azure Data Factory

Flexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balance

Senior-level Full Time

KA Bangalore, India

14h ago
TTT - GTP IT - Manager INR 1500K-2500K

AI Agents | Alteryx | Automation frameworks | Cloud Platforms | Data Modeling

Mid-level Full Time

Bengaluru, KA, IN, 560016

14h ago

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs