Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Bangalore, KA, IN

INR 1500K-2200K (estimate) Mid-level Full Time

@ N...

Apply Save

Found 1d ago

Tasks

Analyze usage patterns to deliver required data products
Build data reconciliation and validation workflows
Collaborate with internal clients for handoff and sign off
Convert and optimize legacy SQL and Spark consumption patterns for Snowflake and Iceberg
Execute physical data migration ensuring data integrity
Perform end to end datastore migration from on prem data lake to AWS lakehouse
Refactor and migrate extraction logic and job scheduling
Troubleshoot SQL and debug data pipeline issues

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Practice Customer Engineer, Data Analytics INR 1200K-2000K

Apache Spark | Batch Processing | C++ | Cloud platform | DNS

Senior-level Full Time

Bengaluru, Karnataka, India; Mumbai, Maharashtra, India

1h ago
Practice Customer Engineer, Data Analytics INR 1200K-2000K

Apache Spark | C++ | DMZ | DNS | Data Lake

Equal opportunity work environment | Travel as required

Senior-level Full Time

Mumbai, Maharashtra, India; Bengaluru, Karnataka, India

1h ago
Data Engineer INR 938K-1200K

Azure Data | Azure Data Factory | Azure Databricks | Data Factory | ETL

Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off

Mid-level Full Time

Chennai, TN, India

4h ago
Software Engineer + Gen AI (Fresher) INR 300K-540K

AI Model Integration | AI model | API Integration | Algorithms | Data Structures

Entry-level Full Time

Pune, MH, India

5h ago
Applied AI ML Associate Senior INR 1050K-1250K

AWS | Big Data | CI/CD | Continuous Delivery | Continuous integration

Mid-level Full Time

Hyderabad, Telangana, India

6h ago
IN-Associate_AI/ML Developer_MS Engg_Advisory_Kolkata INR 1500K-2000K

App Service | Azure App | Azure App Service | Azure Blob | Azure Blob Storage

Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing support

Mid-level Full Time

Kolkata DN 57, India

12h ago
IN_Senior Associate_Java/Python Developer_Risk Analytics-GRC_Advisory_Gurgaon INR 2500K-4000K

CI/CD | Couchbase | Design Patterns | Docker | Guice

Senior-level Full Time

Gurugram 8 B, India

12h ago
Sr. Azure Data Engineer INR 1500K-2000K

AWS | Azure | Azure Data | Azure Data Factory | Azure Data Lake

Senior-level Full Time

INDIA - BENGALURU - HP, IN

12h ago
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000K

Agile | Azure | Azure Data | Azure Data Factory | Azure Data Lake

Mid-level Full Time

Bhubaneswar - Ihub, India

12h ago
Machine Learning Engineer INR 2500K-3500K

Agentic AI | CI/CD | Data Science | Generative AI | Go

Mid-level Full Time

Bangalore, KA, IN, 562149

12h ago
Data Engineer INR 2000K-2000K

API | API Integration | AWS | Apache Airflow | Apache Spark

Mid-level Full Time

India - Hyderabad

12h ago
Sr Data Engineer INR 2400K-2800K

API Integration | AWS | Apache Airflow | Apache Spark | CCPA

Senior-level Full Time

India - Hyderabad

12h ago
Data Engineer INR 2000K-2000K

API | AWS | Apache Airflow | Apache Spark | Caching

Mid-level Full Time

India - Hyderabad

12h ago
Data Engineer INR 2000K-2000K

API Integration | AWS | Apache Airflow | Apache Spark | Caching

Mid-level Full Time

India - Hyderabad

12h ago
Sr Data Engineer INR 2400K-2800K

APIs | AWS | Apache Airflow | Apache Spark | CCPA

Senior-level Full Time

India - Hyderabad

12h ago
Data Engineer INR 2000K-2000K

APIs | AWS | Apache Airflow | Apache Spark | CCPA

Mid-level Full Time

India - Hyderabad

12h ago
Senior Engineer Data - MDM INR 1628K-2146K

Agile | Amazon Web Services | Azure | Cloud Platforms | Cloud platform

Flexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balance

Senior-level Full Time

KA Bangalore, India

12h ago
Lead Engineer Data - MDM INR 1500K-2040K

APIs | Agile | Amazon Web Services | Azure | Cloud platform

Flexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balance

Senior-level Full Time

KA Bangalore, India

12h ago
Lead Engineer Data INR 2156K-2400K

Agile methodology | Automation | Azure | Azure Data | Azure Data Factory

Flexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balance

Senior-level Full Time

KA Bangalore, India

12h ago
TTT - GTP IT - Manager INR 1500K-2500K

AI Agents | Alteryx | Automation frameworks | Cloud Platforms | Data Modeling

Mid-level Full Time

Bengaluru, KA, IN, 560016

12h ago
Agentic AI Engineer INR 2500K-5000K

API Integration | Agent systems | Amazon Web Services | Azure | Backend Development

Senior-level Full Time

Pune, MH, IN, 411018

12h ago
Machine Learning Engineer, Chakra INR 2000K-4600K

Benchmarking | Conversational AI | Data Pipelines | Deep learning | Docker

Mid-level Full Time

Hybrid in Bangalore, India R

16h ago
Technical Support Engineer INR 850K-1100K

Amazon Web Services | Apache Hadoop | Apache Spark | Bash | Cloud platform

Flexible paid time off

Mid-level Full Time

Hyderabad, India

18h ago
Senior Data Engineer INR 2000K-2300K

AWS | AWS Glue | AWS Lambda | Amazon EMR | Apache Airflow

Senior-level Full Time

India

19h ago
Software Engineer Lead (Python + Snowflake) INR 2040K-3100K

Airflow | CI/CD | DBT | Dagster | Data Modeling

Senior-level Full Time

India (Noida)

19h ago

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs