Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Bangalore, KA, IN

INR 1500K-2000K (estimate) Mid-level Full Time

@ N...

Apply Save

Found 7d ago

Tasks

Analyze usage patterns to deliver data products
Build data reconciliation and validation frameworks
Ensure migrated data matches production functional requirements
Execute physical data migration while ensuring data integrity
Manage schema evolution and enforcement strategies
Optimize data partitioning and clustering
Perform end to end datastore migration from on prem DataLake to AWS Lakehouse
Refactor and migrate extraction logic and job scheduling
Serve as technical liaison to data owners for handoff and sign off
Translate and optimize legacy SQL and Apache Spark consumption patterns for Snowflake and Apache Iceberg

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Data Science Engineer INR 2400K-3500K

Cloud Database | Data Modeling | Database Design | ELT | ETL

Commercial awareness | Onshore Offshore model experience | UK client experience

Senior-level Full Time

Mumbai, MH, India

3h ago
Engineering Manager- DevOps(Vendor) INR 2200K-4000K

AWS Lambda | Agile | Amazon S3 | Amazon Web Services | Ansible

Senior-level Full Time

Noida, Uttar Pradesh

3h ago
Engineering Manager- Data Devops(Vendor) INR 1500K-2000K

AWS CloudFormation | AWS IAM | AWS Lambda | Amazon CloudFront | Amazon CloudWatch

Mid-level Full Time

Noida, Uttar Pradesh

3h ago
VnV Automation & Analytics(AI & LLM) INR 1800K-2500K

ASPICE | AUTOSAR | C# | C++ | CAN

Senior-level Full Time

bangalore, India

3h ago
Senior Data Engineer INR 2516K-3356K

AWS | Airflow | Apache Iceberg | Azure | CI/CD

Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off

Senior-level Full Time

Chennai, TN, India

4h ago
Lead Machine Learning Engineer INR 3100K-4500K

Apache Airflow | Argo Workflows | Deep learning | GenAI | Java

Senior-level Full Time

Bangalore, India R

4h ago
Devops Technical Lead INR 2500K-3440K

CI/CD | Checkmarx | Docker | GitHub | Helm

Senior-level Contract Full Time

Bengaluru, Karnataka, India

5h ago
Senior AI Engineer INR 2500K-4000K

AWQ | Agentic AI | Autogen | CI/CD | Caching

Senior-level Full Time

IND - Bengaluru - Esko-Graphics India …

10h ago
Data Engineer (5+ Years of Exp in Data Warehouse Modeling + Big Data + SSIS + BI + Agile + PowerApps + Shell + SQL) INR 1500K-2000K

AI | AWS | Agile | Azure | Azure DevOps

Mid-level Full Time

Bengaluru, India

10h ago
IN_Associate_Chatbots/Voicebots_GCC_Advisory_Bangalore INR 1000K-1400K

API | AWS | AWS Lex | Agent Assist | Auto-QA

Mid-level Full Time

Bengaluru Millenia, India

10h ago
Business Data Analyst II INR 1200K-1848K

AWR | CI/CD | Clean Code | Core Java | Data Pump

Mid-level Full Time

India Offsite (ZIN99) R

10h ago
Cloud Engineer AIOps INR 2000K-2700K

Apache Spark | Auto Scaling | CI/CD | Compliance | Data Lineage

Accident insurance | Childcare assistance reimbursement | Coaching | Continuous learning culture | Employee assistance program

Entry-level Full Time

Pune - Business Bay, India

10h ago
Data Engineer INR 1500K-2160K

Data Quality | Data Validation | Deep learning | Git | Jupyter

Mid-level Full Time

New Delhi

13h ago
Data Engineer INR 1500K-2100K

Data Pipelines | Data Quality | Data Validation | Deep learning | Git

Mid-level Full Time

New Delhi

13h ago
Analytics Engineer INR 1800K-2500K

Apache Airflow | Cloud Composer | DBT | Data Modeling | Data Warehousing

Insurance package | Learning and development resources

Mid-level Full Time

Noida, Uttar Pradesh

1d ago
Principal Engineer INR 2500K-4500K

API Integration | AWS Glue | Amazon Redshift | Apache Airflow | Apache Kafka

Senior-level Full Time

Noida

1d ago
C Engineer - Bangalore/Pune INR 2000K-2500K

Bash | C# | Character sets | Code generation | Compiler Writing

Mid-level Full Time

Bangalore, India

1d ago
Lead Data Engineer - R01553055 INR 1500K-2000K

Apache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CD

Competitive benefits | Growth opportunities | Remote flexibility

Senior-level Full Time

Bangalore, Karnataka, India

1d ago
Staff Software Developer, AI/ML INR 2500K-3100K

AWS | Argo CD | Automation Testing | Azure | Big Data

Flexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programs

Senior-level Full Time

Bangalore, KA, India

1d ago
IN_Associate_AI Engineer_GCC_Advisory_Bangalore INR 3000K-4800K

API Development | Agent evaluation | Anthropic API | Async Programming | Autogen

Flexibility programmes | Inclusive benefits | Mentorship | Work-life balance support

Senior-level Full Time

Bengaluru Millenia, India

1d ago
IN_Senior Associate_Java/Python_Risk Analytics - GRC_Advisory_Gurgaon INR 2400K-3500K

Artificial Intelligence | Audit | Compliance | Data Analysis | Data Modeling

Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing support

Senior-level Full Time

Gurugram 8 B, India

1d ago
Python Developer INR 300K-420K

Agile | CSS | Git | HTML | JavaScript

Career growth | Health insurance | Performance bonuses | Professional development

Entry-level Full Time

Ahmedabad, India

1d ago
Data Engineer INR 1800K-2040K

API | Airflow | BigQuery | CI/CD | Composer

Hybrid work

Mid-level Full Time

Hyderabad, Telangana, India

1d ago
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-5000K

API Integration | Agent Development | Agent Development Kit | Agent systems | Cloud platform

Senior-level Full Time

Mumbai, Maharashtra, India; Bengaluru, Karnataka, India

1d ago
AWS With GenAI INR 1300K-1700K

API Gateway | AWS Fargate | AWS Glue | AWS IAM | AWS KMS

Remote Working | Work-life balance

Mid-level Full Time

Bangalore, KA, IN, 560100

2d ago

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs