Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Bangalore, KA, IN

INR 1500K-2000K (estimate) Mid-level Full Time

@ N...

Apply Save

Found 5d ago

Tasks

Analyze usage patterns to deliver data products
Build data reconciliation and validation frameworks
Ensure migrated data matches production functional requirements
Execute physical data migration while ensuring data integrity
Manage schema evolution and enforcement strategies
Optimize data partitioning and clustering
Perform end to end datastore migration from on prem DataLake to AWS Lakehouse
Refactor and migrate extraction logic and job scheduling
Serve as technical liaison to data owners for handoff and sign off
Translate and optimize legacy SQL and Apache Spark consumption patterns for Snowflake and Apache Iceberg

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

WFS Analytics 168231 INR 1500K-2400K

Agile | Architectural patterns | Design Patterns | Java | JavaScript

Mid-level Full Time

Hyderabad, IND-TG, India

15h ago
Senior Data Engineer (QA AI Automation) INR 2000K-2500K

Azure DevOps | CI/CD | CSS | Cypress | Defect Reporting

Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time off

Senior-level Full Time

Pune, MH, India

17h ago
Senior Data Engineer INR 2520K-4000K

AWS | Business Intelligence | Cloud platform | Data Modeling | Data Quality

Hybrid work | Professional development | Remote work

Senior-level Full Time

Delhi NCR/Remote R

18h ago
ML Ops INR 2500K-3000K

AWS | CI/CD | Datadog | Distributed Systems | Docker

Mid-level Full Time

Chennai, India

18h ago
Senior ML Engineer INR 2500K-3000K

AWS | Cloud Computing | Cloud platform | Data Pipelines | Docker

Senior-level Full Time

Chennai, India

18h ago
Senior Data Engineer INR 3000K-4000K

AWS | AWS Data | AWS Data Services | Amazon Aurora | Apache Spark

Accreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount

Senior-level Full Time

Mumbai, MH, India

19h ago
Senior Data Engineer INR 2400K-3500K

API Integration | AWS | ETL | NumPy | Pandas

Hybrid work | Professional development | Remote work

Senior-level Full Time

Greater Delhi Area R

19h ago
Lead Consultant, ETL Data Engineer and Python INR 2520K-4000K

Data Governance | Data Modeling | Data Quality | Data Warehousing | Data integration

Senior-level Full Time

India-Bangalore

19h ago
Backend Engineer INR 1800K-4000K

AWS | Aggregation Framework | Apache Kafka | Azure | CAP Theorem

Senior-level Full Time

IN-TN-Chennai

19h ago
Gen AI INR 2500K-4512K

API Development | Chroma | Data Engineering | Faiss | Java

Full-time employment

Senior-level Full Time

IN-TN-Chennai

19h ago
GCP Data Engineer INR 1500K-2400K

Airflow | Alation | Amazon Redshift | Apache Flink | BigQuery

Senior-level Full Time

IN-AP-Hyderabad

19h ago
Data Engineer INR 1200K-2040K

AWS CDK | AWS Glue | AWS Glue Data Catalog | AWS Lambda | Amazon Athena

Senior-level Full Time

IN-TN-Chennai

19h ago
Senior Data Engineer (R-19107) INR 2400K-3356K

Data Analysis | Data Modeling | Data Quality | Data Visualization | Data integration

Senior-level Full Time

Hyderabad - India

19h ago
Data Engineer (R-19111) INR 1500K-2000K

Data Analysis | Data Quality | Data Transformation | Data Visualization | Data cleaning

Mid-level Full Time

Hyderabad - India

20h ago
Core Data Platform - Software Engineering-Associate-Bengaluru INR 2500K-3500K

AWS | AWS Lambda | Agile | CloudFormation | Data Modeling

Global networks | Mindfulness programs | Personal finance offerings | Training and development | Wellness programs

Senior-level Full Time

Bengaluru, Karnataka, India

20h ago
DevOps Engineer INR 1600K-2500K

AWS | Agile | Apache Iceberg | Argo Workflows | Authentication

Mid-level Full Time

Gurgaon, Haryana, India

20h ago
Cloud Support Engineer-Database INR 850K-1000K

AWS | Ansible | Azure | Backups | ClickHouse

Conference reimbursement | Employee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning access

Mid-level Full Time

Bengaluru

20h ago
Software Engineer (Scala and Spark) INR 2516K-3356K

Agile | Apache Spark | Azure | CI/CD | Cause analysis

Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off

Senior-level Full Time

Chennai, TN, India

21h ago
Senior Software Engineer, Cloud Bigtable INR 2000K-3500K

Bigtable | C++ | CI/CD | Cassandra | Column-stores

Senior-level Full Time

Bengaluru, Karnataka, India

21h ago
Software Engineer, Cloud Infrastructure Engineering INR 1000K-1500K

APIs | Capacity Planning | Compute Technologies | Data Structures | Data Structures and Algorithms

Mid-level Full Time

Bengaluru, Karnataka, India

21h ago
AI Engineer INR 2000K-3500K

AWS | Airflow | Amazon Bedrock | BM25 | CI/CD

Senior-level Full Time

IN-Karnataka-Bangalore

21h ago
Senior Analyst INR 2500K-4000K

AWS | Agent Orchestration | Anthropic API | Autogen | Chroma

Senior-level Full Time

Mumbai, Maharashtra, India

22h ago
Azure Data & Fabric Developer -Deputy Manager - RNA INR 1500K-2000K

Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory

Mid-level Full Time

Mumbai, MH, India

22h ago
AI/ML Engineer INR 2000K-3000K

BigQuery | CI/CD | COT | Cloud Functions | Cloud Run

Mid-level Full Time

Noida, Uttar Pradesh, India

22h ago
Group Manager - Data Engineering INR 1500K-2000K

APIs | Agile | Angular | Apache Airflow | BigQuery

Mid-level Full Time

Gurgaon, HR, India

22h ago

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs