Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Bangalore, KA, IN

INR 1500K-2200K (estimate) Mid-level Full Time

@ N...

Apply Save

Found 21d ago

Tasks

Convert legacy SQL and Spark patterns for Snowflake and Iceberg
Coordinate stakeholder handoff and sign off
Migrate data pipelines to lakehouse environment
Optimize usage patterns for data products
Perform data reconciliation and quality checks
Refactor extraction logic and job scheduling
Transfer datasets ensuring data integrity
Validate data with reconciliation frameworks

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en | Views: 3 | Clicks: 0 | Saves: 0

Related jobs

Sr. DevOps Engineer INR 2500K-3500K

AIOps | AKS | ARM | Azure Container | Azure Container Registry

Rotational on-call support

Senior-level Full Time

Hyderabad, India

3h ago
Database Engineer INR 1500K-2400K

AWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data Warehousing

Senior-level Full Time

IN-TN-Chennai

4h ago
Database Engineer INR 1500K-2500K

AWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud Databases

Senior-level Full Time

IN-TN-Chennai

4h ago
Gen AI Developer INR 2000K-3000K

API Integration | Claude API | Context Management | CrewAI | FastAPI

Mid-level Full Time

IN-MH-Pune

4h ago
Snowflake Developer INR 400K-1200K

Apache Airflow | DBT | Data Sharing | Dynamic Tables | ETL

Senior-level Full Time

IN-TN-Chennai

4h ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

4h ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

4h ago
Aws Etl INR 1500K-2000K

AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch

Mid-level Full Time

IN-AP-Hyderabad

4h ago
Senior SW Engineer INR 2500K-4500K

Artificial Intelligence | CI/CD | Flyte | Java | Language Models

Senior-level Full Time

India

5h ago
Senior Applied Computer Vision Engineer - Data Driven Development INR 2000K-3900K

Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure ML

Senior-level Full Time

bengaluru, India

6h ago
Staff Software Engineer, Android Embedded Software INR 2000K-3200K

Android | C++ | Distributed Systems | Java | Performance optimization

Senior-level Full Time

Bengaluru, Karnataka, India

6h ago
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000K

Amazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMaker

Senior-level Full Time

Pune, Maharashtra, India

6h ago
Process Manager INR 1500K-2000K

Big Data | Data Modeling | Data pipeline | ETL | Hadoop

Mid-level Full Time

Mumbai, Maharashtra, India

6h ago
Manager - Python with Gen AI INR 1800K-3000K

Autogen | Claude | CrewAI | Data Pipelines | Event Driven

Mid-level Full Time

Bangalore, Karnataka, India

9h ago
Lead Software Engineer - Big Data INR 2040K-3380K

Amazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache Parquet

Senior-level Full Time

Mumbai, Maharashtra, India

10h ago
Assistant Manager- Python AI Developer INR 1800K-3000K

AWS | Autogen | Azure | Claude | CrewAI

Mid-level Full Time

Bangalore, Karnataka, India

10h ago
Consultant - Python Developer with Gen AI INR 2500K-4500K

AWS | Autogen | Azure | CrewAI | Docker

Senior-level Full Time

Bangalore, Karnataka, India

10h ago
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500K

Agent-based | Agent-based frameworks | Autogen | Claude | Cloud Computing

Mid-level Full Time

Bangalore, Karnataka, India

10h ago
Data Platforms Manager INR 2000K-2400K

AWS | Alerting | Amazon Aurora | Amazon RDS | Ansible

Senior-level Full Time

Hyderabad, India

11h ago
Sr. Data Engineer INR 2800K-4000K

Cloud warehousing | DAX | Dashboard Design | Data Quality | Data Storytelling

Community outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentives

Senior-level Full Time

Bangalore, KA, IN, 560037

11h ago
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500K

AWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CD

Senior-level Full Time

Hyderabad, Telangana, India

11h ago
Data Engineer INR 3000K-4000K

Apache Airflow | Apache Kafka | Apache Spark | Big Data | BigQuery

Senior-level Full Time

Gurgaon, Haryana, India

11h ago
Software Engineer INR 1000K-1496K

Bitbucket | Data Architecture | Data Modeling | Data Pipelines | Linux

Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off

Mid-level Full Time

Chennai, TN, India

11h ago
Database Reliability/Automation Engineer INR 1000K-1820K

Ansible | Bash | CI/CD | CloudFormation | Docker

Mid-level Full Time

India

11h ago
Data Scientist- GenAI Engineer INR 2000K-3000K

A/B | A/B Testing | B testing | Causal Inference | Clustering

Mid-level Full Time

Noida, Uttar Pradesh, India

11h ago

Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs