Data Engineer - Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg
Tasks
- Build data pipelines
- Deploy applications on Kubernetes
- Design data models
- Implement CI/CD pipelines
- Manage schema evolution
- Optimize data partitioning
- Process streaming data
- Troubleshoot SQL and scripts
Perks/Benefits
- N/A
Skills/Tech-stack
ANSI SQL | Apache Iceberg | Apache Spark | Avro | CI/CD | FTP | HDFS | Hadoop | Hive | JSON | Kafka | Kubernetes | Parquet | Python | SQL | Snowflake | Sybase IQ
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | Batch Processing | C++ | Cloud platform | DNSSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India1h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India1h ago
-
Data Engineer INR 938K-1200KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India4h ago
-
Software Engineer + Gen AI (Fresher) INR 300K-540KAI Model Integration | AI model | API Integration | Algorithms | Data StructuresEntry-level Full TimePune, MH, India5h ago
-
Applied AI ML Associate Senior INR 1050K-1250KAWS | Big Data | CI/CD | Continuous Delivery | Continuous integrationMid-level Full TimeHyderabad, Telangana, India6h ago
-
IN-Associate_AI/ML Developer_MS Engg_Advisory_Kolkata INR 1500K-2000KApp Service | Azure App | Azure App Service | Azure Blob | Azure Blob StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India12h ago
-
CI/CD | Couchbase | Design Patterns | Docker | GuiceSenior-level Full TimeGurugram 8 B, India12h ago
-
Sr. Azure Data Engineer INR 1500K-2000KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN12h ago
-
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBhubaneswar - Ihub, India12h ago
-
Mid-level Full TimeBangalore, KA, IN, 56214912h ago
-
Mid-level Full TimeIndia - Hyderabad12h ago
-
Senior-level Full TimeIndia - Hyderabad12h ago
-
Mid-level Full TimeIndia - Hyderabad12h ago
-
Mid-level Full TimeIndia - Hyderabad12h ago
-
Senior-level Full TimeIndia - Hyderabad12h ago
-
Mid-level Full TimeIndia - Hyderabad12h ago
-
Senior Engineer Data - MDM INR 1628K-2146KAgile | Amazon Web Services | Azure | Cloud Platforms | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India12h ago
-
Lead Engineer Data - MDM INR 1500K-2040KAPIs | Agile | Amazon Web Services | Azure | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India12h ago
-
Lead Engineer Data INR 2156K-2400KAgile methodology | Automation | Azure | Azure Data | Azure Data FactoryFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India12h ago
-
TTT - GTP IT - Manager INR 1500K-2500KAI Agents | Alteryx | Automation frameworks | Cloud Platforms | Data ModelingMid-level Full TimeBengaluru, KA, IN, 56001612h ago
-
Agentic AI Engineer INR 2500K-5000KAPI Integration | Agent systems | Amazon Web Services | Azure | Backend DevelopmentSenior-level Full TimePune, MH, IN, 41101812h ago
-
Machine Learning Engineer, Chakra INR 2000K-4600KBenchmarking | Conversational AI | Data Pipelines | Deep learning | DockerMid-level Full TimeHybrid in Bangalore, India R16h ago
-
Technical Support Engineer INR 850K-1100KAmazon Web Services | Apache Hadoop | Apache Spark | Bash | Cloud platformFlexible paid time offMid-level Full TimeHyderabad, India18h ago
-
Senior-level Full TimeIndia19h ago
-
Software Engineer Lead (Python + Snowflake) INR 2040K-3100KAirflow | CI/CD | DBT | Dagster | Data ModelingSenior-level Full TimeIndia (Noida)19h ago