IN_Senior Associate_Spark Scala_Data and Analytics_Advisory_Bangalore
Bengaluru Millenia, India
INR 2000K-2146K (estimate) Senior-level Full Time
Tasks
- Build and manage dependencies with Maven or SBT
- Build end to end data ingestion workflows
- Debug and optimize Spark jobs
- Design and optimize data processing pipelines
- Develop and maintain Hive data models and ETL processes
- Ensure data quality and reliability
- Implement CI/CD pipelines
- Orchestrate workflows with Airflow
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Hive | Apache Kafka | Apache Spark | CI/CD | Docker | ETL | Functional Programming | Git | GitHub Actions | Kubernetes | Maven | Oozie | SBT | Scala
Education
Bachelor of Engineering | Bachelor of Technology | MCA | Master of Computer Applications | Master of Engineering
Roles
Related jobs
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | Batch Processing | C++ | Cloud platform | DNSSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India3h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India4h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure OpenAI | CSS | DjangoMid-level Full TimeBangalore, Karnataka, India4h ago
-
Assistant Manager- AI Engineer with Cloude INR 2000K-3000KAWS | Autogen | Azure | Claude | Cloud platformLeadership opportunity | MentorshipMid-level Full TimeBangalore, Karnataka, India5h ago
-
AWS Data Engineer- Assistant Manager INR 1200K-2000KAWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeBangalore, Karnataka, India5h ago
-
Data Engineer INR 938K-1200KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India7h ago
-
Applied AI ML Associate Senior INR 1050K-1250KAWS | Big Data | CI/CD | Continuous Delivery | Continuous integrationMid-level Full TimeHyderabad, Telangana, India9h ago
-
Software Engineer III - Data Engineer INR 1500K-2146KAWS | Apache Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
IN-Associate_AI/ML Developer_MS Engg_Advisory_Kolkata INR 1500K-2000KApp Service | Azure App | Azure App Service | Azure Blob | Azure Blob StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India15h ago
-
CI/CD | Couchbase | Design Patterns | Docker | GuiceSenior-level Full TimeGurugram 8 B, India15h ago
-
Mid-level Full TimeBangalore, KA, IN, 56214915h ago
-
Mid-level Full TimeIndia - Hyderabad15h ago
-
Senior-level Full TimeIndia - Hyderabad15h ago
-
Mid-level Full TimeIndia - Hyderabad15h ago
-
Mid-level Full TimeIndia - Hyderabad15h ago
-
Senior-level Full TimeIndia - Hyderabad15h ago
-
Mid-level Full TimeIndia - Hyderabad15h ago
-
Senior Engineer Data - MDM INR 1628K-2146KAgile | Amazon Web Services | Azure | Cloud Platforms | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India15h ago
-
Lead Engineer Data - MDM INR 1500K-2040KAPIs | Agile | Amazon Web Services | Azure | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India15h ago
-
TTT - GTP IT - Manager INR 1500K-2500KAI Agents | Alteryx | Automation frameworks | Cloud Platforms | Data ModelingMid-level Full TimeBengaluru, KA, IN, 56001615h ago
-
Agentic AI Engineer INR 2500K-5000KAPI Integration | Agent systems | Amazon Web Services | Azure | Backend DevelopmentSenior-level Full TimePune, MH, IN, 41101815h ago
-
Data Platform Engineer INR 800K-1200KCloud Architecture | Data Architecture | Data Modeling | Data Warehouse | Data integrationMid-level Full TimeHyderabad, HDC4A, India15h ago
-
Data Platform Engineer INR 800K-1200KCloud Data | Cloud Data Architecture | Data Architecture | Data Modeling | Data WarehouseMid-level Full TimeHyderabad, HDC4A, India15h ago
-
Data Platform Engineer INR 800K-1200KCloud Data | Cloud Data Architecture | Data Architecture | Data Modeling | Data WarehouseMid-level Full TimeHyderabad, HDC4A, India15h ago
-
Data Platform Engineer INR 800K-1200KCloud Architecture | Data Modeling | Data Query | Data Query Optimization | Data WarehouseMid-level Full TimeHyderabad, HDC4A, India15h ago