Staff Data Engineer-Data Pipelines,Hadoop,Spark,Kafka,Java 8+(6+yrs- 8 yrs)
Bengaluru, INDIA, India
INR 2500K-3100K (estimate) Senior-level Full Time
Tasks
- Architect data and AI platform solutions
- Build and optimize batch data pipelines
- Build and optimize real-time data pipelines
- Design scalable enterprise architectures
- Develop and maintain platform services
- Establish engineering best practices for scalability resiliency performance security
- Implement CI/CD pipelines
- Lead distributed systems initiatives
- Mentor engineers through design reviews and architectural guidance
- Work in agile development environments
Perks/Benefits
Skills/Tech-stack
Agile | CI/CD | Containers | Distributed Systems | Git | Hadoop | JSON | JUnit | Java | Java 8 | Jenkins | Kafka | Maven | Mockito | Observability | Performance Testing | REST APIs | Resiliency engineering | Secure Coding | SonarQube | Spark
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Sr Data Engineers - AI/ML - Chennai INR 2500K-4500KAPI Security | Agent systems | Asynchronous programming | CI/CD | Docker401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeIndia3h ago
-
Software Engineering INR 1500K-2000KAI Driven | AI-driven development | Apache Spark | C# | C++On-call support rotationMid-level Full TimeBengaluru, KA, IN4h ago
-
AI ML Data Engineer for ADAS Sr Backend Developer INR 2535K-4225KAWS | Apache Kafka | Azure | CI/CD | Cloud platformSenior-level Full Timebangalore, India7h ago
-
AWS | Azure | Business Rules | Data Catalog | Data CleansingAgile work culture | Learning opportunities | Team collaborationEntry-level Full Timepune, India7h ago
-
Sr.Staff Software Engineer- Networking INR 3100K-3380KC++ | Cloud Networking | CloudFormation | Distributed Systems | Infrastructure automationSenior-level Full TimeBengaluru, India8h ago
-
Senior-level Full TimeHyderabad, Telangana, India8h ago
-
SW Engineer (6 months - 2 yrs Experience - Java/Python, UNIX, J2EE, REST & SOAP, Automation, Gen AI) INR 700K-700KAgile | Automation | CI/CD | Deep learning | GenAICareer development | Continued learning | Hybrid work model | MentorshipEntry-level Full TimeBengaluru, INDIA, India8h ago
-
Azure Lead Data Engineer INR 1200K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
AI - Sr Group Manager INR 2500K-4500KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | Agentic developmentSenior-level Full TimePune, Maharashtra, India9h ago
-
Sr Devops Engineer Platform Engineering INR 2500K-3065KAPI Gateway | AWS | AWS CodePipeline | Ansible | BackupReward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India9h ago
-
AWS Data Engineer INR 2000K-3000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Senior Software Engineer (Python/SQL/Data Engineering) (m/f/x) INR 3200K-3880KAWS | Apache Spark | Azure | Backend systems | ClickHouseSenior-level Full TimeBangalore10h ago
-
Sr Data Engineer INR 2250K-2600KAWS | Airflow | Apache Hive | Apache Spark | AzureContinuous learning culture | Hybrid work environmentSenior-level Full TimeBengaluru, INDIA, India10h ago
-
Software Engineer II INR 3375K-4590KAWS | Apache Maven | CI/CD | Eclipse | GitLab CICross-functional team projects | Learning and training opportunitiesSenior-level Full TimeMumbai, India11h ago
-
Software Engineer II INR 2486K-4144KAWS | Agile | CSS | CloudFront | Code reviewMentoring | Mentorship opportunities | Professional growthEntry-level Full TimeBengaluru, KA, India11h ago
-
Software Development Engineer, Transportation Financial Systems INR 1317K-2000KAlgorithms | Big Data | Design Patterns | Distributed Systems | High AvailabilityMid-level Full TimeBengaluru, Karnataka, IND15h ago
-
ARM | App Service | Application Insights | Azure | Azure DevOpsSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 1628K-2040KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-2146KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-2146KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Work-life balanceSenior-level Full TimeGurugram 10 C, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-2146KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
App Service | Application Insights | Azure App | Azure App Service | Azure DevOpsSenior-level Full TimeBengaluru Millenia, India15h ago
-
App Service | Application Insights | Azure App | Azure App Service | Azure DevOpsFlexible work programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
App Service | Application Insights | Azure App | Azure App Service | Azure ArtifactsSenior-level Full TimeBengaluru Millenia, India15h ago
-
Automation | CI/CD | Cloud Platforms | Containerization | DevOpsFlexible work programs | Hybrid work environment | MentorshipSenior-level Full TimeChennai - Menon Eternity, India15h ago