Staff Data Engineer-Data Pipelines, Hadoop, Scala,spark,Kafka (6+yrs- 8 yrs)
Bengaluru, INDIA, India
INR 2040K-3100K (estimate) Senior-level Full Time
Tasks
- Architect and design scalable data and AI platform solutions
- Build and optimize batch and real time data pipelines
- Develop and maintain platform services
- Establish engineering best practices
- Implement Shift-Left quality practices
- Lead distributed systems technical initiatives
- Mentor engineers through design reviews and guidance
- Use AI assisted engineering tools
Perks/Benefits
Skills/Tech-stack
API | Agile | Apache Spark | Big Data | CI/CD | Distributed Systems | Docker | Git | Hadoop | JSON | JUnit | Java | Jenkins | Kafka | Kubernetes | LLM | Maven | Microservices | Mockito | Observability | Performance Testing | REST | Resiliency | Scalability | Secure Coding | Security | SonarQube
Education
Roles
Related jobs
-
Mid-level Full TimeBengaluru, IN, 5601034h ago
-
Senior_AI_developer INR 3000K-4500KCI/CD | CNN | Computer Vision | Data Preprocessing | Deep learningSenior-level Full Timepune, India5h ago
-
Senior_AI_developer INR 3000K-4500KAI pipeline | API Orchestration | ASPICE | Agent behavior | CI/CDSenior-level Full Timebangalore, India5h ago
-
Technologist, Software Development Engineering : 14 years + C, C++/Python Server / Storage/Firmware Architecture /Linux Kernel INR 2486K-5076KAPI Design | BIOS/UEFI | Block layer | Board Firmware | C#Senior-level Full TimeBengaluru, KA, India6h ago
-
Senior Data Engineer, Payments INR 2940K-4170KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache HBaseSenior-level Full TimeBangalore, India7h ago
-
Software Engineer 2 - AI/ML- Bangalore INR 1294K-2157KAWS | AWS Bedrock | Azure | Git | Google CloudMid-level Full TimeIndia7h ago
-
Cloud Data Platform Engineer-Senior INR 2000K-2400KAWS RDS | Azure SQL | Backup and Recovery | Bash | CI/CDSenior-level Full TimeBengaluru, KA, IN, 56001612h ago
-
Sr. AI/Data Scientist INR 2500K-5000KAWS | Agent workflows | Automated testing | CI/CD | ContainersSenior-level Full TimeBangalore, Karnataka, IN India, 56008712h ago
-
EY - GDS Consulting - AIA - Gen AI - Manager INR 1800K-2500KAWS | Agent Orchestration | Azure | Caching | Cost OptimizationMentorship | Professional developmentMid-level Full TimeBengaluru, KA, IN, 56001612h ago
-
Data Platform Engineer - Assistant Vice President INR 1500K-6000KAWS | Apache Flink | Database APIs | Docker | Event DrivenExecutive-level Full TimeTOWER B, EON FREE ZONE II, …12h ago
-
ALB | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsEmployee Mental Wellness Assistance Program | Employee investment plan | Medical coverage | Paid time off | Relocation assistanceEntry-level Full TimeBangalore, Karnataka, India12h ago
-
Data Science AI Pod Member INR 2500K-3100KAgile | Data Pipelines | Deep learning | Feature Engineering | Generative AIOnsite work 5 days per week | Relocation assistanceEntry-level Full TimeChennai, Tamil Nadu, India12h ago
-
Assistant Vice President -Senior Bigdata Engineer INR 1500K-2000KApache Kafka | Apache Spark | Couchbase | Data Analysis | Data GovernanceSenior-level Full TimeTOWER B, EON FREE ZONE II, …12h ago
-
Assistant Vice President -Senior Java -Spark -Bigdata Engineer INR 2040K-2800KApache Kafka | Apache Spark | Couchbase | Data Warehousing | DockerSenior-level Full TimeTOWER B, EON FREE ZONE II, …12h ago
-
Tech Lead - AI Platform & Consumer Systems INR 1800K-4800KAPIs | Agent Frameworks | Agent systems | Databases | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
AI auditability | Accelerate | Access Control | Attention Mechanisms | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Data Engineer INR 2500K-3500KAgile | Apache Airflow | CI/CD | Cloud platform | Data EngineeringCross-functional collaboration | Flexible working options | Hybrid working | Job shadowing | Leadership development programsSenior-level Full TimeHyderabad Knowledge City (LTC), India12h ago
-
Sr Analyst, Data Engineering INR 1500K-2040KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeIND07, India12h ago
-
Senior Data Engineer - GBS IND INR 1800K-2800KAutoscaling | Backups | Disaster Recovery | Federation | HadoopSenior-level Full TimeHyderabad, India12h ago
-
Senior-level Full TimeBlock 1 DT, Chennai India12h ago
-
AWS | Agile | CI/CD | Datadog | DockerSenior-level Full TimeBengaluru, INDIA, India21h ago
-
Software Developer, AI - Sr INR 2000K-3800K.NET | AI bias | Convolutional Neural Networks | Csharp | Data EthicsSenior-level Full TimeHyderabad, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka1d ago
-
Staff Data Engineer INR 2800K-4000KAccess Control | Airflow | Amazon Redshift | Amazon Web Services | Apache FlinkFlexible work policy | Learning and development platform | Medical benefitsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer INR 1500K-2000KAirflow | CI/CD | Cloud Composer | Cloud Functions | Cloud StorageHealth insurance | Learning and developmentMid-level Full TimeNoida, Uttar Pradesh1d ago