Staff Data Engineer-Data Pipelines, Hadoop, Scala,spark,Kafka (6+yrs- 8 yrs)
Bengaluru, INDIA, India
INR 2040K-3100K (estimate) Senior-level Full Time
Tasks
- Architect and design scalable data and AI platform solutions
- Build and optimize batch and real time data pipelines
- Develop and maintain platform services
- Establish engineering best practices
- Implement Shift-Left quality practices
- Lead distributed systems technical initiatives
- Mentor engineers through design reviews and guidance
- Use AI assisted engineering tools
Perks/Benefits
Skills/Tech-stack
API | Agile | Apache Spark | Big Data | CI/CD | Distributed Systems | Docker | Git | Hadoop | JSON | JUnit | Java | Jenkins | Kafka | Kubernetes | LLM | Maven | Microservices | Mockito | Observability | Performance Testing | REST | Resiliency | Scalability | Secure Coding | Security | SonarQube
Education
Roles
Related jobs
-
Partner Engineer, Generative AI INR 2500K-4500KAWS | Azure | Bias Mitigation | C++ | Conversational AISenior-level Full TimeBangalore, India | Mumbai, India2h ago
-
Senior-level Full TimeMumbai, Maharashtra, India4h ago
-
Associate Process Manager INR 2000K-2500KAPI Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Agent systemsMid-level Full TimePune, Maharashtra, India6h ago
-
Mid-level Full TimeBengaluru, IN, 5601036h ago
-
Senior_AI_developer INR 3000K-4500KCI/CD | CNN | Computer Vision | Data Preprocessing | Deep learningSenior-level Full Timepune, India6h ago
-
Senior_AI_developer INR 3000K-4500KAI pipeline | API Orchestration | ASPICE | Agent behavior | CI/CDSenior-level Full Timebangalore, India6h ago
-
Technologist, Software Development Engineering : 14 years + C, C++/Python Server / Storage/Firmware Architecture /Linux Kernel INR 2486K-5076KAPI Design | BIOS/UEFI | Block layer | Board Firmware | C#Senior-level Full TimeBengaluru, KA, India7h ago
-
Senior Data Engineer, Payments INR 2940K-4170KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache HBaseSenior-level Full TimeBangalore, India8h ago
-
Software Engineer 2 - AI/ML- Bangalore INR 1294K-2157KAWS | AWS Bedrock | Azure | Git | Google CloudMid-level Full TimeIndia8h ago
-
Cloud Data Platform Engineer-Senior INR 2000K-2400KAWS RDS | Azure SQL | Backup and Recovery | Bash | CI/CDSenior-level Full TimeBengaluru, KA, IN, 56001613h ago
-
Sr. AI/Data Scientist INR 2500K-5000KAWS | Agent workflows | Automated testing | CI/CD | ContainersSenior-level Full TimeBangalore, Karnataka, IN India, 56008713h ago
-
EY - GDS Consulting - AIA - Gen AI - Manager INR 1800K-2500KAWS | Agent Orchestration | Azure | Caching | Cost OptimizationMentorship | Professional developmentMid-level Full TimeBengaluru, KA, IN, 56001613h ago
-
Data Platform Engineer - Assistant Vice President INR 1500K-6000KAWS | Apache Flink | Database APIs | Docker | Event DrivenExecutive-level Full TimeTOWER B, EON FREE ZONE II, …13h ago
-
ALB | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsEmployee Mental Wellness Assistance Program | Employee investment plan | Medical coverage | Paid time off | Relocation assistanceEntry-level Full TimeBangalore, Karnataka, India13h ago
-
Data Science AI Pod Member INR 2500K-3100KAgile | Data Pipelines | Deep learning | Feature Engineering | Generative AIOnsite work 5 days per week | Relocation assistanceEntry-level Full TimeChennai, Tamil Nadu, India13h ago
-
Assistant Vice President -Senior Bigdata Engineer INR 1500K-2000KApache Kafka | Apache Spark | Couchbase | Data Analysis | Data GovernanceSenior-level Full TimeTOWER B, EON FREE ZONE II, …13h ago
-
Assistant Vice President -Senior Java -Spark -Bigdata Engineer INR 2040K-2800KApache Kafka | Apache Spark | Couchbase | Data Warehousing | DockerSenior-level Full TimeTOWER B, EON FREE ZONE II, …13h ago
-
Tech Lead - AI Platform & Consumer Systems INR 1800K-4800KAPIs | Agent Frameworks | Agent systems | Databases | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
AI auditability | Accelerate | Access Control | Attention Mechanisms | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Data Engineer INR 2500K-3500KAgile | Apache Airflow | CI/CD | Cloud platform | Data EngineeringCross-functional collaboration | Flexible working options | Hybrid working | Job shadowing | Leadership development programsSenior-level Full TimeHyderabad Knowledge City (LTC), India13h ago
-
Sr Analyst, Data Engineering INR 1500K-2040KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeIND07, India13h ago
-
Senior Data Engineer - GBS IND INR 1800K-2800KAutoscaling | Backups | Disaster Recovery | Federation | HadoopSenior-level Full TimeHyderabad, India13h ago
-
Senior-level Full TimeBlock 1 DT, Chennai India13h ago
-
Data Visualization Engineer INR 720K-1000KCI/CD | DAX | Data Lineage | Data Modeling | Data QualityDiversity, equity, & inclusion programs | Employee assistance program | Employee referral program | Healthcare insurance | Hybrid work environmentMid-level Full TimeIND - Bengaluru, India13h ago
-
MLOps Engineer INR 1800K-2600KAWS | AWS Lambda | AWS Step Functions | Amazon CloudWatch | Amazon SageMakerMid-level Full TimeNoida, Candor TechSpace, India13h ago