Sr. Data Engineer - (RealTime Streaming)
Bengaluru, Karnataka, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply GitOps for deployment automation
- Automate infrastructure provisioning and deployment with Terraform
- Build cloud native data engineering solutions
- Build streaming data pipelines
- Design Kafka real time streaming architectures
- Develop Apache Flink applications
- Ensure fault tolerant resilient streaming systems
- Implement Kafka high availability and disaster recovery
- Implement security for Kafka using SSL mTLS SASL ACL
- Manage Kafka cluster setup administration configuration tuning monitoring
Perks/Benefits
- N/A
Skills/Tech-stack
ACL | Apache Flink | Apache Kafka | Cloud Native | Cloud-native applications | Cluster management | Data Pipelines | Disaster Recovery | Fault Tolerance | GitOps | High Availability | Java | KSQLDB | Kafka Cluster | Kafka Connect | Kafka cluster management | MTLS | Native Applications | Performance Tuning | PySpark | Real Time | Real Time Streaming Architecture | Real-time Streaming | SASL | SSL | Scalability | Schema Registry | Streaming Architecture | Streaming Data | Streaming data pipelines | Terraform
Education
N/A
Roles
Related jobs
-
Senior Software Engineer (Infra) INR 2400K-3500KC++ | Distributed Systems | Java | Networking | PythonSenior-level Full TimeBengaluru, India15h ago
-
Senior Software Engineer - Data Platform INR 2500K-3584KAWS | Agentic AI | Apache Airflow | Apache Druid | Apache FlinkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India R16h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India17h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India1d ago
-
DATA Architect - Lead Systems Engineer INR 2771K-4132KAgile | Apache Airflow | Apache Kafka | Apache Spark | Audit LoggingSenior-level Full TimeIndia1d ago
-
AI Foundry | AWS | AWS SageMaker | Agentic AI | Amazon Bedrock401k match | Career development resources | Dental insurance | Flexible work arrangements | Health Savings Account medical planSenior-level Full TimeIndia1d ago
-
Engineer, Storage and Data Protection INR 1500K-2600KAlerting | Ansible | Automation | Backup | BashMid-level Full TimeGurugram, Haryana1d ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Senior-level Full TimeGurugram, India1d ago
-
Senior Forward Deployed Engineer INR 1500K-2800KAI APIs | AWS | Apache Spark | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer, AI/ML INR 2000K-5000K3D mathematics | Agent systems | Autonomous Agents | C plus plus | Computational GeometrySenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer (GCP, Azure) INR 1500K-2500KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Data PipelinesSenior-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Software Engineer - Workflow INR 3715K-5000KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureSenior-level Full TimeIndia (Bengaluru)1d ago
-
Software Engineer, Data Science INR 1000K-2000KD3 | Data Governance | Data Modeling | Data Pipelines | ETLHealth and wellness programs | Time awayMid-level Full TimeBengaluru, KA, India R1d ago
-
Entry-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer 3 INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Continuous integration | Data CatalogMid-level Full TimePune, Maharashtra, India1d ago
-
Lead Software Engineer - Java AWS Kafka INR 2500K-3500KAWS | Agile | Apache Kafka | CI/CD | CachingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN1d ago
-
Senior Database Engineer / Senior Consultant Specialist INR 2000K-3200KAccess Control | Backup and Recovery | BigQuery | CI/CD | CassandraSenior-level Full TimePune, Maharashtra, India R1d ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India1d ago
-
Mid-level Full TimePune, India1d ago
-
Tech Lead Data Engineer INR 1500K-2600KAWS Data | AWS Glue | AWS data warehousing | Amazon Athena | Amazon EKSGreat Place to Work recognitionSenior-level Full TimePune, India1d ago
-
Embedded C++ & PLC Automation Engineer-EPS1 INR 1716K-2700KBuild systems | C++ | C++17 | CAN | Case DevelopmentSenior-level Full Timebangalore, India1d ago