Sr. Data Engineer - (RealTime Streaming)
Bengaluru, Karnataka, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply GitOps for deployment automation
- Automate infrastructure provisioning and deployment with Terraform
- Build cloud native data engineering solutions
- Build streaming data pipelines
- Design Kafka real time streaming architectures
- Develop Apache Flink applications
- Ensure fault tolerant resilient streaming systems
- Implement Kafka high availability and disaster recovery
- Implement security for Kafka using SSL mTLS SASL ACL
- Manage Kafka cluster setup administration configuration tuning monitoring
Perks/Benefits
- N/A
Skills/Tech-stack
ACL | Apache Flink | Apache Kafka | Cloud Native | Cloud-native applications | Cluster management | Data Pipelines | Disaster Recovery | Fault Tolerance | GitOps | High Availability | Java | KSQLDB | Kafka Cluster | Kafka Connect | Kafka cluster management | MTLS | Native Applications | Performance Tuning | PySpark | Real Time | Real Time Streaming Architecture | Real-time Streaming | SASL | SSL | Scalability | Schema Registry | Streaming Architecture | Streaming Data | Streaming data pipelines | Terraform
Education
N/A
Roles
Related jobs
-
Software Engineer III, ML Infrastructure, Google Cloud INR 2500K-5000KBack-end | Back-end development | C++ | Cloud APIs | Data StorageSenior-level Full TimePune, Maharashtra, India2h ago
-
Senior-level Full TimeBengaluru, KA, IN5h ago
-
Sr. Data Engineer INR 3000K-4000KApache Kafka | Apache Spark | Data Modeling | Data Pipelines | Data integrationSenior-level Full TimeBangalore, Karnataka, IN5h ago
-
Software Engineer III - Java, Springboot, Cloud INR 2200K-3500KAPI Gateway | Agile | Artificial Intelligence | CI/CD | CassandraSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Software Engineer III - ETL Testing ,Pyspark, AWS INR 2000K-3100KAWS CloudFormation | AWS Glue | AWS Glue Data Catalog | AWS Lambda | AWS MSKAgile team environment | Automated testing validation | Peer reviewSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Software Engineer II- ETL Testing ,Pyspark, AWS INR 2000K-3000KAWS | Agile | Apache Spark | Application Resiliency | CI/CDEntry-level Full TimeMumbai, Maharashtra, India7h ago
-
AWS | AWS Kinesis | Agile | Apache Kafka | Cloud platformCloud certification support | Collaborative innovation environment | Inclusive diverse workplace | Mentoring and thought leadership opportunities | Professional developmentSenior-level Full TimeIndia9h ago
-
ML & AI Engineer II INR 1860K-3000KAPIs | Classification | Cloud Platforms | Computer Vision | Data PipelinesCareer growth opportunities | Continuous learning and development | Flexible work arrangements | Hybrid work arrangements | Inclusive work environmentMid-level Full TimeNavi Mumbai, India10h ago
-
API Development | Access Control | Artificial Intelligence | Automation | CI/CDCareer growth | Fully remote work | Paid time off | Professional developmentMid-level Full TimeIndia R10h ago
-
Cloud Database Platform Engineer INR 1500K-4000KAWS RDS | Amazon Aurora | Amazon CloudWatch | Amazon EC2 | Amazon IAMEducation support | Generous time-off policies | Wellness and lifestyle supportSenior-level Full TimeBangalore10h ago
-
Cloud Engineer, Specialist CDAO Data Mgmt. & Analytics Platforms INR 2000K-3000KAWS | Agile | Automation | CI/CD | Capacity PlanningFinancial wellness programs | Hybrid working model | Personal wellness resources | Physical wellness benefits | Wellness supportMid-level Full TimeHyderabad, India14h ago
-
Senior Data Engineer - (Flink/Kafka/PySpark) INR 1500K-2500KAgile | Anonymization | Apache Flink | Apache Kafka | CI/CDSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Palantir Foundry Developer INR 1300K-2500KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksMid-level Full TimePune, Maharashtra, India14h ago
-
Sr. Data Engineer Ops Data Analytics INR 1500K-2500KAzure Data | Azure Data Factory | Data Clustering | Data Factory | Data ModelingSenior-level Full TimeGurgaon Sector 59, India14h ago
-
EY - GDS Consulting - AI And DATA - Databricks - Senior INR 2400K-4000KAPIs | Apache Spark | Azure | Azure Data | Azure Data FactoryGlobal scale | Inclusive culture | Supportive team environmentSenior-level Full TimeTrivandrum, KL, IN, 69558114h ago
-
Senior Manager - Data Engineer- Methodology & Assumption (M&A) Actuarial Policyholder Data Team INR 2817K-4064KApache Spark | Azure Databricks | Data Governance | Data Modeling | Data PipelinesSenior-level Full TimeMumbai Central Avenue, India14h ago
-
Senior Data Engineer INR 3000K-4000KAPIs | Algorithms | Amazon Kinesis | Amazon Redshift | Amazon Web ServicesDiscounted gym memberships | Flexible working | Life assurance | Medical insurance | Pension schemeSenior-level Full TimeHyderabad, India17h ago
-
Senior-level Full TimeKochi, Kerala, India19h ago
-
Specialist Cloud Database Engineer (SQL, DevOps, AWS) INR 2156K-2500KAlwaysOn Availability | AlwaysOn availability groups | Amazon Aurora | Amazon CloudFormation | Amazon RDSHybrid work model | Office collaboration days | Remote work flexibilitySenior-level Full TimeIndia - Pune R22h ago
-
Mid-level Full TimeUttar Pradesh, India1d ago
-
Senior Software Engineer, Data INR 2475K-4200KApache Airflow | Apache Flink | Apache Spark | CSV | Data LineageFlexible policies | Hybrid work | Internal mobility | Professional developmentSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Agentic AI - Lead Engineer INR 2500K-5000KAgile | Anomaly Detection | CI/CD | Data Preprocessing | Data VisualizationSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Data Engineer II INR 1500K-2500KAWS AppFlow | AWS Glue | AWS Step Functions | Amazon Redshift | Amazon S3Continuous learning | Hybrid work | Leadership development | Professional certifications | Quarterly perks programMid-level Full TimeChennai1d ago
-
Data Engineer IV INR 1500K-2500KAWS | AWS AppFlow | AWS Glue | AWS Step Functions | Amazon Lake FormationHybrid work | Leadership development | Professional certification access | Time offSenior-level Full TimeChennai1d ago
-
Staff Software Engineer, Server AI Foundations INR 2500K-5000KAgents | C++ | CI/CD | Data Storage | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India1d ago