Kafka Engineer
Bengaluru, India
Fractal
Fractal is a strategic analytics partner to global Fortune 500 companies & powers every human decision in the enterprise with AI, engineering & design.It's fun to work in a company where people truly BELIEVE in what they are doing!
We're committed to bringing passion and customer focus to the business.
Job Summary
We are looking for a skilled Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain high-performance, real-time data streaming pipelines. The ideal candidate will have expertise in Kafka ecosystem components and be well-versed in deploying and scaling Kafka clusters, both on-prem and in cloud environments.
Key Responsibilities
- Design, build, and manage Kafka and Confluent infrastructure for high throughput streaming applications
- Implement Kafka Connect, Schema Registry, and KSQL (KSQLDB), FlinkSQL
- Ensure high availability, performance tuning, and monitoring of Kafka clusters
- Collaborate with data engineers and backend teams to integrate streaming pipelines with data lakes, warehouses.
- Set up and enforce Kafka security mechanisms (SASL, SSL, ACLs, RBAC)
- Create and manage CI/CD pipelines for Kafka components using tools like Git, Jenkins, etc.
- Monitor and troubleshoot issues using tools like Confluent Control Center, DataDog
Required Skills
- Experience in Apache Kafka and Confluent Platform
- Experience with Kafka Connect, Kafka Streams, Schema Registry, KSQL, and FlinkSQL
- Strong background in Java or Python
- Good understanding of stream processing and event-driven architecture
- Hands-on experience with cloud platforms: AWS / Azure / GCP (esp. Confluent Cloud)
- Proficient in Kafka cluster deployment, tuning, and maintenance
- Familiarity with CI/CD, Git, Helm, and Kubernetes
Nice to Have
- Knowledge of Terraform, Pulumi, or other Infra as Code tools
- Exposure to DataOps / Data Engineering ecosystems
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture AWS Azure CI/CD DataOps Engineering GCP Git Helm Java Jenkins Kafka Kubernetes Pipelines Python Security Streaming Terraform
Perks/benefits: Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.