Senior Confluent Kafka Lead
Columbus, United States
USD 140K-213K (estimate) Senior-level Full Time
Tasks
- Build real-time pipelines
- Build streaming microservices
- Define topic design standards
- Design Kafka solutions
- Design event-driven integration patterns
- Develop Python Kafka consumers
- Develop Python Kafka producers
- Enforce Kafka security controls
- Enforce data governance
- Ensure high availability, fault tolerance, scalability
- Handle idempotency retries back pressure
- Implement ACL authorization
- Implement CI/CD pipelines
- Implement Confluent Platform
- Implement SASL OAuth authentication
- Implement TLS encryption
- Implement message serialization
- Implement monitoring and alerting
- Implement schema validation
- Integrate Kafka with data platforms
- Manage Kafka clusters
- Manage infrastructure as code
- Mentor developers
- Partner on roadmap and capacity planning
- Provision and manage Kafka infrastructure
- Review Kafka and Python streaming solutions
- Serve as Kafka subject matter expert
- Troubleshoot streaming production issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Access Control Lists | Apache Kafka | Avro | Azure | Azure DevOps | Bicep | Cloud platform | CloudFormation | Confluent Control Center | Confluent Kafka | Confluent Platform | Control center | Docker | GitHub Actions | GitLab | Google Cloud | Google Cloud Platform | Grafana | Infrastructure as Code | JSON | Jenkins | KSQLDB | Kafka Connect | Kafka Streams | Kubernetes | OAuth | Prometheus | Protobuf | Python | SASL | Schema Registry | TLS | Terraform | “as-code”
Education
N/A
Roles
Data Engineer | DevOps | DevOps Engineer | Engineer | Senior Software Engineer | Software Engineer
Related jobs
-
AI Software Engineer USD 100K-200KDeep learning | Language Models | Large Language Models | Machine Learning | PyTorchMid-level Full TimeSan Francisco, CA, US / Palo …4h ago
-
Software Development Engineer - AI/LLM Network - Global Frontier Tech Research Program - 2027 Start USD 202K-368KC++ | Cause analysis | Fault Localization | High Availability | LinuxEntry-level Full TimeSeattle, Washington, United States6h ago
-
Machine Learning Engineer Intern (E-commerce Governance Algorithms) - 2026 Summer (BS/MS) USD 122K-246KAlgorithm Design | Fraud Detection | Machine Learning | Python | Risk AssessmentDevelopment workshops | Hands-on experience | Industry exposure | Social eventsEntry-level InternshipSeattle, Washington, United States6h ago
-
Artificial Intelligence | Big Data | Data Processing | Distributed Systems | High PerformanceEntry-level InternshipSan Jose, California, United States6h ago
-
Staff Software Engineer, YouTube Data Science USD 207K-300KBig Data | Data Structures | Data Structures and Algorithms | Data analytics | Distributed ComputingSenior-level Full TimeSan Bruno, CA, USA7h ago
-
Software Engineer III, BigLake OSS USD 147K-211KApache Arrow | Apache Iceberg | Apache Spark | C++ | Data StorageSenior-level Full TimeSeattle, WA, USA7h ago
-
Senior Machine Learning Engineer USD 160K-250KCaching | Cloud Platforms | GPU Computing | Kubernetes | LLM InferenceSenior-level Full TimeIsrael, center, IL7h ago
-
ADLS Gen2 | API Gateway | AppDynamics | Autoscaling | AzurePaid time offSenior-level Full TimeAddison, United States18h ago
-
Senior Data Engineer USD 113K-188KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage401k retirement plan | Adoption Assistance | Employee referral program | Health savings account | Parental leaveSenior-level Full TimeGH Office: San Antonio, TX (9903 …18h ago
-
Principal Associate, Data Scientist - Innovation Hub USD 147K-184KAWS | Apache Spark | Conda | Generative AI | H2OSenior-level Full TimeMcLean, VA, United States18h ago
-
Commercial Analytics - Senior Associate USD 80K-150KBigQuery | Hadoop | Microsoft Excel | Microsoft PowerPoint | Power BIEmployee benefits | Flexible work environment | Home-based option | Incentive eligibilitySenior-level Full Time127 Public Square, Cleveland, OH, United … R18h ago
-
Sr. Data Engineers USD 158K-173KData Mining | Data Modeling | Feature Selection | Language Processing | Machine Learning401k match | Healthcare benefits | Life insurance | Paid disability | Paid time offSenior-level Full TimeCA - Irvine, HQ, United States18h ago
-
Feature Lead - Technology - GenAI Platform USD 106K-173KArchitecture | Asynchronous programming | Authentication and Authorization | Automation | CI/CDPaid time offSenior-level Full TimeJersey City, United States18h ago
-
Feature Lead - GenAI Team USD 106K-173KAgentic Retrieval Augmented Generation | Agile | Automation | Data Ingestion | Data ProcessingEmployee support resources | Paid time offSenior-level Full TimeNew York, United States18h ago
-
Senior Staff AI Data Infrastructure Engineer USD 203K-344KApache Iceberg | Apache Spark | C++ | Concurrent programming | Data LakehouseSenior-level Full TimeSanta Clara, CA20h ago
-
Software Engineer - GPU Inference USD 165K-330KAPI | Async Scheduling | CLI | CUDA | Distributed Systems401k | Fertility and family building stipend | Flexible PTO | Medical/Dental/Vision insurance | Paid parental leaveSenior-level Full TimeSan Francisco22h ago
-
Entry-level Full TimeSan Jose, CA, United States1d ago
-
Senior-level Full TimeReston, VA1d ago
-
Forward Deployed AI Engineer USD 90K-140KArtificial Intelligence | Language Models | Large Language Models | Machine Learning | Neural NetworksAccess to cutting-edge tools | Dental insurance | Equity | Health insurance | Professional developmentMid-level Full TimeSan Francisco, New York1d ago
-
Senior Machine Learning Engineer USD 194K-214KComputer Vision | Data Management | Deep learning | Java | Language ModelsCommuter benefits | Dental insurance | Health insurance | Parental leave | Vision insuranceSenior-level Full TimePalo Alto, CA1d ago
-
Communication Protocols | Computer Vision | Control Systems | Debugging | GRPC401k plan | Dental insurance | Medical insurance | Relocation benefits | Unlimited PTOMid-level Full TimeSan Francisco, CA1d ago
-
Cloud Machine Learning Engineer - US remote USD 150K-200KAWS CloudWatch | Accelerate | Amazon EC2 | Amazon S3 | Amazon SageMakerConference reimbursement | Flexible paid time off | Flexible working hours | Health, dental, and vision benefits | Parental leaveMid-level Full TimeUnited States - Remote R1d ago
-
Palantir Senior Data Engineer USD 135K-200KData Management | Data Processing | Data integration | Feature Engineering | Generative AISenior-level Full TimeAtlanta, Georgia, United States1d ago
-
Mid-level Full TimeMalvern, Pennsylvania, United States1d ago
-
Applied Research - Evals & Data USD 150K-300KAccelerate | Data Pipelines | Data Versioning | Distributed Systems | Distributed tracingConference attendance | Professional development budget | Relocation support | Remote work | Team offsitesSenior-level Full TimeSan Francisco1d ago