Kafka Platform Engineer
Tasks
- Architect deploy and manage Apache Kafka and Confluent Platform environments
- Build Infrastructure as Code for Kafka provisioning
- Collaborate to establish event driven architecture standards
- Conduct architecture reviews and mentor engineering teams
- Deploy Kafka on Kubernetes using Strimzi Confluent Operator or managed services
- Design Kafka cluster topology and performance optimization
- Design and implement High Availability and Disaster Recovery
- Develop and manage Kafka Connect Schema Registry Kafka Streams and ksqlDB pipelines
- Implement Kafka security SASL SSL mTLS ACLs and RBAC
- Set up monitoring alerting logging and observability
- Troubleshoot production issues and perform root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
ACLs | AWS MSK | Ansible | Apache Kafka | Azure Event | Azure Event Hubs | Bash | Confluent Cloud | Confluent Operator | Confluent Platform | Disaster Recovery | ELK | Event Hubs | Go | Grafana | High Availability | Infrastructure as Code | KSQLDB | Kafka Connect | Kafka Streams | Kubernetes | MTLS | OpenTelemetry | Prometheus | Python | RBAC | SASL | SSL | Schema Registry | Strimzi | Terraform | “as-code”
Education
Roles
Related jobs
-
Telemetry Data Engineer USD 110K-128KAnomaly Detection | Azure Data | Azure Data Explorer | Data Engineering | Data Explorer401k retirement plan | Medical/Dental/VisionMid-level ContractRedmond, Washington, USA R9h ago
-
Automated testing | Build Automation | C++ | CI/CD | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractDallas, Texas, USA R10h ago
-
AWS | AWS EC2 | Automation | Azure | Azure Virtual401k match | ESPP | Family leave programs | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R10h ago
-
AWS | Azure | CI/CD | Cloud platform | Containers401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R11h ago
-
Staff AI Engineer USD 198K-260KAgentic Workflows | Containerization | Docker | Experiment design | Generative AI401k plan participation | Annual performance bonuses | Company equity grants | Disability insurance | Life insuranceSenior-level Full TimeNew York, New York, United States R11h ago
-
Automated testing | C++ | CI/CD | Embedded Linux | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractTampa, Florida, USA R11h ago
-
Automated testing | C++ | CI/CD | Firmware Build | Firmware Testing401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractAtlanta, Georgia, USA R11h ago
-
Machine Learning Engineer, II - 3D Perception USD 153K-183K3D Perception | BEV Representations | Birds Eye View | C++ | Cloud processing100 percent paid medical dental and vision | 401k employer match | Accidental death and dismemberment insurance | Company holiday office closures | Life insuranceMid-level Full TimeRemote, U.S, Ann Arbor, MI, Fort … R12h ago
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R14h ago
-
BE CAD Physical Impl and AI Engineer USD 401KAI for Design | AI for Design Optimization | ASIC | Automation | Back End CAD401k match | Dental plan | Educational assistance | Health benefits | Hybrid workSenior-level Full TimeAustin,Texas,United States R16h ago
-
Senior-level Full TimeAnnapolis Junction, United States R16h ago
-
Cloud Computing | Deep learning | Language Models | Language Processing | Large Language ModelsAutonomy | Contract flexibility | Remote workSenior-level FreelanceUnited States of America R21h ago
-
Cloud infrastructure | Distributed Systems | GPU | JAX | Machine LearningMid-level Full TimeUnited States R1d ago
-
LLM Application Engineer USD 130K-175KAPIs | Agent Frameworks | Databases | Distributed Systems | EvaluationMid-level Full TimeUnited States R1d ago
-
Analytics Engineer USD 115K-149KAirflow | BI Semantic Layer | CI/CD | DAX | DBT401k plan | Catered lunches | Dental insurance | Medical insurance | Onsite fitness centerSenior-level Full TimeIndianapolis, IN R1d ago
-
Specialist Solutions Architect - Data Engineering & Warehousing (Digital Native Business) USD 180K-247KAWS | Anomaly Detection | Apache Kafka | Automated Ingestion | AzureConference presentations | Hackathons | Mentorship | Remote work | Training programsSenior-level Full TimeUnited States R1d ago
-
Senior AWS Data Engineer USD 153K-207KAPI Integration | AWS Batch | AWS CloudTrail | AWS Glue | AWS LambdaRemote workSenior-level Full TimeMountain View, CA, US R1d ago
-
Senior AWS Data Engineer USD 153K-207KAPI | AWS Batch | AWS Glue | AWS Lambda | AWS Step FunctionsContinuous learning | Flexible work hours | Mentorship | Remote workSenior-level Full TimeAtlanta, GA, US R1d ago
-
Machine Leaning Performance Engineer (Inference) USD 200K-300KC++ | CUBLAS | CUDA | CUDA C | CutlassFitness Events | Free meals | Hybrid work options | Paid time off | Volunteer opportunitiesMid-level Full TimeNew York R1d ago
-
Machine Learning Research Engineer USD 200K-300KAI Agents | API Design | Automation | Dask | Data pipelineHybrid work | Paid time off | Paid wellness expenses | Volunteer opportunities | Workshops and continuous learningMid-level Full TimeNew York R1d ago
-
Lead Analytics Engineer USD 138K-177KAWS Glue | AWS Glue Data Catalog | Amazon Athena | Amazon RDS | Amazon RedshiftRemote workSenior-level Full TimeAtlanta, GA, US R1d ago
-
Junior Data Engineer USD 85K-90KAWS EMR | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaContinuous learning | Flexible work arrangement | Remote workEntry-level Full TimeMountain View, CA, US R1d ago
-
Junior Data Engineer USD 85K-90KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchContinuous learning | Flexible schedule | Remote workEntry-level Full TimeAtlanta, GA, US R1d ago
-
General Pipeline - FullStack Applied AI Engineer USD 150K-250KAWS | Access Control | Asynchronous programming | Authentication | AuthorizationSenior-level Full TimeUnited States R1d ago
-
Agent Orchestration | Agentic AI | Apache Airflow | Argo Workflows | Artifact versioning401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R1d ago