Kafka Data Engineer
USA, HI, Camp H.M. Smith (Halawa Heights Dr), United States
USD 77K-176K Mid-level Full Time
Tasks
- Configure monitoring for data pipelines
- Create data partitioning strategies
- Deploy Kafka clusters on Kubernetes in AWS
- Design and develop Kafka data pipelines
- Enable alerting for data pipelines
- Ensure high availability
- Ensure low latency
- Guide and mentor data engineers
- Implement Kafka Schema Registry
- Maintain Kafka clusters
- Manage Kafka schema evolution
- Monitor Kafka topics performance
- Oversee platform assessment
- Oversee platform build
- Oversee platform design
- Oversee platform maintenance
- Upgrade Kafka clusters
- Utilize Kafka Security Manager
Perks/Benefits
Skills/Tech-stack
Agile | Alerting | Amazon Web Services | Apache Kafka | Data Partitioning | Data Pipeline Monitoring | Data pipeline | Datadog | Elastic Stack | High Availability | Kafka Schema Registry | Kafka Security | Kafka Security Manager | Kubernetes | Low Latency | Observability | Pipeline monitoring | Schema Registry | Security Manager | Stream processing | Topic Monitoring | Web Services
Education
Roles
Regions
Countries
States
Related jobs
-
Data Platform Engineer-Solutions Delivery USD 125K-174KAPI Integration | API Management | APIs | Azure API | Azure API Management401k matching | Company holidays | Employee purchase program | Medical/Dental/Vision | Paid time offSenior-level Full TimeMerriam, KS, United States23h ago
-
API | Airflow | Amazon Web Services | Apache Spark | AzureLearning and development | Mentorship | Travel opportunitiesEntry-level Full TimeAtlanta, Georgia, United States; Boston, Massachusetts, …1d ago
-
databricks engineer - Delivery Senior Consultant, Data Engineering and Conversion Solutions USD 124K-213KAPI | Agile | Data Governance | Data Modeling | Data QualityHybrid work model | Travel 10 percentSenior-level Full TimeLake Mary, Florida, United States1d ago
-
Mid-level Full TimeJersey City, New Jersey, United States1d ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | Data durabilitySenior-level Full TimeKirkland, WA, USA1d ago
-
Senior Engineer, Big Data USD 134K-170KAmazon Web Services | Apache Spark | Automated testing | Azure | CI/CDSenior-level Full TimeUnited States1d ago
-
Senior-level Full TimeHouston, TX, US1d ago
-
AI Engineer II USD 60K-90KAPI Development | Backend Development | Cloud Computing | Databricks | DockerOnsite workMid-level Full TimeLocation Irving, Texas1d ago
-
APIs | AWS CloudWatch | AWS Kinesis | Agile | Amazon DynamoDB401k savings plan | Adoption benefits | Career development | Disability benefits | Employee assistance programSenior-level Full TimeIrving, Texas, United States1d ago
-
Staff Frontier Agents Engineer (Applied AI) USD 252K-315KA/B | A/B Testing | AWS | Ablation Studies | AzureCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago
-
Senior Frontier Agents Engineer (Applied AI) USD 216K-270KA/B Testing | AWS | Ablation Studies | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago
-
Frontier Agents Engineer (Applied AI) USD 180K-225KA/B | A/B Testing | AWS | Ablation Studies | Agent FrameworksCommuter stipend | Dental insurance | Health insurance | Learning and development stipend | Paid time offMid-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago
-
Finance & Analytics USD 100K-155KBudgeting | Business Intelligence | Chart of Accounts | Data Modeling | Data QualityFeedback Focused Environment | Growth mindset | In-person work culture | Owner mentality | Startup flexibilitySenior-level Full TimeAustin, TX1d ago
-
Software Engineer, API Multimodal USD 293K-385KConcurrency | Distributed Systems | Go | Latency | ObservabilitySenior-level Full TimeSan Francisco1d ago
-
AWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon RedshiftSenior-level Full TimeCupertino1d ago
-
Senior AI Engineer - Services Special Projects USD 150K-260KAdversarial evaluation | Airflow | CI/CD | Cloud Platforms | Content ModerationSenior-level Full TimeSan Francisco Bay Area1d ago
-
API Design | AWS | AWS CloudWatch | AWS Lambda | AWS Step FunctionsBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planSenior-level Full TimePlano, TX, United States1d ago
-
AI Engineer USD 180K-200KAgent Orchestration | Data Pipelines | Distributed Systems | LLM | Machine Learning401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …1d ago
-
Senior Software Engineer, Data Lake USD 196K-230KAWS S3 | Apache Flink | Apache Kafka | Apache Spark | Change Data Capture401k matching | Disability insurance | Fertility benefits | Health insurance | Life insuranceSenior-level Full TimeBellevue, WA1d ago
-
Principal AI Engineer USD 185K-265KAPI Integration | Agent systems | Artificial Intelligence | Cloud Native | Cloud-native ArchitecturesEducation reimbursement | Health plans | Paid time off | Parental leave | Remote workSenior-level Full TimeRemote - USA R1d ago
-
Data Engineer USD 160K-200KAWS | Apache Spark | Azure | CI/CD | DBT401k match | Continuing education support | Employee assistance program | Flexible spending accounts | Generous paid time offSenior-level Full TimeAuburn Hills, MI, US R1d ago
-
Senior Data Engineer II, AI Native USD 148K-216KAmazon Web Services | Apache Airflow | Apache Spark | Azure | BigQuery401k matching | Dental insurance | Disability insurance | Employee assistance program | Equipment reimbursementSenior-level Full TimeRemote, USA R1d ago
-
Senior Production Engineer, Storage USD 172K-209KAnsible | Backup and Restore | Block Storage | C# | Data replication401k match | Calm subscription | Cell phone reimbursement | Commuter benefit | HSA employer contributionSenior-level Full TimeSunnyvale, CA - US1d ago
-
API Design | AWS | Access Control | Amazon S3 | Apache AirflowEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNashville, TN1d ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R1d ago