Streaming Data Engineer
Tasks
- Apply HA and DR strategies
- Architect Kafka platform
- Automate Kafka operations
- Conduct code reviews and design reviews
- Configure Kafka security
- Convert ambiguous requirements into solutions
- Deploy Kafka clusters
- Enable developers with streaming platform
- Implement observability and monitoring
- Mentor junior engineers
- Operate Kafka production environments
- Support Kafka Connect and Schema Registry
- Troubleshoot streaming data issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS MSK | Ansible | Apache Flink | Apache Kafka | Apache Spark | Azure Event | Azure Event Hubs | Azure Event Hubs Kafka | Azure Event Hubs Kafka API | Bash | Confluent Operator | Confluent Platform | Consumer groups | Data Governance | Data Lineage | Go | HA/DR | KSQLDB | Kafka API | Kafka Connect | Kafka Security | Kafka Streams | Kafka internals | Kubernetes | MTLS | Observability | Partitions | Python | RBAC | Replication | SASL | Schema Registry | Scripting | Strimzi | Terraform
Education
Roles
Related jobs
-
Data Engineer CAD 100K-170KAWS | Apache Airflow | Azure | BigQuery | Cloud Computing401k | Asynchronous work culture | Autonomy | Company paid life insurance | Disability coverageMid-level Full TimeRemote - US or Canada R4h ago
-
Data Modeling & AI Analytics USD 133K-190KAirbyte | Amazon Redshift | BigQuery | DBT | Data GovernanceSenior-level Full TimeMiami, Florida R6h ago
-
Senior Research Engineer / Scientist - Storage for LLM USD 207K-368KCUDA | Caching | Data Structures | Distributed Systems | Eviction PolicyConference attendance | Open source contributions | Research resourcesSenior-level Full TimeSeattle, Washington, United States R7h ago
-
Research Engineer / Scientist - Storage for LLM USD 153K-300KCUDA | Caching | Distributed Systems | Eviction policies | GPU ComputingConference attendance | Innovation-driven culture | Open source contributions | Research resourcesEntry-level Full TimeSeattle, Washington, United States R7h ago
-
Software Engineer (Technical Leadership) USD 213K-293KC++ | Data Classification | Data Mining | Data Modeling | Data RegressionSenior-level Full TimeBellevue, WA | Menlo Park, CA … R8h ago
-
Data Engineer, Product Analytics USD 181K-204KAlgorithm Optimization | Bias Mitigation | C# | C++ | Data GovernanceCareer growth opportunitiesSenior-level Full TimeSunnyvale, CA | Bellevue, WA | … R8h ago
-
Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 200K-400KClaude Code | Cursor | JavaScript | OpenAI Codex | PythonSenior-level Full TimeMiami R17h ago
-
AI Security Engineer USD 140K-200K800-53 | ABAC | AI RMF | AI Studio | AKS401k matching | Dental insurance | Employee development program | Employee referral program | Medical insuranceSenior-level Full TimeRemote, MD, US R18h ago
-
Junior AI Engineer USD 86K-120KAPI Integration | Authentication | Cloud deployment | Docker | Error Handling401k matching | BYOD reimbursement | Company holidays | Flexible spending accounts | Health savings accountEntry-level Full TimeHouston, Texas, United States (Hybrid) R19h ago
-
Principal ML/AI Engineer USD 119K-274KAPI Development | Artificial Intelligence | Automated testing | Azure | CI/CDCareer growth | MentorshipSenior-level Full TimeREMOTE GA 3 - Remotely Working … R19h ago
-
AWS Bedrock | AWS Lambda | Amazon DynamoDB | Amazon S3 | Amazon SageMaker401k plan | Flexible time off | Global shutdown | Health insurance | Paid time offSenior-level Full TimePrinceton LVL - NJ, United States R19h ago
-
Staff Machine Learning Engineer, Traffic Intelligence USD 212K-265KBayesian Calibration | Bayesian Inference | Calibration | Causal Inference | Data PipelinesSenior-level Full TimeUnited States R20h ago
-
Senior Machine Learning Engineer USD 150K-241KC++ | Cloud Architecture | Computer Vision | Data Privacy | EncryptionDiscretionary paid time off | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R20h ago
-
Active Learning | Auto-labeling | Computer Vision | Confidence Scores | Data BalancingBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, … R21h ago
-
Solution Engineer USD 165K-216KCloud Computing | Data Lake | Data Warehouse | Data fabric | Data meshTravelSenior-level Full TimeUS-OH-Remote R22h ago
-
Principal Data Engineer (Remote) USD 151K-189KAmazon Kinesis | Apache Spark | CI/CD | Cloud Data | Cloud Data Services12 weeks new parent leave | Coworking support | Flexible PTO | Learning & development stipend | Time allotment for learning and developmentSenior-level Full TimeUnited States R22h ago
-
Lead Data Engineer (Remote) USD 126K-157KAWS | AWS Redshift | Amazon Kinesis | Azure | Azure DataCoworking support | Flexible PTO | Learning and development stipend | New parent leave | Remote workSenior-level Full TimeUnited States R23h ago
-
Senior Machine Learning Engineer, Vehicle Perception USD 140K-230KAblation Studies | C plus plus | Cloud Computing | Computer Vision | Data CurationComprehensive benefits package | Hybrid work schedule | Incentive programsSenior-level Full TimePalo Alto, CA R23h ago
-
AWS | Agile | Azure | Azure Data | Azure Data FactoryHybrid work | Occasional onsite work | Onsite interviews as needed | Remote workSenior-level Full TimeUnited States R23h ago
-
AWS | Agile | Azure | Azure Data | Azure Data FactoryMid-level Full TimeUnited States R23h ago
-
Senior Analytics Engineer USD 141K-176KAWS Glue | Amazon Athena | Apache Hive | Apache Spark | CI/CDGenerous time off | Healthcare | Occasional travel for in person meetings | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R23h ago
-
ASICs | C++ | CUDA | CUDA Graphs | Continuous batchingRemote workSenior-level Full TimeUnited States (Remote) R23h ago
-
Embedded & Automation Engineer USD 140K-230KAbstraction layer | Bring up automation | Bring-up | C# | C++401k | Accident insurance | Critical illness insurance | DCFSA | Dental insuranceMid-level Full TimeSan Diego, CA R23h ago
-
Senior Software Engineer (Forward Deployed) USD 180K-264KAWS | Automation | Data Contracts | Data Governance | Data QualityHybrid work | On-call support | Travel opportunitiesSenior-level Full TimeLondon - Hybrid; New York - … R1d ago
-
Data Scientist USD 90K-120KAWS | Agentic AI | Azure | Cypress | Data Analysis401k employer contribution | Remote work optionMid-level Full TimeRemote, USA R1d ago