Sr. Software Engineer, Data Streaming Systems
Tasks
- Architect distributed event driven data streaming systems
- Build horizontally scalable services on Kubernetes
- Create automated integration and load testing for streaming workflows
- Define autoscaling strategies for resource management
- Deploy and manage containerized services on Kubernetes
- Design Kafka topics partitions consumer groups and event schemas
- Design reactive non blocking architectures
- Develop CI/CD pipelines and infrastructure-as-code
- Develop real time low latency streaming applications
- Drive code quality and system design documentation
- Enable real time feature pipelines and inference services
- Expose real time APIs and services
- Implement observability with metrics logging and distributed tracing
- Integrate streaming systems with batch pipelines and data platforms
- Lead architectural reviews and mentor engineers
- Participate in on-call rotations and production incident response
Perks/Benefits
- 401k plan
- Dental insurance
- Disability benefits
- Life insurance
- Medical insurance
- PTO for on call coverage
- Paid time off
- Tuition assistance
- Vision insurance
Skills/Tech-stack
Autoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | Flink | GCP | I/O | Infrastructure as Code | Integration Testing | Java | Kafka | Kafka Streams | Kubernetes | Load Testing | Logging | Metrics | Microservices | Non Blocking | Non-blocking I/O | Observability | Project Reactor | Reactive Programming | Spring Webflux | “as-code”
Education
N/A
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Senior Embedded Flight Software Engineer USD 160K-240KAMD Xilinx | AMD Xilinx FPGAs | AMD/Xilinx SoC | Agile | Aircraft systems401k | Casual dress code | Dental insurance | FSA | Free daily lunchSenior-level Full TimeHawthorne, CA7h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R9h ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA9h ago
-
AI Engineer USD 125K-201KAWS | Agent Frameworks | Agent SDK | Agent coordination | Claude Agent SDKCollaboration with little supervision | Startup environment | Work on cutting-edge AIEntry-level Full TimePittsburgh, Pennsylvania, United States9h ago
-
Mid-level Full TimeSan Francisco10h ago
-
Mid-level Full TimeSan Francisco10h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 9150510h ago
-
Senior Analytics Engineer, GTM USD 176K-265KAPI Integration | CI/CD | DBT | Data Modeling | Data QualityCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeSanta Clara, California11h ago
-
Senior AI Engineer – Developer Products USD 170K-250KAPI Design | LLMOps | Language Models | Large Language Models | MLOpsGenerous benefits | Health benefits | Remote work options | Stock optionsSenior-level Full TimeSan Francisco, California11h ago
-
Machine Learning Engineer USD 140K-190KApache Flink | Apache Kafka | Apache Spark | Bigtable | CI/CDMid-level Full TimeRemote - USA R12h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Data Curation | Deep learning401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY12h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Artificial Intelligence | Azure | Cloud infrastructure401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeSan Francisco, CA12h ago
-
BigQuery | Cloud Functions | Compute Engine | DBT | Fivetran11 paid holidays | 401k matching | Basic life insurance | Commuter benefits | Disability insuranceMid-level Full TimeNew York, NY12h ago
-
Senior-level Full TimeUnited States13h ago
-
Embedded Device Firmware Engineer USD 145K-195KAutomated testing | C# | C++ | CI/CD | Circuit debuggingMid-level Full TimeSanta Clara, CA13h ago
-
Software Engineer, Storage USD 153K-196KAlertmanager | As-a-Service | Availability | C++ | CassandraEquity compensation | Onsite optionSenior-level Full TimeSan Mateo, CA, United States R13h ago
-
Member of Technical Staff (Storage) USD 185K-200KAI Assisted Development | C++ | Concurrency Control | Data replication | Distributed SystemsDental insurance | Flexible time off | Life and disability insurance | Medical insurance | Mental wellbeing benefitsSenior-level Full TimeNew York, NY R13h ago
-
Member of Technical Staff (Storage) USD 185K-200KAI Assisted Development | C# | C++ | Concurrency Control | Data replicationDental insurance | Flexible time off | Life and disability insurance | Medical insurance | Mental wellbeing benefitsSenior-level Full TimeNew York, NY R13h ago
-
Architecture Review | Assembly | C# | C++ | Code review401k retirement plan | Company shuttles | Dental insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimeRedmond, WA13h ago
-
Assembly | C# | C++ | Convex Optimization | Distributed Systems401k retirement plan | Dental insurance | Disability insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimePalo Alto, CA13h ago
-
Assembly | C# | C++ | Convex Optimization | Distributed Systems401k | Dental insurance | Employee stock purchase plan | Life insurance | Medical insuranceSenior-level Full TimePalo Alto, CA13h ago
-
Assembly | C# | C++ | Convex Optimization | Debugging401k | Company shuttle | Dental insurance | Disability insurance | Employee discountsSenior-level Full TimeRedmond, WA13h ago
-
Software Engineer - Sensor Systems, Robot Software USD 209K-291KBuild systems | C++ | Core dumps | Data Streaming | DebuggingHybrid work | Inclusive work environment | Work from home optionMid-level Full TimeSunnyvale14h ago
-
Embedded Software Engineer II USD 140K-200KBootloader | C# | C++ | CI/CD | Device DriversDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeEl Segundo, CA14h ago