Sr. Software Engineer, Data Streaming Systems
Tasks
- Architect distributed event driven data streaming systems
- Build horizontally scalable services on Kubernetes
- Create automated integration and load testing for streaming workflows
- Define autoscaling strategies for resource management
- Deploy and manage containerized services on Kubernetes
- Design Kafka topics partitions consumer groups and event schemas
- Design reactive non blocking architectures
- Develop CI/CD pipelines and infrastructure-as-code
- Develop real time low latency streaming applications
- Drive code quality and system design documentation
- Enable real time feature pipelines and inference services
- Expose real time APIs and services
- Implement observability with metrics logging and distributed tracing
- Integrate streaming systems with batch pipelines and data platforms
- Lead architectural reviews and mentor engineers
- Participate in on-call rotations and production incident response
Perks/Benefits
- 401k plan
- Dental insurance
- Disability benefits
- Life insurance
- Medical insurance
- PTO for on call coverage
- Paid time off
- Tuition assistance
- Vision insurance
Skills/Tech-stack
Autoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | Flink | GCP | I/O | Infrastructure as Code | Integration Testing | Java | Kafka | Kafka Streams | Kubernetes | Load Testing | Logging | Metrics | Microservices | Non Blocking | Non-blocking I/O | Observability | Project Reactor | Reactive Programming | Spring Webflux | “as-code”
Education
N/A
Related jobs
-
Software Engineer, Data (L1) USD 75K-130KAI Platform | APIs | Apache Airflow | Apache Iceberg | Apache Spark401k match | Calm subscription | Career growth and learning opportunities | Commuter benefits options | Dental insuranceMid-level Full TimeAustin, TX9h ago
-
Solutions Engineer – Robotics & Autonomous Driving USD 152K-500K2D Imaging | 3D Imaging | Autonomous Driving | C++ | CameraCommuter stipend | Generous PTO | Global travel | Health, dental, vision coverage | Learning and development stipendSenior-level Full TimeSan Francisco, CA; New York, NY10h ago
-
Machine Learning Research Engineer USD 161K-189KAWS | Azure | Bias Variance | Bias-Variance Tradeoff | C++Flexible hybrid work model | Mental health counseling | Mentorship programs | Paid parental leave | Paid volunteer time offMid-level Full TimeNew York, US, New York13h ago
-
Sr. Application Software Engineer, Data Analytics USD 160K-225KAngular | C# | CI/CD | Computer Vision | Continuous integrationExtended hours | Travel | Weekend workSenior-level Full TimeBastrop, TX14h ago
-
Mid-level Full TimeEl Segundo15h ago
-
Foundation Model Data, Software Engineer USD 213K-263KApache Beam | Apache Flume | C++ | CI/CD | Distributed Systems401k match | Baby bonding leave | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeMountain View, CA, USA; San Francisco, …15h ago
-
Senior-level Full TimeOnsite - Austin, TX15h ago
-
AWS Bedrock | Agent systems | Anthropic API | Autogen | Azure401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Contract Full TimeRemote, OR, United States R16h ago
-
Senior Data Engineer USD 90K-110KAWS | Agile | Apache NiFi | Data Architecture | Data ModelingAutonomy | Flexible working hours | Global employee assistance programme | Online training videos | Teambuilding eventsSenior-level Full TimeNew York, United States16h ago
-
Data Platform Engineer USD 85K-120KAlembic | App Service | Azure | Azure App | Azure App Service401k match | Annual discretionary bonus program | Bereavement leave | Commuter spending accounts | Dental insuranceMid-level Full TimeChicago, IL (Downtown)16h ago
-
Robotics Test Engineer USD 100K-150KASan | Bitbucket Pipelines | C++ | CI/CD | DebuggingDirect hire | Mentorship | Ownership of test suitesMid-level Full TimeOnsite - Austin, TX17h ago
-
AI Feedback | Checkpointing | Cost Performance | Cost-performance tradeoffs | Data Decontamination401k matching | Country specific visa support | Flexible work arrangements | Medical, dental, and vision options | Parental leaveSenior-level Full TimePalo Alto, California, United States17h ago
-
AI Engineer 1 - Compliance, Quality & Testing USD 80K-150KAI-assisted testing | CI/CD | Code review | Cypress | Defect Tracking401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC17h ago
-
Machine Learning Engineer, ML Flywheel USD 136K-173KC++ | Data Pipelines | Distributed Systems | ML Ops | Machine LearningAnnual bonus program | Company benefits program | Equity incentive plan | Hybrid workMid-level Full TimeMountain View, CA, USA17h ago
-
Software Engineer, Applied AI USD 190K-280KContext engineering | Data Processing | Data Storage | Debugging | Docker401k match | Dental insurance | Health insurance | Hybrid work model | Professional developmentSenior-level Full TimeNew York City R18h ago
-
Staff Data Engineer USD 185K-220KAWS | Apache Airflow | Apache Kafka | Benthos | Big DataDental insurance | Disability insurance | Flexible work hours | Health insurance | Health savings accountSenior-level Full TimeRosslyn, VA or Remote R19h ago
-
Machine Learning Engineer, ML Resources USD 170K-216KC++ | Compute management | Dashboards | Debugging | Distributed SystemsAnnual bonus | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeMountain View, CA, USA19h ago
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R19h ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R20h ago
-
AI Engineer 1 - Platform Integration & AI/Data USD 80K-150KAWS | Agentic Systems | Backend Development | Backend Services | CI/CD401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC20h ago
-
IT Infrastructure Engineer II USD 139K-178KAWS Organizations | Access Management | Amazon Web Services | Ansible | Application FirewallHealth and wellness resources | Remote work | Wellness FridaysSenior-level Full TimeRemote - United States R20h ago
-
Senior Machine Learning Engineer, Agentic AI USD 163K-245KAI Observability | Agent systems | Autonomous Agents | Benchmark Datasets | Distributed SystemsHealth insurance | Life and disability insurance | Lifestyle Benefits Account | Mental health benefits | Paid time offSenior-level Full TimeBellevue, WA; Menlo Park, CA; New …20h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Data Analysis | Data AssociationDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R21h ago
-
Blob Storage | C# | C++ | Distributed Caches | Distributed Caching401k | Dental insurance | Flexible time off | Health insurance | Paid parental leaveSenior-level Full TimeAliso Viejo, California, United States21h ago
-
Access layers | Blob Storage | C# | Caching Strategies | Data access401k | Dental insurance | Health insurance | Paid parental leave | Unlimited Flex Time OffSenior-level Full TimeLos Angeles, California, United States21h ago