Sr. Software Engineer, Data Streaming Systems
Tasks
- Architect distributed event driven data streaming systems
- Build horizontally scalable services on Kubernetes
- Create automated integration and load testing for streaming workflows
- Define autoscaling strategies for resource management
- Deploy and manage containerized services on Kubernetes
- Design Kafka topics partitions consumer groups and event schemas
- Design reactive non blocking architectures
- Develop CI/CD pipelines and infrastructure-as-code
- Develop real time low latency streaming applications
- Drive code quality and system design documentation
- Enable real time feature pipelines and inference services
- Expose real time APIs and services
- Implement observability with metrics logging and distributed tracing
- Integrate streaming systems with batch pipelines and data platforms
- Lead architectural reviews and mentor engineers
- Participate in on-call rotations and production incident response
Perks/Benefits
- 401k plan
- Dental insurance
- Disability benefits
- Life insurance
- Medical insurance
- PTO for on call coverage
- Paid time off
- Tuition assistance
- Vision insurance
Skills/Tech-stack
Autoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | Flink | GCP | I/O | Infrastructure as Code | Integration Testing | Java | Kafka | Kafka Streams | Kubernetes | Load Testing | Logging | Metrics | Microservices | Non Blocking | Non-blocking I/O | Observability | Project Reactor | Reactive Programming | Spring Webflux | “as-code”
Education
N/A
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA7h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 915059h ago
-
Senior AI Engineer – Developer Products USD 170K-250KAPI Design | LLMOps | Language Models | Large Language Models | MLOpsGenerous benefits | Health benefits | Remote work options | Stock optionsSenior-level Full TimeSan Francisco, California10h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Data Curation | Deep learning401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY10h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Artificial Intelligence | Azure | Cloud infrastructure401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeSan Francisco, CA10h ago
-
Senior-level Full TimeUnited States11h ago
-
Embedded Device Firmware Engineer USD 145K-195KAutomated testing | C# | C++ | CI/CD | Circuit debuggingMid-level Full TimeSanta Clara, CA11h ago
-
Member of Technical Staff (Storage) USD 185K-200KAI Assisted Development | C++ | Concurrency Control | Data replication | Distributed SystemsDental insurance | Flexible time off | Life and disability insurance | Medical insurance | Mental wellbeing benefitsSenior-level Full TimeNew York, NY R12h ago
-
Architecture Review | Assembly | C# | C++ | Code review401k retirement plan | Company shuttles | Dental insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimeRedmond, WA12h ago
-
Assembly | C# | C++ | Convex Optimization | Distributed Systems401k retirement plan | Dental insurance | Disability insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimePalo Alto, CA12h ago
-
Assembly | C# | C++ | Convex Optimization | Distributed Systems401k | Dental insurance | Employee stock purchase plan | Life insurance | Medical insuranceSenior-level Full TimePalo Alto, CA12h ago
-
Assembly | C# | C++ | Convex Optimization | Debugging401k | Company shuttle | Dental insurance | Disability insurance | Employee discountsSenior-level Full TimeRedmond, WA12h ago
-
Software Engineer - Sensor Systems, Robot Software USD 209K-291KBuild systems | C++ | Core dumps | Data Streaming | DebuggingHybrid work | Inclusive work environment | Work from home optionMid-level Full TimeSunnyvale12h ago
-
Senior Software Engineer - Data Platform USD 130K-220KAWS Lambda | AWS RDS | Airflow | Amundsen | Apache HiveHealth insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R12h ago
-
Ai Engineer USD 100K-150KAI Agents | API Development | AWS | AWS Bedrock | Agentic Workflows401k | Commuter benefits | Dental insurance | Disability coverage | EAPMid-level Full TimeColumbia, MD, United States13h ago
-
Senior-level Contract Full TimeReston, VA, United States14h ago
-
Senior Data Engineer (Remote) USD 155KAgile | Apache Spark | BigQuery | Cassandra | Data Governance401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible scheduleSenior-level Full TimeWork From Home, United States R16h ago
-
Senior AI Operations Engineer USD 170K-180KAI infrastructure | Azure | CI/CD | Cloud infrastructure | Container Engine for Kubernetes401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountSenior-level Full TimeWork From Home, United States R16h ago
-
AI Agents | AI Governance | AI architecture | API Integration | AWSContract employment | Hybrid workSenior-level Contract Full TimeChicago, Illinois, United States16h ago
-
Senior Data Engineer | Bankrate USD 100K-210KAPIs | AWS Lambda | AWS S3 | Airflow | Amazon EC2401k matching | Eastern Standard Time schedule | Employee assistance program | Flexible paid time off | Flexible spending accountsSenior-level Full TimeUnited States R18h ago
-
Senior Lead AI Software Engineer USD 216K-324KAgentic Workflows | Alerting | Architectural patterns | Coding assistants | Cost OptimizationSenior-level Full TimeBoston, MA19h ago
-
API Development | Airflow | Automated retraining | CI/CD | Cloud PlatformsEquityMid-level Full TimeNaples, United States19h ago
-
API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud developmentSenior-level ContractGlendale, United States20h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …20h ago