Sr. Software Engineer, Data Streaming Systems
Tasks
- Architect distributed event driven data streaming systems
- Build horizontally scalable services on Kubernetes
- Create automated integration and load testing for streaming workflows
- Define autoscaling strategies for resource management
- Deploy and manage containerized services on Kubernetes
- Design Kafka topics partitions consumer groups and event schemas
- Design reactive non blocking architectures
- Develop CI/CD pipelines and infrastructure-as-code
- Develop real time low latency streaming applications
- Drive code quality and system design documentation
- Enable real time feature pipelines and inference services
- Expose real time APIs and services
- Implement observability with metrics logging and distributed tracing
- Integrate streaming systems with batch pipelines and data platforms
- Lead architectural reviews and mentor engineers
- Participate in on-call rotations and production incident response
Perks/Benefits
- 401k plan
- Dental insurance
- Disability benefits
- Life insurance
- Medical insurance
- PTO for on call coverage
- Paid time off
- Tuition assistance
- Vision insurance
Skills/Tech-stack
Autoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | Flink | GCP | I/O | Infrastructure as Code | Integration Testing | Java | Kafka | Kafka Streams | Kubernetes | Load Testing | Logging | Metrics | Microservices | Non Blocking | Non-blocking I/O | Observability | Project Reactor | Reactive Programming | Spring Webflux | “as-code”
Education
N/A
Related jobs
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York4h ago
-
Software Engineer - TikTok AI Search Infrastructure USD 212K-389KAlgorithm Design | C++ | DAG | Data Architecture | Data ProcessingSenior-level Full TimeSan Jose, California, United States5h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …6h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …6h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA6h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA6h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA6h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA6h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA6h ago
-
C++ | Containers | Distributed Systems | Distributed Training | Distributed inferenceSenior-level Full TimeCupertino11h ago
-
Senior-level Full TimeUnited States12h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States15h ago
-
Data Analysis | Data Visualization | GenAI | Java | Jupyter NotebookSenior-level Full TimeCupertino16h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States17h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States17h ago
-
Data Engineer, Consultant USD 125K-164KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeOakland, CA, United States17h ago
-
AI Engineer (Temporary) USD 85K-95KAWS | Agents SDK | Anthropic API | Azure | Data RiskAccess to training and enablement resources | Hybrid work environment | Temporary contract with benefitsEntry-level Full Time TemporaryIthaca (Main Campus), United States17h ago
-
Principal Embedded Software Engineer - OS Build USD 152K-229KArtifactory | BSP | Bamboo | Bash | BitbucketSenior-level Full TimeUSA-CO Lafayette Bldg 2, United States17h ago
-
Mid-level Full TimeUSA - Seattle, WA, United States17h ago
-
Principal Embedded Software Engineer - OS Build USD 152K-229KArtifactory | Atlassian | BSP | Bamboo | BashSenior-level Full TimeUSA-CO Lafayette Bldg 2, United States17h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States17h ago
-
Gen AI - CVS - Dallas USD 36K-126KAPI Gateway | Aiohttp | Amazon Web Services | Asyncio | CI/CD401k retirement plan | Medical, dental, vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesMid-level Full TimeUnited States18h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States18h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States19h ago
-
Software Engineer, Algorithms (SDE) USD 150K-220KAI tools | C++ | Concurrency | Digital Signal | Digital Signal ProcessingSenior-level Full TimeCupertino19h ago