Sr. Software Engineer, Data Streaming Systems
Tasks
- Architect distributed event driven data streaming systems
- Build horizontally scalable services on Kubernetes
- Create automated integration and load testing for streaming workflows
- Define autoscaling strategies for resource management
- Deploy and manage containerized services on Kubernetes
- Design Kafka topics partitions consumer groups and event schemas
- Design reactive non blocking architectures
- Develop CI/CD pipelines and infrastructure-as-code
- Develop real time low latency streaming applications
- Drive code quality and system design documentation
- Enable real time feature pipelines and inference services
- Expose real time APIs and services
- Implement observability with metrics logging and distributed tracing
- Integrate streaming systems with batch pipelines and data platforms
- Lead architectural reviews and mentor engineers
- Participate in on-call rotations and production incident response
Perks/Benefits
- 401k plan
- Dental insurance
- Disability benefits
- Life insurance
- Medical insurance
- PTO for on call coverage
- Paid time off
- Tuition assistance
- Vision insurance
Skills/Tech-stack
Autoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | Flink | GCP | I/O | Infrastructure as Code | Integration Testing | Java | Kafka | Kafka Streams | Kubernetes | Load Testing | Logging | Metrics | Microservices | Non Blocking | Non-blocking I/O | Observability | Project Reactor | Reactive Programming | Spring Webflux | “as-code”
Education
N/A
Related jobs
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …1h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA1h ago
-
Data Analysis | Data Visualization | GenAI | Java | Jupyter NotebookSenior-level Full TimeCupertino11h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States12h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States12h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States13h ago
-
Gen AI - CVS - Dallas USD 36K-126KAPI Gateway | Aiohttp | Amazon Web Services | Asyncio | CI/CD401k retirement plan | Medical, dental, vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesMid-level Full TimeUnited States13h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States13h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States14h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA14h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | CI/CD | Cloud Storage | Cloud platformSecurity clearance providedMid-level Full TimeArlington, VA14h ago
-
Senior Data Engineer USD 180K-210KAirflow | Anomaly Detection | BigQuery | CI/CD | Cloud platform401k employer match | Annual Company Holidays | Catered lunches | Company retreat | Comprehensive health coverageSenior-level Full TimeNew York City14h ago
-
Sr. Engineer, Firmware & Embedded Software USD 79K-158KAgile | Azure DevOps | BDM | Bare Metal | BootloaderOccasional travel for onboarding | Remote work within the United StatesSenior-level Full TimeFlorida, United States R15h ago
-
Software Engineer, Optimized Checkout & Link USD 161K-213KAPI Development | Automated testing | End to End | End-to-End Testing | GraphQL401k plan | Company bonus | Equity | Medical, dental, and vision benefits | TelecommutingMid-level Full TimeUS Remote R15h ago
-
Senior Software Engineer; Analytics Infrastructure USD 167K-230KAPI Design | Backend Engineering | Caching | Columnar Databases | Data ModelingBack up child care support | Employee stock purchase program ESPP | Flexible time off | Home office & equipment stipend | Learning and development stipendSenior-level Full TimeSan Francisco, CA15h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R15h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R15h ago
-
Machine Learning Research Engineer, App Store Search USD 185K-313KA/B | A/B Testing | Apache Spark | B testing | Fine TuningMid-level Full TimeSeattle16h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA16h ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R16h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA17h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas17h ago
-
Machine Learning Engineer III, Core Agents USD 175K-219KAWS Bedrock | Amazon SageMaker | Embedding Models | Evaluation | IndexingSenior-level Full TimeRedwood City, CA17h ago
-
Sr. AI/ML Engineer II (6707) USD 210K-253KAWS | Anaconda | CI/CD | Containerization | Data analytics401k match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, vision insurance | Paid time offMid-level Full TimeTysons Corner, VA17h ago