Sr. Software Engineer, Data Streaming Systems
Tasks
- Architect distributed streaming systems
- Build automated unit integration contract chaos and performance testing
- Build reactive non blocking architectures
- Collaborate with data engineering and platform engineering teams
- Containerize microservices with Docker
- Create and manage CI/CD pipelines
- Define autoscaling deployment and failover strategies
- Deploy and operate microservices in Kubernetes
- Design high throughput low latency streaming applications
- Drive schema evolution and event lifecycle patterns
- Ensure reliability scalability and high availability
- Implement event-driven microservices
- Implement infrastructure-as-code
- Manage Kafka topics partitioning and consumer groups
- Mentor engineers and set engineering standards
- Optimize throughput latency and resiliency
- Set up observability with metrics and centralized logging
- Support AI ML real time feature engineering and inference pipelines
- Support production and perform incident response and root cause analysis
- Use distributed tracing alerting and health monitoring
Perks/Benefits
- 401k plan
- Disability benefits
- Life insurance
- Medical/Dental/Vision
- PTO
- Paid time off
- Tuition assistance
- Tuition assistance program
Skills/Tech-stack
Asynchronous programming | Autoscaling | CI/CD | Cause analysis | Centralized Logging | Chaos Testing | Contract testing | Distributed Systems | Distributed tracing | Docker | Event Driven | Event modeling | Event-driven architecture | Flink | Health Monitoring | Horizontal scaling | Idempotency | Infrastructure as Code | Infrastructure automation | JVM Performance | JVM performance tuning | Java | Kafka | Kafka Streams | Kubernetes | Metrics | Multithreading | Non Blocking | Non Blocking Architecture | Observability | Performance Testing | Performance Tuning | Project Reactor | Reactive Programming | Rolling deployments | Root Cause Analysis | Root cause | Schema Registry | Schema evolution | Spring Webflux | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Related jobs
-
Senior Databricks Platform Engineer USD 140K-165KAWS | Active Directory | Apache Hive | Apache Spark | Audit LoggingSenior-level Full TimeArlington, VA, United States4h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R4h ago
-
AI Platform Engineer USD 108K-215KAutogen | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Key VaultMid-level Full TimeBelmont, NC, United States7h ago
-
AI Platform Engineer USD 108K-215KAI Agents | Agent Frameworks | Autogen | Azure Data | Azure Data LakeMid-level Full TimeBelmont, NC, United States7h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York7h ago
-
Project Lead Data Engineer III USD 119K-198KBTEQ | Database Administration | Patch Management | Performance Tuning | Query OptimizationSenior-level Full TimeSacramento, California, United States8h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R8h ago
-
Software Engineer - TikTok AI Search Infrastructure USD 212K-389KAlgorithm Design | C++ | DAG | Data Architecture | Data ProcessingSenior-level Full TimeSan Jose, California, United States9h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …10h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …10h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA10h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA10h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA10h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA10h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA10h ago
-
C++ | Containers | Distributed Systems | Distributed Training | Distributed inferenceSenior-level Full TimeCupertino15h ago
-
Senior-level Full TimeUnited States16h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States19h ago
-
Data Analysis | Data Visualization | GenAI | Java | Jupyter NotebookSenior-level Full TimeCupertino20h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States20h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States20h ago
-
Data Engineer, Consultant USD 125K-164KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeOakland, CA, United States21h ago
-
AI Engineer (Temporary) USD 85K-95KAWS | Agents SDK | Anthropic API | Azure | Data RiskAccess to training and enablement resources | Hybrid work environment | Temporary contract with benefitsEntry-level Full Time TemporaryIthaca (Main Campus), United States21h ago
-
Principal Embedded Software Engineer - OS Build USD 152K-229KArtifactory | BSP | Bamboo | Bash | BitbucketSenior-level Full TimeUSA-CO Lafayette Bldg 2, United States21h ago
-
Mid-level Full TimeUSA - Seattle, WA, United States21h ago