Senior Software Architect, AI Networking
Tasks
- Author design documents and internal specifications
- Collaborate with model systems compiler and networking teams
- Contribute to open source efforts
- Design scalable multi-node LLM inference architectures
- Develop inference infrastructure to optimize latency throughput and cost efficiency
- Evaluate and integrate software and hardware technologies for model inference
- Prototype KV cache handling approaches
- Prototype dynamic batching
- Prototype tensor parallel pipeline parallel execution
- Translate architecture into reliable high-performance systems
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | Cluster scheduling | Compute scheduling | Deep learning | Distributed Systems | Dynamic batching | GPU Acceleration | Inter-node communication | KV cache | LLM Inference | Memory Orchestration | Networking | Performance optimization | Pipeline parallelism | Python | System Performance | System Performance Optimization | Tensor Parallelism
Education
Roles
AI | AI Systems Architect | Architect | Software Architect | Systems Architect
Related jobs
-
AI Researcher - Agentic AI ILS 230K-290KAgentic AI | Anthropic API | Benchmarking | Evaluation Methodologies | Gemini APIHybrid workMid-level Full TimeRamat Gan, Tel Aviv District, IL1d ago
-
AI Agents | AWS | Automation | Azure | Cloud ComputingSenior-level Full TimeKfar Saba, Israel1d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Causal Inference | Deep learning | Distributed Training | Experimental Design | Foundation ModelsSenior-level Full TimeIsrael1d ago
-
Senior-level Full TimeKfar Saba, Israel2d ago
-
AI | API Design | Application Programming | Application Programming Interfaces | Data Center StorageSenior-level Full TimeIsrael, Raanana2d ago
-
C# | C++ | CUDA | CUDA programming | Computer ArchitectureSenior-level Full TimeIsrael, Tel Aviv2d ago
-
Benchmarking | Deep learning | Distributed Training | Efficient Fine Tuning | Evaluation FrameworksFlexible working arrangements | High autonomy | Open source publication support | Professional growth opportunities | Remote workSenior-level Full TimeIsrael R3d ago
-
Senior-level Full TimeNetanya, Center District, IL4d ago
-
Mid-level Full TimeNetanya, Center District, IL4d ago
-
Team8 AI Stealth Mode Startup-AI Engineer ILS 420K-510KAI/ML | AI/ML Pipelines | AWS | Agent systems | Backend DevelopmentMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL4d ago
-
Algorithm Optimization | Algorithm validation | Code Reviews | Computer Vision | Data-Driven Decision MakingFlexible benefits package | Short-Term IncentiveMid-level Full TimeISR-TA Herzliya Hamenofim, Israel4d ago
-
Algorithm Design | Computer Vision | Data-Driven Decision Making | Data-driven | Decision MakingFlexible benefitsMid-level Full TimeISR-TA Herzliya Hamenofim, Israel4d ago
-
Data Analysis | Data Science | Distributed Training | Generative AI | Language ModelsSenior-level Full TimeIsrael, Yokneam4d ago
-
Data Analysis | Data Center Infrastructure | Data center | Deep learning | Distributed TrainingSenior-level Full TimeIsrael, Yokneam4d ago
-
AI architecture | C++ | Computer Vision | Deep learning | KerasPart-time flexibilitySenior-level Full TimeJerusalem, Israel5d ago
-
Senior AI Researcher - Agentic Endpoint Security(Cortex) ILS 420K-504KAgent Frameworks | Agent Orchestration | Automated Evaluation | Batching | BenchmarkingSenior-level Full TimeTel Aviv, Tel Aviv5d ago
-
AI Agents | AI Search | AI/ML | Automation platforms | Azure AIRemote-friendly work environmentMid-level Full TimeRosh Haayin, Center District, IL8d ago
-
Senior-level Full TimeRamat Gan, Tel Aviv District, IL8d ago
-
Alignment | Data Generation | Data Science | Deep learning | Knowledge DistillationMid-level Full TimeTel Aviv, Israel R9d ago
-
Mid-level Full TimeHerzliya, Tel Aviv District, IL9d ago
-
Big Data | C++ | Data Modeling | Deep learning | Foundation ModelsMid-level Full TimeTel Aviv, Israel R9d ago
-
Senior-level Full TimeIsrael, Yokneam11d ago
-
Senior-level Full TimeRamat Gan, Tel Aviv District, IL15d ago
-
Mid-level Full TimeRamat-Gan, Tel Aviv District, IL15d ago