Senior Software Architect, AI Networking
Tasks
- Author design documents and technical specifications
- Collaborate with model systems compiler and networking teams
- Design scalable architectures for multi node LLM inference
- Develop infrastructure to optimize latency throughput and cost-efficiency
- Evaluate and integrate new software and hardware technologies for model inference
- Prototype KV cache handling and tensor pipeline parallel execution
- Translate high level architecture into reliable high performance systems
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | Cluster scheduling | Compute scheduling | Deep learning | Distributed Systems | Dynamic batching | GPU Acceleration | Inter-node communication | KV cache | Memory Orchestration | Networking | Performance Profiling | Pipeline parallelism | Python | Tensor Parallelism | Transformer
Education
Related jobs
-
AI | APIs | DPUs | Deep learning | Direct memory accessCompetitive compensation | Comprehensive benefits package | Opportunity to work on frontier technologySenior-level Full TimeIsrael, Raanana1d ago
-
C# | C++ | Communication Algorithms | Linux | MPISenior-level Full TimeIsrael, Tel Aviv1d ago
-
API Design | Cloud Architecture | Data Engineering | Data Pipelines | Distributed SystemsSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R8d ago
-
AI Serving Systems | AI serving | Data Analysis | Data Science | Deep learningSenior-level Full TimeIsrael, Tel Aviv9d ago
-
API Design | Artificial Intelligence | Cloud Architecture | Data Engineering | Distributed SystemsSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R12d ago
-
Senior-level Full TimeHerzliya, Israel, IL16d ago
-
Senior-level Full TimeGiv'atayim, Tel Aviv District, IL16d ago
-
Senior Cloud Architect, Delivery (GenAI) ILS 420K-504KAPI Gateway | AWS | AWS Fargate | AWS Glue | AWS LambdaSenior-level Full TimeRemote Israel R24d ago
-
Data Analysis | Data Science | Distributed Training | Generative AI | Language ModelsSenior-level Full TimeIsrael, Yokneam1mo ago
-
Mid-level Full TimeTel Aviv, Israel1mo ago
-
Agentic AI | Autonomous Agents | Deep learning | Fine Tuning | Language ModelsSenior-level Full TimeTel Aviv, Tel Aviv1mo ago
-
Senior-level Full TimeJerusalem, Israel1mo ago
-
Senior-level Full TimeHaifa, Israel1mo ago
-
C++ | Chip architecture | Co-design | Computer Architecture | Deep learningSenior-level Full TimeTel Aviv, Israel; Haifa, Israel1mo ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1mo ago
-
AI and ML | Access Management | Automation | Cloud Native | Cloud Native ArchitectureCareer Development Programs | Health and wellbeing benefits | Hybrid work schedule | Inclusion programsSenior-level Full TimeTel Aviv, Israel1mo ago