Senior Software Architect, AI Networking
Tasks
- Author design documents internal specs and technical blog posts
- Collaborate across model systems compiler and networking teams
- Design scalable architectures for multi node LLM inference
- Develop infrastructure to optimize latency throughput cost efficiency
- Evaluate and integrate software and hardware technologies for model inference
- Prototype KV cache handling tensor parallel pipeline parallel and dynamic batching
- Translate high level architecture into reliable high performance systems
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | Cluster scheduling | Compute scheduling | Deep learning | Distributed Systems | Dynamic batching | GPU Acceleration | Inter-node communication | KV cache | Language Models | Large Language Models | Memory Orchestration | Network Topology | Performance Profiling | Pipeline parallelism | Python | Tensor Parallelism
Education
Roles
Related jobs
-
AI Data Engineer - Early Career ILS 325K-446KAPIs | AWS | Airflow | Azure | CI/CDCareer growth | Inclusive work environment | MentorshipNone Full TimeCaesarea, Israel, IL R1d ago
-
AI Engineer ILS 321K-400KAnthropic Claude | Asynchronous pipelines | Authentication | Credential Handling | Error HandlingDinners provided | Dog-friendly office | Fully stocked kitchen | Global teams | Happy hoursSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Data Ingestion | Data Modeling | Data Quality | Data Transformation | Data pipelineMid-level Full TimeTel Aviv, Israel1d ago
-
Agentic development | Agile | Asynchronous processing | CI/CD | DEVEXMid-level Full TimeRamat Gan, Tel Aviv District, IL R2d ago
-
Agentic AI Engineer - Product Support ILS 402K-504KAWS | Agent Orchestration | Context engineering | Data integration | Human-in-the-loopSenior-level Full TimeTel Aviv District, Israel3d ago
-
AWS Bedrock | AWS GovCloud | AWS SageMaker | Agentic AI | Authorization Documentation401k match | Dental insurance | Flexible work arrangements | Health insurance | Life insuranceSenior-level Full TimeIsrael5d ago
-
Senior AI Researcher ILS 420K-522KAutonomous Driving | Computer Vision | Distributed Training | Embeddings | Machine LearningFlexible schedule | Professional growth opportunities | Team building events | Well-being initiatives | Work location flexibilitySenior-level Full TimeTel Aviv-Yafo, Israel6d ago
-
AI Solutions Specialist ILS 420K-504KAI Agents | API Integrations | Claude | Evaluation | Fine TuningCross-functional collaboration | Ownership and autonomy | Training and enablement sessionsSenior-level Full TimeTel Aviv/ Netanya, Israel6d ago
-
Mid-level Full TimeRa'anana, Center District, IL R6d ago
-
C# | C++ | DSP | Debugging | Deep Neural NetworksSenior-level Full TimeHod Hasharon, Haifa District, Israel7d ago
-
AI IT Centre of Excellence Deploy Lead ILS 420K-510KAI Governance | API Integration | Agentic AI | Application Programming | Application Programming InterfaceSenior-level Full TimeIsrael R8d ago
-
Associate Director Lead AI Engineer ILS 156K-204KAPIs | Agent Orchestration | Artificial Intelligence | Automated testing | CI/CDMid-level Full TimeJerusalem, Jerusalem, IL, 97776138d ago
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R9d ago
-
AI Agents | AI Governance | AI cost management | API Integration | Artificial IntelligenceExecutive-level Full TimeGiv'atayim, Tel Aviv District, IL R9d ago
-
AI Solution Expert ILS 420K-516KAI APIs | AI Agents | Automation Scripting | Billing Systems | CRM systemsSenior-level Full TimeHolon, Center District, IL R9d ago
-
AI Platform Engineering Team Lead ILS 420K-504KAI Agents | AWS | Distributed Systems | Docker | ECSSenior-level Full TimeModiin-Maccabim-Reut, Center District, IL R13d ago
-
AI Innovation Builder ILS 50KAPIs | Agentic Systems | Automation | Code Development | Language ModelsSenior-level Full TimeRamat Gan, Israel, IL R13d ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R13d ago
-
Principal AI Engineer (Prisma Browser - Agents Fleets) ILS 230K-290KArtificial Intelligence | Automated Evaluation | Caching | Context engineering | Context windowSenior-level Full TimeTel Aviv, Tel Aviv17d ago
-
Senior Backend AI Engineer ILS 362K-504KAgentic AI | Alembic | Autogen | Azure | Azure OpenAIEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeYokneam Illit, Israel20d ago
-
Lead AI Engineer USD 160K-213KAgentic Workflows | Artificial Intelligence | CI/CD | Data Engineering | LLM ApplicationsHybrid work model | In-office collaboration | Remote flexibilitySenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R20d ago
-
AI Engineer, Agentic Systems & AI Infrastructure USD 120K-150KBigQuery | Evaluation Frameworks | GCP | Human-in-the-loop | LLM AgentsMid-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL20d ago
-
AI Engineer ILS 384K-504KAngular | Azure DevOps | Django | JSON | JiraGlobal team collaboration | Hybrid work locationSenior-level Full TimeTel Aviv, Tel Aviv District, IL21d ago
-
Senior AI Storage Software Architect ILS 420K-504KAI | API Design | DPUs | Deep learning | Hardware offloadCompetitive salary | Comprehensive benefits packageSenior-level Full TimeIsrael, Raanana22d ago
-
Software Infrastructure Developer (Agentic AI Focus) USD 160K-213KAWS | Agent SDK | Anthropic API | Asynchronous | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL23d ago