Senior Software Architect, AI Networking
Tasks
- Author design documents internal specs and technical blogs
- Contribute to open source efforts
- Coordinate model systems compiler and networking teams
- Design scalable multi-node LLM inference architectures
- Develop inference infrastructure for production deployment
- Evaluate and integrate software and hardware technologies
- Optimize latency, throughput, and cost-efficiency
- Prototype KV cache handling tensor pipeline parallel execution dynamic batching
- Translate architecture into reliable high-performance systems
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | Congestion Control | Deep learning | Distributed Systems | Dynamic batching | GPU Acceleration | Inter-node communication | KV cache | Language Models | Large Language Models | Latency optimization | Load Balancing | Model Parallelism | Pipeline parallelism | Python | Scheduling | Telemetry | Tensor Parallelism | Throughput Optimization | Transformer
Education
Related jobs
-
AI Engineer ILS 384K-504KAngular | Azure DevOps | Django | JSON | JiraGlobal team collaboration | Hybrid work locationSenior-level Full TimeTel Aviv, Tel Aviv District, IL1d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Algorithms | C# | C++ | CUDA | Computer ArchitectureSenior-level Full TimeIsrael, Tel Aviv1d ago
-
Senior Software Architect, AI Networking ILS 420K-504KC++ | CUDA | Cluster scheduling | Compute scheduling | Deep learningSenior-level Full TimeIsrael, Tel Aviv1d ago
-
Agentic Systems | Benchmarking | Data Analysis | Experimentation | Fine TuningMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel1d ago
-
Senior AI Storage Software Architect ILS 420K-504KAI | API Design | DPUs | Deep learning | Hardware offloadCompetitive salary | Comprehensive benefits packageSenior-level Full TimeIsrael, Raanana2d ago
-
Software Infrastructure Developer (Agentic AI Focus) USD 160K-213KAWS | Agent SDK | Anthropic API | Asynchronous | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL3d ago
-
AI Tech Lead ILS 402K-504KAIOps | APIs | AWS | Alerting | Anomaly DetectionCross company long weekends | Flexible work schedule | Hybrid work environment | Mental health insurance | Private health insuranceSenior-level Full TimeBnei Brak, Tel Aviv District, IL3d ago
-
Senior-level Full TimePetah Tikva, Center District, IL3d ago
-
Senior AI Engineer - Agentic Systems USD 125K-170KAgent Orchestration | Autogen | CI/CD | Cloud | CrewAISenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL4d ago
-
Senior AI Engineer USD 142K-186KAWS | Agent systems | Azure | Containerization | Database Management SystemSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL7d ago
-
Senior AI Researcher ILS 384K-504KDeep learning | Experimental Design | Foundation Models | Machine Learning | Machine Learning InfrastructureCollaborative work environment | Hybrid work model | Research impactSenior-level Full TimeRamat Gan, Tel Aviv District, IL R7d ago
-
Senior AI Platform Engineer ILS 420K-510KAgentic Workflows | Async Programming | CI/CD | Distributed Systems | DockerSenior-level Full TimeIsrael, Yokneam10d ago
-
Principal Data Engineer (Cortex) ILS 402K-504KAmazon Redshift | Apache Beam | Azure Data | Azure Data Explorer | Azure SQLSenior-level Full TimeTel Aviv, Tel Aviv11d ago
-
BigQuery | Cloud Computing | Cloud platform | Containerization | Content ManagementOffice based work with flexible schedule | Reasonable accommodationsMid-level Full TimeTel Aviv, Tel Aviv11d ago
-
Forward Deployed Engineer ILS 402K-504KAPI Development | AWS | Agentic AI | Azure | CI/CDClient-facing work | Cross-functional team collaboration | Hybrid workSenior-level Full TimeTel Aviv, Tel Aviv District, IL14d ago
-
AI Research Scientist ILS 420K-504KCode generation | Data Generation | Deep learning | Evaluation | Fine TuningMid-level Full TimeTel Aviv, Israel | Paris, France14d ago
-
APIs | Data Ingestion | Data Modeling | Data Quality | Data TransformationEnglish proficiency required | On-site work environmentMid-level Full TimeTel Aviv, Israel14d ago
-
API Gateway | AWS Bedrock | AWS Lambda | Amazon API | Amazon API GatewayFlexible working hours | Mentoring | Professional developmentSenior-level Full TimeRa'anana, Center District, IL15d ago
-
Computer Vision | Deep learning | Language Processing | Machine Learning | Model OptimizationMid-level Full TimePetach – Tikva, Israël15d ago
-
Mid-level Full TimeRa'anana, Center District, IL16d ago
-
Senior-level Full TimeCategory Data Location Petach Tikva, Israel …16d ago
-
Reindeer- AI Solutions Engineer (IL) USD 80K-170KApplication Integration | Cloud Computing | Communication | Compliance | Data AnalysisSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL17d ago
-
AI Agents | Agents SDK | Claude Agents SDK | Cloud Computing | ContainersMid-level Full TimeHerzliya, Tel Aviv District, IL17d ago
-
Executive-level Full TimeHerzliya, Israel18d ago