Senior Software Engineer, Deep Learning Inference
Tasks
- Build production software in open source libraries
- Implement and optimize LLM inference algorithms
- Optimize fused MoE and quantized GEMM operators
- Own optimization features end to end
- Profile inference pipelines
- Solve distributed inference problems
- Write and tune GPU kernels
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | CUDA profiling | Collective communication | Communication Compute Overlap | Deep learning | Distributed Computing | FP8 | GPU kernel optimization | Kernel optimization | Mamba | Memory hierarchy | Mixed Precision | Mixture of Experts | Multi-node | Multi-node deployment | Networking | Node deployment | Nsight | Pipeline parallelism | PyTorch | Python | Quantization | Roofline model | State Space Models | State-Space | Tensor Parallelism | Transformers | Triton
Education
Related jobs
-
API Integration | AWS | Access Control | Apache Airflow | AuthenticationFlexible work schedule | Hybrid work model | Remote work flexibilityMid-level Full TimeIsrael - Raanana R1d ago
-
API Authentication | API pagination | API rate-limiting | AWS | Apache AirflowCareer growth opportunities | Collaborative work environment | Flexible schedule | Hybrid work model | Remote work optionMid-level Full TimeIsrael - Raanana R2d ago
-
A/B | A/B Testing | AUC | AWS | Apache SparkDental insurance | Fitness and wellness support | Fully remote | Health insurance | Home-office allowanceMid-level Full TimeIsrael R5d ago
-
CRM | Claude | Data integration | HubSpot | JavaScriptCareer growth | Collaborative global team | Continuous learning | Fully remoteMid-level Full TimeIsrael R5d ago
-
API Design | Agent-based | Agent-based Architectures | Artificial Intelligence | CI/CDEmployee stock options | Flexible scheduling | Fully remote work | Health insurance | Home office setup allowanceMid-level Full TimeIsrael R6d ago
-
AI Algorithms Team Lead ILS 341K-443KAlgorithm Development | Data Modeling | Deep learning | Documentation | Language ProcessingCollaborative culture | Employee gym | Free meals | Hybrid work model | Meal cardSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R8d ago
-
Senior AI Solution Engineer ILS 341K-443KAI Model Evaluation | AI model | Amazon Athena | Apache Airflow | CI/CDGym membership | Healthy Meals | Hybrid work model | Meal card | ParkingSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R8d ago
-
AWS | Azure | Distributed Systems | Django | ELKFlexible working | Hybrid work | Work from home optionSenior-level Full TimeIsrael R8d ago
-
C++ | Deep learning | Diffusion Models | Edge Computing | GgmlFast-paced environment | Fully remote | Global collaboration | High ownershipSenior-level Full TimeIsrael R8d ago
-
Actor-critic | Exploration Strategy | Online Reinforcement Learning | Policy Optimization | Policy gradientsAutonomy and innovation | Flexible work culture | Fully remote | Global team collaboration | Research exposureMid-level Full TimeIsrael R8d ago
-
AWS | Alerting | Apache Airflow | Apache Flink | Apache KafkaHybrid work model | Incident response support | On-call supportMid-level Full TimeIsrael R9d ago
-
Sr. Data Engineer - Cloud Security (Hybrid, ISR) ILS 380K-473KAWS | Apache Iceberg | Apache Spark | Cassandra | DockerCompetitive vacation and holidays | Employee networks | Paid adoption leave | Paid parental leave | Professional development opportunitiesSenior-level Full TimeTel Aviv (Sky Tower), Israel R14d ago
-
AWS | Azure | Cloud deployment | Containerization | CrewAIRemote workMid-level Full TimeTel Aviv; Haifa R18d ago
-
Senior AI Researcher - Applied Models ILS 420K-504KData Validation | Data benchmarking | DataOps | Experimental Design | Large-scaleCollaborative work environment | Hybrid work modelSenior-level Full TimeRamat Gan, Tel Aviv District, IL R19d ago
-
Mid-level Full TimeIsrael R20d ago
-
BLE | Bluetooth | C# | C++ | Communication ProtocolsHybrid work model | Work from home optionMid-level Full TimeRa'anana, Ha'sharon, IL R22d ago
-
Agentic AI | Audio Processing | Computer Vision | Deep learning | Generative AISenior-level Full TimeRamat Gan (Hybrid) R24d ago
-
Bit Error Rate Tester | Bit error rate | C# | C++ | CXLMid-level Full TimeHome Office, ISR, Israel R1mo ago
-
Field Application Engineer (Machine Learning) ILS 420K-504KASIC | C# | C++ | Docker | GDSFamily leave | Health care plan | Paid time off | Stock option plan | Training and developmentSenior-level Full TimeIsrael - Remote R1mo ago
-
Backend Engineer, Knowledge Graph (Rust) USD 98K-210KAI tools | AI tools integration | API Development | ClickHouse | Data ModelingBenefits to support health and well-being | Equity compensation | Flexible paid time off | Growth and development funds | Home office supportSenior-level Full TimeRemote, Canada; Remote, Ireland; Remote, Israel; … R1mo ago
-
Cloud Platforms | Data Analysis | Docker | ML algorithms | Model EvaluationHealth insurance reimbursement | Language course discounts | Paid vacation | Professional training reimbursement | Recognition systemMid-level Full TimeIsrael R1mo ago
-
Data Science | Embeddings | Evaluation Frameworks | Experimentation | Information ExtractionAnnual bonus | Global retreats | Home office stipend | Learning stipend | Medical coverageSenior-level Full TimeIsrael R1mo ago
-
Content Moderation | Fine Tuning | Hugging Face | Language Models | Large Language ModelsAI tool access | Co-working budget | Company laptop | Flexible schedule | Health allowanceSenior-level Full TimeIsrael R1mo ago