Senior Software Engineer, LLM Inference
Tasks
- Build production software in open source libraries
- Correlate simulation to real hardware performance
- Implement and optimize LLM inference algorithms
- Optimize SSM state updates
- Optimize fused MoE layers
- Own optimization features end to end
- Profile inference pipelines
- Solve distributed inference problems
- Tune quantized GEMMs
- Write and tune GPU kernels
Perks/Benefits
- N/A
Skills/Tech-stack
CUDA | CUDA profiling | Collective communication | Communication Compute Overlap | Deep learning | Distributed Computing | Expert parallelism | FP8 | GEMM | GPU Kernels | MOE | Memory hierarchy | Mixed Precision | Mixture of Experts | Multi-node | Networking | Nsight | Performance Modeling | Pipeline parallelism | PyTorch | Quantization | Simulation | State Space Models | State-Space | Tensor Parallelism | Transformers | Triton
Education
Related jobs
-
AI Engineer USD 110K-120KArtificial Intelligence | BigQuery | Classification | Cloud Storage | Cloud platformSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Benchmarking | Data parallelism | Deep learning | Distributed Computing | JAXSenior-level Full TimeTel Aviv, Israel1d ago
-
A/B | A/B Testing | B testing | Calibration | Deep learningComprehensive benefits | Fully stocked kitchen | Hybrid work schedule | Location-specific perks | Well-being programsMid-level Full TimeTel Aviv, Israel1d ago
-
Senior Machine Learning Engineer USD 150K-200KAPI Development | AWS SageMaker | Data Pipelines | FastAPI | Feature EngineeringSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Computer Vision | Deep learning | Language Processing | Machine Learning | Model OptimizationMid-level Full TimePetach – Tikva, Israël2d ago
-
Senior-level Full TimeTel Aviv-Yafo, Israel, IL3d ago
-
3D Object Detection | 3D Perception | 3D Reconstruction | C++ | Computer VisionMid-level Full TimeRamat Gan, Israel3d ago
-
3D Reconstruction | Behavior Modeling | Computer Vision | Deep learning | Machine LearningSenior-level Full TimeRamat Gan, Israel3d ago
-
Machine Learning Developer USD 80K-127KComputer Vision | Deep learning | Model Evaluation | Model Training | NumPyEntry-level Full TimeTel Aviv-Yafo, Israel, IL4d ago
-
Principal/Senior ML Platform Engineer (Cortex) ILS 420K-504KAWS | Azure | CI/CD | Data Drift | Data drift monitoringSenior-level Full TimeTel Aviv, Tel Aviv5d ago
-
Deep learning | Distributed Systems | GPU Computing | High Performance | High-Performance ComputingSenior-level Full TimeIsrael, Raanana5d ago
-
Apache Spark | Big Data | Data Analysis | Data Pipelines | Deep learningEmployee Assistant Program | Employee stock purchase plan | Equity | Home-office allowance | Insurance benefitsSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel7d ago
-
3D Perception | Autonomous Driving | C++ | Computer Vision | Deep learningMid-level Full TimeHaifa, Israel8d ago
-
Airflow | Amazon SageMaker | Apache Beam | Argo Workflows | Attention MechanismsSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R8d ago
-
Mid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R8d ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R8d ago
-
Software Engineer, Algorithms Team ILS 420K-504KAWS | Airflow | CI/CD | CUDA | DatadogCross-team collaboration | End-to-end ownership | High autonomy | Remote learning growthSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL9d ago
-
AI Assisted Development | Agent Orchestration | Alerting | Automation | C#Senior-level Full TimeTel Aviv, Israel9d ago
-
Detection algorithms | Digital Receiver | Digital Receiver Design | Digital Signal | Digital Signal ProcessingMid-level Full TimeRaanana, Center District9d ago
-
Senior Algorithm Engineer (RTB) ILS 380K-504KA/B | A/B Testing | B testing | Deep learning | JavaFully stocked kitchen | Hybrid work schedule | Location-specific perks | Well-being programsSenior-level Full TimeTel Aviv, Israel9d ago
-
Senior Algorithm Engineer, Recommendations ILS 380K-504KA/B | A/B Testing | B testing | Deep learning | EmbeddingsComprehensive benefits | Fully stocked kitchen | Hybrid work schedule | Location-specific perks | Well-being programsSenior-level Full TimeTel Aviv, Israel9d ago
-
AI Serving Systems | AI serving | Data Analysis | Data Science | Deep learningSenior-level Full TimeIsrael, Tel Aviv10d ago
-
R&D Team Leader, Algorithms (RTB) ILS 341K-504KA/B | A/B Testing | B testing | Data Science | Deep learningFully stocked kitchen | Hybrid work schedule | Location-specific perks | Well-being programsSenior-level Full TimeTel Aviv, Israel10d ago
-
Software Engineer Student (Data Science) ILS 170K-230KMachine Learning | NumPy | Pandas | PyTorch | PythonEntry-level Full TimeIsrael10d ago
-
Software Engineer Student (Data Science) ILS 170K-230KData Analysis | Data Pipelines | Data Processing | Machine Learning | NumPyEntry-level Full TimeIsrael10d ago