Senior Performance Engineer - LLM Inference Frameworks
Tasks
- Build benchmarking and testing systems for latency utilization and efficiency
- Design high performance inference pipelines for large language models
- Develop and optimize context caching
- Develop and optimize speculative decoding
- Implement FP8 and INT4 quantization
- Implement memory management strategies for improved bandwidth and cache efficiency
- Profile and tune model execution across the stack
Perks/Benefits
Skills/Tech-stack
Debugging | Deep learning | Distributed Systems | FP8 | GPU | Huggingface | INT4) | Latency optimization | Memory Management | Model Benchmarking | Performance Profiling | PyTorch | Python | Quantization | Throughput Optimization
Education
Related jobs
-
AWS | Azure | Distributed Systems | Django | ELKFlexible working | Hybrid work | Work from home optionSenior-level Full TimeIsrael R1d ago
-
Data Science Team Lead ILS 380K-473KAnomaly Detection | Data labeling | Deep learning | Experimental Design | Feature EngineeringCommuter benefits | Equity | Extra Time Off for Parents and Caregivers | Functional training | Happy hoursSenior-level Full TimeTel Aviv1d ago
-
AI Agents | Agentic Architectures | Authentication | CI/CD | Cloud BuildEmployee stock option plan | Flexible working options | Health insurance | Home-office allowance | Parental leaveSenior-level Full TimeRemote Israel R1d ago
-
Mid-level Full TimeTel Aviv1d ago
-
AI API | API Development | AWS | Anthropic API | AuthenticationContinuous learning | Hands on architectural guidance | Technical leadership growth | Variety of projectsMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Laid-back atmosphere | Remote friendly distributed setupMid-level Full TimeHaifa, Israel1d ago
-
APIs | AWS | Agent systems | Authentication | AzureContinuous learning | MentorshipEntry-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
AI Coding Assistants | AI coding | AI software | AI software development | AI software development toolsOn-site work environment | Student intern positionEntry-level Part TimePTK1 - PTK1 - Petah Tikva …1d ago
-
Agile Development | Argo | Continuous integration | Docker | ElasticsearchHybrid work modelMid-level Part TimePTK1 - PTK1 - Petah Tikva …1d ago
-
Senior-level Full TimeIsrael, Tel Hai1d ago
-
AWS | Ansible | CI/CD | Distributed Systems | HPCChallenging cloud and AI projects | Collaborative team environment | Professional growth and learning opportunitiesMid-level Full TimeTel Aviv-Yafo, Tel Aviv, ISR1d ago
-
API Integration | Data Pipelines | LLM integration | Language Models | Large Language ModelsCollaborative cross-functional team | On-site collaborationMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel2d ago
-
Algorithm Optimization | C++ | Computer Vision | Data Analysis | LidarMid-level Full TimeHaifa, Israel2d ago
-
Data Analysis | Google Cloud | Graph Data | Hadoop | Machine LearningFinancial wellness support | Healthcare coverage | Mental health resources | Paid time offEntry-level Full Time InternshipISR - Tel Aviv District - …2d ago
-
3D Geometry | Active Learning | Apache Airflow | Argo Workflows | Camera ModelsSenior-level Full TimeJerusalem, Israel5d ago
-
A/B | A/B Testing | AWS | Azure | B testingAnnual learning and development budget | Company laptop | Fully remote | Home office stipend | Paid Maternity LeaveSenior-level Full TimeIsrael R5d ago
-
AWS | Airflow | Amazon EC2 | Amazon EMR | Amazon RedshiftCareer coaching | Flexible workplace | Hybrid work modelMid-level Full TimeTel Aviv District, Israel5d ago
-
A/B | A/B Testing | B testing | Benchmarking | Data AnalysisAutonomy | Company provided MacBook | Continuous learning | Fully remote | Paid national holidaysMid-level Full TimeIsrael R5d ago
-
Big Data | Geometric algorithms | Graph Neural Networks | Machine Learning | Neural NetworksMid-level Full TimeJerusalem, Israel5d ago
-
Azure Synapse | Azure Synapse Analytics | BigQuery | ClickHouse | Data ModelingMid-level Full TimeHolon, Center District, IL6d ago
-
Senior Machine Learning Engineer - Syte ILS 420K-504KAirflow | CI/CD | Docker | Elasticsearch | GitHub ActionsSenior-level Full TimeHerzliya, Israel, IL6d ago
-
API Integration | Airflow | DBT | DLT | Data ModelingCatered lunches | Commuter benefits | Company equity | Flexible work schedule | Learning and development benefitsMid-level Full TimeBudapest, Hungary; Munich, Germany; Tel Aviv, …6d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL6d ago
-
Benchmarking | Data Quality | Dataset development | Deep learning | LLM APIsSenior-level Full TimeTel-Aviv, Israel, IL6d ago
-
Senior-level Full TimeTel Aviv, IL6d ago