AI Computing Software Development Engineer, TensorRT-LLM
Tasks
- Collaborate with research and product teams
- Develop inference software
- Implement TensorRT LLM feature updates
- Optimize and tune LLM inference
- Perform LLM performance analysis
- Provide feedback on architecture and hardware design
- Publish results in scientific conferences
- Scale inference software across platforms
- Track AI research developments
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | Debugging | Deep learning | Deep learning inference | GPU Programming | Huggingface | OpenCL | Performance Profiling | Performance optimization | PyTorch | Python | TensorRT-LLM | Test Design
Education
Related jobs
-
Machine Learning Engineer, AI Labs TWD 1300K-2000KAccuracy evaluation | Cache optimization | Deep learning | Distributed Systems | Inference OptimizationSenior-level Full TimeTaipei, Taiwan23h ago
-
Software Engineer, Embedded Software, Silicon TWD 2175K-2900KAndroid | C# | C++ | Debugging | Device DriversMid-level Full TimeNew Taipei, Banqiao District, New Taipei …1d ago
-
Machine Learning Engineer TWD 1000K-1500KAWS SageMaker | CI/CD | Containerization | Data Preprocessing | DockerConference workshop subsidies | Technical community supportMid-level Full TimeTaipei1d ago
-
Full-Stack AI Engineer, IPAI, SMAI TWD 600K-636KAgentic patterns | Angular | Batching | CI/CD | CachingEntry-level Full TimeTaichung - Fab 16, Taiwan2d ago
-
Senior-level Full TimeTaichung - Fab 16, Taiwan2d ago
-
Entry-level Full TimeLinkou, Taiwan2d ago
-
AWS | AWS CodeDeploy | AWS ECS | Agile | Apache HudiSenior-level Full TimeTaipei, Taiwan3d ago
-
C# | C++ | Embedded Linux | Java | JavaScriptSenior-level Full TimeHsinchu City, Taiwan3d ago
-
Senior LLM Inference Performance & Evaluation Engineer TWD 1700K-2300KBenchmarking | CI/CD | Concurrency | Dashboards | GPU UtilizationDevelopment opportunities | Inclusive environment | Mentoring | Training opportunitiesSenior-level Full TimeSingapore, SG / Penang, MY / …4d ago
-
Senior Inference Runtime Engineer TWD 1900K-2500KCUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory OptimizationFlexible work culture | Inclusive environment | Training and mentoringSenior-level Full TimeSingapore, SG / Penang, MY / …4d ago
-
Cloud Storage Engineer TWD 1700K-2500KBeeGFS | CI/CD | Caching | Capacity Planning | CephAutonomy | Fast growth learning opportunities | Inclusive environment | Training and mentoring | Welfare benefitsSenior-level Full TimeSingapore, SG / Penang, MY / …4d ago
-
Entry-level Full TimeTaichung - Fab 16, Taiwan4d ago
-
Audio Compression | C# | Computer Vision | Debugging | Device DriversEntry-level Full TimeTaiwan Hsinchu4d ago
-
AWS | Algorithms | Apache Airflow | Apache Pinot | Apache SparkSenior-level Full TimeTaipei, Taiwan; Tokyo, Japan7d ago
-
Software Engineer, Applied AI, Pixel TWD 2175K-2900KC++ | Cloud deployment | Computer Vision | Data Processing | Device deploymentMid-level Full TimeNew Taipei, Banqiao District, New Taipei …7d ago
-
(中科) Senior SRE Engineer - Big Data Platform TWD 480K-500KApache Cassandra | Apache Iceberg | Ceph | ELK Stack | ElasticsearchSenior-level Full Time台中，台灣, TW7d ago
-
Senior Ubuntu Embedded IoT System Engineer TWD 1500K-2000KACPI | ARM | Bash | Board Bring-up | BootloaderAnnual holiday leave | Annual learning and development budget | Distributed work environment | Maternity leave | Opportunity to travelSenior-level Full TimeOffice Based - Taipei, Taiwan8d ago
-
Embedded Software Engineer (Linux/C/C++) TWD 1500K-2000KC# | C++ | Cause analysis | Debugging | EtherCATFamily-friendly benefitsSenior-level Full TimeTWN-Hsinchu-Zhubei-KLA, Taiwan8d ago
-
Applied AI Engineer (Taiwan) TWD 480K-480KAutomation | CRM | Compliance | Document processing | FintechEnglish communication support | Hybrid work | Remote friendly team culture | Taiwan office accessMid-level Full TimeTaipei, Taiwan9d ago
-
Applied AI Engineer - AI Neobank App (Taiwan) TWD 480K-480KAPI Integration | Agents | Evaluation | LLM APIs | MonitoringEnglish communication support | Fast interview process | Hybrid workMid-level Full TimeTaipei, Taiwan9d ago
-
Software (Sr.) Engineer(Embedded/林口) TWD 310K-500KDeep learning | Docker | Docker Compose | Dockerfile | GitSenior-level Full TimeLinkou, Taiwan9d ago
-
R&D Engineer - Verdi Assistant (LLM/MCP/Agent) TWD 1500K-2000KC# | C++ | Context Management | Debugging | LLMHealth and wellness benefitsSenior-level Full TimeHsinchu, Taiwan10d ago
-
ATE testing | Analog Simulation | C++ | Data Analysis | Data MiningMid-level Full TimeTaichung - Fab 16, Taiwan10d ago
-
Senior Algorithm Engineer TWD 1000K-1300KAVX | Algorithm acceleration | Artificial Intelligence | C# | C++Family-friendly benefits | Inclusive work environmentSenior-level Full TimeTWN-Hsinchu-Zhubei-KLA, Taiwan11d ago
-
Senior-level Full TimeTaipei, Taiwan11d ago