AI Computing Software Development Engineer, TensorRT-LLM
Tasks
- Analyze and optimize LLM performance
- Collaborate with research and product teams on inference architecture
- Develop LLM inference software
- Implement TensorRT LLM features
- Publish results in scientific conferences
- Scale inference software to multiple platforms
- Track AI academic developments
- Tune LLM inference performance
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | Debugging | Huggingface | LLM Inference | OpenCL | Performance Modeling | Performance optimization | Profiling | PyTorch | Python | Software Design | Software Engineering | TensorRT
Education
Related jobs
-
AWS | AWS CodeDeploy | AWS ECS | Agile | Apache HudiSenior-level Full TimeTaipei, Taiwan12h ago
-
Senior LLM Inference Performance & Evaluation Engineer TWD 1700K-2300KBenchmarking | CI/CD | Concurrency | Dashboards | GPU UtilizationDevelopment opportunities | Inclusive environment | Mentoring | Training opportunitiesSenior-level Full TimeSingapore, SG / Penang, MY / …1d ago
-
Senior Inference Runtime Engineer TWD 1900K-2500KCUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory OptimizationFlexible work culture | Inclusive environment | Training and mentoringSenior-level Full TimeSingapore, SG / Penang, MY / …1d ago
-
Cloud Storage Engineer TWD 1700K-2500KBeeGFS | CI/CD | Caching | Capacity Planning | CephAutonomy | Fast growth learning opportunities | Inclusive environment | Training and mentoring | Welfare benefitsSenior-level Full TimeSingapore, SG / Penang, MY / …1d ago
-
Entry-level Full TimeTaichung - Fab 16, Taiwan1d ago
-
Audio Compression | C# | Computer Vision | Debugging | Device DriversEntry-level Full TimeTaiwan Hsinchu1d ago
-
AWS | Algorithms | Apache Airflow | Apache Pinot | Apache SparkSenior-level Full TimeTaipei, Taiwan; Tokyo, Japan3d ago
-
Software Engineer, Applied AI, Pixel TWD 2175K-2900KC++ | Cloud deployment | Computer Vision | Data Processing | Device deploymentMid-level Full TimeNew Taipei, Banqiao District, New Taipei …4d ago
-
(中科) Senior SRE Engineer - Big Data Platform TWD 480K-500KApache Cassandra | Apache Iceberg | Ceph | ELK Stack | ElasticsearchSenior-level Full Time台中，台灣, TW4d ago
-
Senior Ubuntu Embedded IoT System Engineer TWD 1500K-2000KACPI | ARM | Bash | Board Bring-up | BootloaderAnnual holiday leave | Annual learning and development budget | Distributed work environment | Maternity leave | Opportunity to travelSenior-level Full TimeOffice Based - Taipei, Taiwan4d ago
-
Embedded Software Engineer (Linux/C/C++) TWD 1500K-2000KC# | C++ | Cause analysis | Debugging | EtherCATFamily-friendly benefitsSenior-level Full TimeTWN-Hsinchu-Zhubei-KLA, Taiwan5d ago
-
Software Development Engineer, Ring AI TWD 1000K-1500KAgile | Cloud services | Distributed Systems | GenAI | JavaMid-level Full TimeTaipei City, TWN5d ago
-
Applied AI Engineer (Taiwan) TWD 480K-480KAutomation | CRM | Compliance | Document processing | FintechEnglish communication support | Hybrid work | Remote friendly team culture | Taiwan office accessMid-level Full TimeTaipei, Taiwan6d ago
-
Applied AI Engineer - AI Neobank App (Taiwan) TWD 480K-480KAPI Integration | Agents | Evaluation | LLM APIs | MonitoringEnglish communication support | Fast interview process | Hybrid workMid-level Full TimeTaipei, Taiwan6d ago
-
Software (Sr.) Engineer(Embedded/林口) TWD 310K-500KDeep learning | Docker | Docker Compose | Dockerfile | GitSenior-level Full TimeLinkou, Taiwan6d ago
-
R&D Engineer - Verdi Assistant (LLM/MCP/Agent) TWD 1500K-2000KC# | C++ | Context Management | Debugging | LLMHealth and wellness benefitsSenior-level Full TimeHsinchu, Taiwan6d ago
-
ATE testing | Analog Simulation | C++ | Data Analysis | Data MiningMid-level Full TimeTaichung - Fab 16, Taiwan7d ago
-
Senior Algorithm Engineer TWD 1000K-1300KAVX | Algorithm acceleration | Artificial Intelligence | C# | C++Family-friendly benefits | Inclusive work environmentSenior-level Full TimeTWN-Hsinchu-Zhubei-KLA, Taiwan8d ago
-
Senior-level Full TimeTaipei, Taiwan8d ago
-
Machine Learning & Generative AI Engineer, up to Staff TWD 1000K-1300KAI Agents | APIs | AWS | Agentic Workflows | Cloud ComputingSenior-level Full TimeHsinchu City, Hsinchu City, Taiwan11d ago
-
Cause analysis | Dashboards | Data analytics | Excel | JMPSenior-level Full TimeHsinchu City, Hsinchu City, Taiwan11d ago
-
3DIC Yield Analytics & Diagnostics Engineer, Staff TWD 135K-500KArtificial Intelligence | Cause analysis | Data Analysis | Data analytics | Data correlationSenior-level Full TimeHsinchu City, Hsinchu City, Taiwan11d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Competitive salary | Laid-back atmosphere | Remote-friendly, distributed teamMid-level Full TimeTaipei, Taiwan12d ago
-
Senior Embedded Firmware Engineer TWD 1200K-1800KBLE | Bluetooth Low Energy | C# | C++ | Cloud-connected devicesSenior-level Full TimeTW - Taiwan12d ago
-
Staff Embedded Firmware Engineer TWD 200K-500KBluetooth Low Energy | C++ | Cause analysis | Cloud Integration | DebuggingSenior-level Full TimeTW - Taiwan12d ago