Staff Software Engineer, AI/ML Heterogeneous Systems
Tasks
- Collaborate with hardware architects on AI accelerator co design
- Deploy vLLM and SGLang on RISC V
- Design heterogeneous compute programming model
- Develop high performance RVV kernels
- Develop matrix compute kernels
- Enable Triton and MLIR lowering to hardware extensions
- Implement device runtime daemon
- Manage memory hierarchies
- Optimize host device synchronization
- Optimize paged attention and KV cache management
- Orchestrate asynchronous task execution
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | KVCaching | LLVM | MLIR | OpenCL | PagedAttention | PyTorch | Python | RISC-V | RISC-V Vector | ROCm | RVV | SGLang | Triton | VLLM
Education
Roles
Related jobs
-
Senior Software Engineer, Machine Learning (AIXON) TWD 1500K-2000KAWS SageMaker | Apache Airflow | Apache Spark | Argo Workflows | ArgoCDSenior-level Full TimeTaipei, Taiwan1d ago
-
Bash | Cloud platform | Data Processing | Data pipeline | DockerAsynchronous culture | Competitive salary | Life-changing product impact | Remote workMid-level Full TimeTaipei, Taiwan2d ago
-
Web Analytics & Data Infrastructure Engineer TWD 360K-420KA/B | A/B Testing | Analytics governance | Attribution | B testingMid-level Full TimeTaipei, Taiwan2d ago
-
Agentic AI | Cloud platform | Data Cleansing | Deep learning | Feature EngineeringSenior-level Full TimeTaoyuan - Fab 11, Taiwan2d ago
-
AI Engineer (TrendIQ Core Team) TWD 600K-1400KAPI Integration | AWS | Agent systems | Azure | CI/CDSenior-level Full TimeTaipei, Taiwan3d ago
-
Data Processing | Deep learning | Machine Learning | Model Evaluation | PythonCareer development | Inclusive culture | MentorshipEntry-level Full Time InternshipPCALT | San Lien Office, Taiwan3d ago
-
Senior-level Full TimeTW - Taipei, Taiwan3d ago
-
Algorithm Engineer (Ebeam) TWD 504K-636KC# | C++ | Calculus | Camera Calibration | CannyOn site assignments | Travel for customer supportMid-level Full TimeTWN-Hsinchu-Zhubei-KLA, Taiwan5d ago
-
Senior-level Full TimeTaiwan8d ago
-
Senior-level Full TimeTaipei, Taiwan8d ago
-
(Sr.) Applied AI Software Engineer in Windows Agent TWD 140K-500KAgile Development | Artificial Intelligence | C# | C++ | CI/CDSenior-level Full TimeTaipei, Taiwan8d ago
-
Senior Software Engineer, AI, TPU Infrastructure TWD 2600K-3120KC++ | Cloud Computing | Compute Technologies | Cross-Functional Communication | Cross-functionalCross-functional collaboration | Technical mentorshipSenior-level Full TimeTaipei, Taiwan9d ago
-
(Sr.) Applied AI DevOps Engineer TWD 480K-500KAWS | Agile | Azure | Bash | CI/CDAgile environment | Continuous learning | On-call rotationSenior-level Full TimeTaipei, Taiwan9d ago
-
(Sr.) Applied AI Software Engineer in Linux Agent TWD 480K-500KAI | Agent tools | Automation Testing | Bash | C#Agile environment | Cross-functional collaborationSenior-level Full TimeTaipei, Taiwan9d ago
-
(Sr.) Applied AI Software Engineer in Windows Agent TWD 140K-500KAgile | Artificial Intelligence | C# | C++ | CI/CDSenior-level Full TimeTaipei, Taiwan9d ago
-
Senior-level Full TimeTaipei, Taiwan10d ago
-
CI/CD | Data Pipelines | Data Sovereignty | Experimentation | Fine TuningMid-level Full TimeTaipei, Taiwan11d ago
-
A/B | A/B Testing | B testing | Confidence Intervals | Data DeduplicationConference ticket subsidy | Learning opportunities | Technical community participationMid-level Full TimeTaipei11d ago
-
Computer Vision | Data Pipelines | Data Preprocessing | Data Visualization | Deep learningMid-level Full TimeTaichung, TW, 40712d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career growth | Flexible remote setting | Friendly work environment | Impactful productMid-level Full TimeHsinchu, Taiwan13d ago
-
APIs | Big Data | Cloud platform | Deep learning | Distributed SystemsMid-level Full TimeTaipei, Taiwan15d ago
-
(Sr.) Applied AI Backend Engineer TWD 600K-1400KAI Agent | AI agent tools | AWS | Agent tools | AzureSenior-level Full TimeTaipei, Taiwan16d ago
-
Senior-level Full TimeTaipei, Taiwan16d ago
-
CS - Ops - Applied AI Engineer - Hsinchu TWD 504K-636KAgent-based | Agent-based AI | Data Security | Data platforms | EmbeddingsMid-level Full TimeTainan ASML Office, Taiwan17d ago
-
(Sr.) Applied AI Backend Engineer (TrendLife) TWD 480K-720KAWS | Azure | C# | CI/CD | Cloud platformSenior-level Full TimeTaipei, Taiwan17d ago