Sr. Software Engineer - Inference Engine (Platform Software)
Tasks
- Build distributed scalable inference
- Collaborate with compiler team to optimize NPU execution
- Design and implement inference engine
- Implement inference optimizations
- Manage KV cache and memory efficient execution
- Research and integrate LLM serving optimizations
Perks/Benefits
- N/A
Skills/Tech-stack
Batching | C++ | CUDA | Deep learning | Distributed Systems | Generative AI | KV cache | Language Models | Large Language Models | Load Balancing | Model Parallelism | Rust | Scheduling | Speculative decoding | Tensor Parallelism | TensorRT-LLM | Triton
Education
Related jobs
-
Alerting | Data Pipelines | Distributed Systems | GPU infrastructure | InferenceMid-level Full TimeSeoul, Korea R7h ago
-
API Integration | Agentic Workflows | Context engineering | Distributed Systems | EvaluationMid-level Full TimeSeoul, Korea R7h ago
-
Metrology Algorithm Developer for R&D TCT Korea KRW 48000K-67000KC# | Computer Vision | Deep learning | Image Processing | Image SegmentationEntry-level Full TimeHwaseong-Lucestar,KOR, Korea, Republic of1d ago
-
Staff Software Engineer, Machine Learning KRW 65000K-90000KBig Data | Causal Inference | Deep Neural Networks | Deep learning | JavaHybrid work | In office collaboration three times per weekSenior-level Full TimeSeoul, South Korea3d ago
-
Staff Software Engineer, Machine Learning KRW 65000K-90000KCausal Inference | Deep learning | Java | Keras | Machine LearningHybrid work model | In office collaboration three times per weekSenior-level Full TimeSeoul, South Korea3d ago
-
[AI Research Div.] AI Agent Engineer (2년 이상) KRW 31000K-31000KAgentic AI | Benchmarking | Deep learning | Evaluation | LLM AgentsSenior-level Full TimeSeoul5d ago
-
Generative AI Systems Developer KRW 31000K-31000KAI Agents | AIOps | Azure | Backend Development | Cloud ArchitectureSenior-level Full TimeKR-AIA Tower, Korea, Republic of5d ago
-
[AI Research Div.] Research Engineer - Vision Language Action Game Agent (2년 이상 / 인턴) KRW 31000K-31000KData Preprocessing | Data pipeline | Deep learning | Experiment design | Inference OptimizationEntry-level Full TimeSeoul6d ago
-
Machine Learning Engineer (Match Group AI) KRW 31000K-31000KA/B | A/B Testing | B testing | Causal Inference | Causal analysisSenior-level Full TimeSeoul, South Korea6d ago
-
Autoscaling | Batching | Capacity Planning | Disaggregated Prefill | Disaggregated prefill decodeConference allowance | English education program | Equipment stipend | Flu vaccination support | Global buddy programSenior-level Full TimeSeoul, South Korea6d ago
-
Software Engineer II - Moloco Commerce Media KRW 50000K-67271KAPIs | Algorithms | Apache Beam | Apache Spark | BigQueryMid-level Full TimeSeoul, Korea7d ago
-
Machine Learning Engineer (Match Group AI) KRW 30000K-30000KA/B | A/B Testing | AWS | B testing | Causal InferenceMid-level Full TimeSeoul, South Korea7d ago
-
Intern- Deep Learning R&D for Automated Driving KRW 48000K-67000KC# | C++ | Deep learning | Machine Learning | PyTorchEntry-level InternshipSeoul, Korea, Republic of8d ago
-
Platform Engineer KRW 44000K-50000KAgent Orchestration | Agentic Workflows | Cloud infrastructure | Code repair | Context engineeringMid-level Full TimeSeoul, KR, 0657811d ago
-
Sr. Lead Engineer (Full Stack Developer) KRW 65000K-90000KAWS | Azure | Client-Server | Client-Server Architecture | Data ModelingSenior-level Full TimeSeoul, Korea, republic of13d ago
-
Machine Learning Software Engineer (Match Group AI) KRW 44000K-44000KApache Flink | Apache Kafka | Apache Spark | Batch Processing | C#Mid-level Full TimeSeoul, South Korea15d ago
-
Algorithms | Batch Processing | C# | Data Structures | Distributed SystemsMid-level Full TimeSeoul, South Korea15d ago
-
AI Engineer (Navigation Agent) KRW 30880K-30880KClassification | Data Quality | Dataset Construction | Deep learning | Distributed TrainingSenior-level Full TimePangyo (Software Dream Center), South Korea18d ago
-
AI Engineer (On-device Agent Orchestration 개발) KRW 31000K-31000KAndroid | C# | Generative AI | Java | KotlinSenior-level Full TimePangyo (Software Dream Center), South Korea20d ago
-
[집중채용] LLM Engineer (LLM Training) KRW 26800K-26800KDDP | Deep learning | Distributed Training | Docker | Efficient Fine TuningSenior-level Full TimePangyo (Software Dream Center), South Korea20d ago
-
LLM Engineer (Reinforcement Learning) KRW 26800K-26800KDDP | DPO | Deep learning | Distributed Training | DockerSenior-level Full TimePangyo (Software Dream Center), South Korea20d ago
-
[집중채용] Deep Learning Engineer (음성 인식 및 wake word detection 개발) KRW 30880K-30880KAndroid | Audio Processing | C# | C++ | CI/CDSenior-level Full TimePangyo (Software Dream Center), South Korea20d ago
-
Intern - GenAI Benchmarking (MLE) / On-Device Model Deployment (SWE) KRW 45000K-67000KAIMet | Automated testing | Executorch | Git | Hugging FaceEntry-level InternshipSeoul, Korea, Republic of20d ago
-
Physical AI Engineer (Model) KRW 31000K-31000KC++ | CUDA | Deep learning | Imitation Learning | JAXSenior-level Full TimePangyo (Software Dream Center), South Korea22d ago
-
Senior Physical AI Engineer (Simulation) KRW 31000K-31000K3D Gaussian Splatting | C++ | CARLA | CUDA | Closed LoopSenior-level Full TimePangyo (Software Dream Center), South Korea22d ago