LLM Inference Frameworks and Optimization Engineer
San Francisco, Singapore, Amsterdam
USD 160K-230K Mid-level Full Time
Tasks
- Analyze inference performance bottlenecks
- Apply CUDA graph optimizations
- Design distributed inference engines
- Develop model execution plans
- Implement distributed inference strategies
- Implement speculative decoding
- Optimize GPU TPU and accelerator performance
- Optimize TensorRT and TRT-LLM graphs
- Optimize end to end model serving pipelines
- Optimize inference latency and throughput
- Perform software hardware co design
- Use torch compile for model execution
Perks/Benefits
Skills/Tech-stack
C++ | CUDA | CUDA graph | Cluster scheduling | Compiler | Efficient kernels | GPU Cluster | GPU Kernel | GPU Programming | GPU cluster scheduling | GPU kernel optimization | KV cache | Kernel optimization | Mixture of Experts | Model Quantization | Pipeline parallelism | PyTorch | Python | Speculative decoding | TRT-LLM | Tensor Parallelism | TensorRT | Torch compile | Transformer | Triton | Workload Scheduling
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11h ago
-
AI Engineer USD 112K-161KAWS | Anomaly Detection | Azure | C++ | Cause analysis401k matching | Educational assistance | Maternity leave | Paid Holidays | Paid sick timeMid-level Full TimePlano,Texas,United States R11h ago
-
Senior-level Full TimeAnnapolis Junction, MD11h ago
-
AWS | Anomaly Detection | Azure | Docker | Feature EngineeringSenior-level Full TimeSingapore, Singapore12h ago
-
Senior-level Full TimeSingapore, Singapore12h ago
-
Data Engineer III (Top Secret Clearance Required) USD 107K-179KAWS | Azure | Cloud Integration | Computer Vision | Data PipelinesSenior-level Full TimeArlington/Rosslyn, Virginia, United States14h ago
-
Mid-level Full TimeArlington/Rosslyn, Virginia, United States14h ago
-
Data Modeling | Data integration | Java | LLM Agents | Language ModelsEntry-level Full TimeSingapore, Singapore14h ago
-
Software Engineer, AI/ML Computer Vision, Pixel Camera USD 147K-211KC++ | Computer Vision | Data Processing | Debugging | Image classificationMid-level Full TimeMountain View, CA, USA15h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KAlloyDB | Aurora | Bigtable | C++ | Capacity PlanningTechnical workshops and training delivery | Travel up to 30 percentMid-level Full TimeReston, VA, USA15h ago
-
Senior Data Engineer, Product Analytics, Payments SGD 153K-204KAI workflows | Analytics infrastructure | Automation | Data Architecture | Data GovernanceSenior-level Full TimeSingapore15h ago
-
API Design | Apache Flink | Apache Presto | Apache Spark | AutoscalingSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Machine Learning Engineer USD 136K-215KAgentic AI | Autonomous Vehicles | Bayesian Inference | Code review | Deep learningMid-level Full TimeChicago, IL, US21h ago
-
Artificial Intelligence | Automation | Data Analysis | Data Visualization | ExcelEntry-level Full TimeGilbert, AZ, US21h ago
-
Forward Deployed AI Engineer USD 140K-240KAPIs | AWS | Azure | C# | Computer Vision401k matching | Comprehensive healthcare | Education stipend | Stock awards | Wellness stipendMid-level Full TimeMountain View, CA1d ago
-
Senior-level Full TimeCedar Rapids, IA1d ago
-
AWS | Azure | Cloud Run | Django | Docker401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeSan Jose, CA, United States1d ago
-
AI Coding Agents | AI coding | Agent Orchestration | Alerting | Benchmarking26 vacation days | E-learning support | Flexible working hours | Hybrid work | Language trainingSenior-level Full TimeNLD - Alphen Aan Den Rijn, … R1d ago
-
Associate Deal Analytics & Technology EUR 50K-67KArtificial Intelligence | Data Engineering | Data Modeling | Data cleaning | Data pipelineAdditional vacation days | Coaching | Mobility allowance | Training | Well-being budgetMid-level Full TimeAmsterdam - Thomas R. Malthusstraat 5, …1d ago
-
Data & Integration Engineer (GenAI) SGD 74K-74KBatch Processing | CI/CD | Cloudera | Confluence | Control-MSenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
Batch Processing | CI/CD | Cloudera | Confluence | Control-MSenior-level Full TimeSingapore, Singapore, Singapore1d ago
-
Lead AI Engineer SGD 165K-238KAPI Development | Agent workflows | Artificial Intelligence | Distributed tracing | EvaluationSenior-level Full TimeSingapore - Technology Centre1d ago
-
Data Scientist SGD 120K-190KActor-critic | Amazon S3 | Apache Airflow | Apache Spark | Attention MechanismsMid-level Full TimeSingapore - Suntec1d ago
-
Data Infra Platform Engineer SGD 178K-221KADLS Gen2 | Access Management | Apache Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeSingapore - Suntec1d ago
-
Senior Analytics Engineer USD 87K-161KAutomation | CI/CD | DBT | Data Ingestion | Data Modeling401k | Flexible workplace options | Hybrid work options | Paid time off | Remote work optionsSenior-level Full TimeRemote-FL, United States R1d ago