Performance Engineer, Inference
Tasks
- Build and train speculative decoders
- Collaborate on architecture co design
- Integrate model and kernel artifacts into serving stack
- Measure and tune acceptance rate
- Modify inference runtime schedulers and allocators
- Operate distributed serving across nodes
- Optimize KV cache internals
- Own production inference serving path end to end
- Produce and defend latency and throughput metrics
- Profile performance and trace bottlenecks
- Provide on call inference SLO ownership
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | Copy-on-write | Disaggregated Prefill | Disaggregated prefill decode | Distributed Computing | EP | Fragmentation | Framework Tracing | Inference Serving | KV Cache Transfer | KV cache | Multi Tenant Serving | Multi-tenant | NVIDIA MIG | NVIDIA MPS | NVIDIA NCCL | Nsight Systems | Nvidia Dynamo | On-Call | PP | Perf | Prefill Decode | Prefix Sharing | Profiling | PySpy | SGLang | Scheduler | Speculative decoding | TP | TensorRT-LLM | VLLM
Education
N/A
Regions
Countries
States
Related jobs
-
AWS | Ansible | As-a-Service | Azure | BIOSSenior-level Contract Full TimeIndia - Remote R2d ago
-
Data Science & Engineering Lead INR 3000K-4500KAPI Gateway | AWS Glue | AWS Lambda | Airbyte | Amazon EC2Senior-level Full TimeIndia - Remote R2d ago
-
A/B | A/B Testing | AWS | Apache Spark | AzureFlexibility programmes | Hybrid work | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India R2d ago
-
A/B | A/B Testing | AIOps | AWS | Artificial IntelligenceFlexibility programmes | Hybrid work environment | MentorshipSenior-level Full TimeBengaluru Millenia, India R2d ago
-
C# | C++ | Data Management | Data Structures | Database DesignOnsite support | Travel for customer supportMid-level Full Time(HE)Office Bangalore, Bhoruka Tech Park, India R2d ago
-
Senior Software Engineer I-Agentic AI INR 2500K-4580KAsynchronous Workflows | C++ | Containerization | Distributed Systems | DockerConference reimbursement | Employee assistance program | Flexible time off | Hybrid work | LinkedIn Learning accessSenior-level Full TimeHyderabad R3d ago
-
Senior-level Full TimeBengaluru East, Karnataka, India R4d ago
-
Staff Data Engineer INR 3242K-4200KCloud Data | Cloud data platform | Continuous integration | Data Engineering | Data QualityFlexible work hours | Mentorship | Remote work optionsSenior-level Full TimeHyderabad, Telangana , India R4d ago
-
Forward Deployed AI Engineer INR 2500K-5000KAgentic Systems | Apache Spark | Data Engineering | Distributed data | Distributed data engineeringCareer development | Employee resource groups | Flexible work from home | Internet reimbursement | Paid time offSenior-level Full TimeIndia-Bangalore R5d ago
-
Senior-level Full TimeBangalore, India R5d ago
-
Software Engineer- Embedded Developer- C/C++ INR 2475K-3465K802.11ac | 802.11ax | 802.11be | BSP | Box testingCafé | Healthcare | On-site gym | Philanthropy | Social interest groupsSenior-level Full TimeBangalore, India R5d ago
-
Mid-level Full TimeNoida, India R6d ago
-
Software Engineering Senior Advisor - HIH - Evernorth INR 2500K-4500KAWS SageMaker | Data Preprocessing | Databricks | Distributed Computing | Feature EngineeringSenior-level Full TimeHyderabad, Telangāna, India R7d ago
-
Engr III Spec-AI Science INR 2500K-4800KAlgorithm performance | Algorithm performance tuning | Amazon SageMaker | Azure Machine Learning | BentoMLSenior-level Full TimeVDSI, 201 TITUS,. BLDG#10, Hyderabad, IND … R9d ago
-
Dist Engr-AI Science INR 2000K-5000KAgentic AI | CNN | CPU architecture | Data Preprocessing | Deep learningHybrid work | Mentorship | Work from homeSenior-level Full TimeVDSI, 201 TITUS,. BLDG#10, Hyderabad, IND … R9d ago
-
Princ Engr-AI Science INR 2500K-5000KAgentic AI | Data Preprocessing | Deep learning | Distributed Computing | Entity ExtractionHybrid work schedule | Work from homeSenior-level Full TimeVDSI-5th floor Wing B, Etamin Block, … R9d ago
-
Senior Embedded Software Engineer INR 1800K-3000KAUTOSAR | C# | C++ | Event evaluation | ISO/SAE 21434BusinessBike bicycle leasing | Continuing education programs | Corporate volunteering | Flexible working hours | Health programsSenior-level Full TimePune, MH, IN, 411057 R9d ago
-
Software Engineering LMTS - Tableau INR 3150K-4500KAWS | Agile | Build processes | C# | C++1-on-1 coaching | Adoption Assistance | Fertility benefits | On-demand training | Parental leaveSenior-level Full TimeIndia - Hyderabad R9d ago
-
Senior AI Engineer INR 2000K-5000KAmazon Web Services | CI/CD | CUDA | Cloud platform | Computer VisionSenior-level Full TimeIndia - Remote R11d ago
-
Software Engineer, Data Foundations INR 2500K-4200KAI frameworks | Alerting | Batch Processing | Big Table | Data ModelingHybrid work | Remote workSenior-level Full TimeRemote (IND), India R11d ago
-
Mid-level Full TimeNoida, India R12d ago
-
Databricks Data Engineer (Databricks, PySpark, Cloud, MLOps) | 100% Remote | Contract 12 + Months | AS A INR 1500K-2600KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | DatabricksRemote workSenior-level Full TimeIndia, India R13d ago
-
ARM | Azure DevOps | C# | C++ | DSPSenior-level Full TimeBangalore, Karnataka, India R16d ago
-
Staff Software Engineer, Machine Learning INR 3000K-4580KC++ | Classification | Data Pipelines | Deep learning | EmbeddingsHealth and wellness programs | Time away for employeesSenior-level Full TimeBengaluru, KA, India R17d ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R17d ago