Performance Engineer, Inference
Tasks
- Build and train speculative decoders
- Collaborate on architecture co design
- Integrate model and kernel artifacts into serving stack
- Measure and tune acceptance rate
- Modify inference runtime schedulers and allocators
- Operate distributed serving across nodes
- Optimize KV cache internals
- Own production inference serving path end to end
- Produce and defend latency and throughput metrics
- Profile performance and trace bottlenecks
- Provide on call inference SLO ownership
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | Copy-on-write | Disaggregated Prefill | Disaggregated prefill decode | Distributed Computing | EP | Fragmentation | Framework Tracing | Inference Serving | KV Cache Transfer | KV cache | Multi Tenant Serving | Multi-tenant | NVIDIA MIG | NVIDIA MPS | NVIDIA NCCL | Nsight Systems | Nvidia Dynamo | On-Call | PP | Perf | Prefill Decode | Prefix Sharing | Profiling | PySpy | SGLang | Scheduler | Speculative decoding | TP | TensorRT-LLM | VLLM
Education
N/A
Regions
Countries
States
Related jobs
-
Machine Learning Engineer 3 ( Firefly ) INR 3264K-5000KCUDA | Diffusion Models | Distributed Systems | GANs | GPU resource managementSenior-level Full TimeNoida, India R11h ago
-
Principal Software Engineer INR 3264K-5876KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeHyderabad, TG, India R2d ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R2d ago
-
Apache Spark | Artificial Intelligence | Docker | Generative AI | KubernetesCareer development opportunities | Employee resource groups | Inclusive Workplace Programs | Paid time off | Paid volunteer timeSenior-level Full TimeIndia R3d ago
-
Agentic AI | Alerting | Anomaly Detection | Apache Airflow | Artifact RegistryMid-level Full TimePune, Maharashtra, India R3d ago
-
AWS | Alerting | Application Security | Authentication | AuthorizationAdditional Holiday Benefits | Continuous learning | Flexible remote first async working | Fully remote | High ownership roleSenior-level Full TimeIndia R4d ago
-
AWS | Agent Frameworks | Alerting | Authentication | AuthorizationCollaborative global teams | Fully remote | High ownership culture | Paid annual leave | Professional developmentSenior-level Full TimeIndia R4d ago
-
Principal AI Engineer INR 2000K-5000KAutogen | CI/CD | Chroma | CrewAI | DockerFully remote | High-impact work | Remote working options | Small teamSenior-level Full TimeIndia - Remote R4d ago
-
Senior Computer Scientist INR 3242K-4680KAgentic AI | Architectural Principles | C++ | Cloud Native | Distributed SystemsSenior-level Full TimeNoida, India R4d ago
-
Senior Computer Scientist INR 2500K-4580KAutomation Testing | C++ | Debugging | Diffusion Models | GPUSenior-level Full TimeBangalore, India R4d ago
-
Staff Machine Learning Engineer INR 2771K-4064KAPI Design | Agent Orchestration | Agentic AI | Autonomous Agents | C++Career development | Flexible working options | Hybrid working | Modern office collaboration spaces | Work-life balanceSenior-level Full TimeIN: Pune - Building 5, India R4d ago
-
Access Control | Apache Airflow | Auditability | Azure | Change Data CaptureCollaborative environment | Documentation and architecture diagram creation support | Flexible contract engagement | Fully remote | Knowledge sharing cultureSenior-level Contract Full TimeIndia R5d ago
-
AI Engineer/Scientist INR 1800K-3000KAWS | Agentic Workflows | C++ | Data Structures | Data Structures and AlgorithmsHybrid work schedule | Mentorship | Onsite days 3 days per weekMid-level Full TimeBengaluru R5d ago
-
Principal AI-ML Engineer INR 3264K-5876KAgentic AI | Amazon Web Services | Apache Airflow | Artificial Intelligence | AzureSenior-level Full TimeBengaluru East, Karnataka, India R10d ago
-
Quantitative Analytics Engineer, Vice President INR 4000K-5000KAPI | Automated testing | Calculus | Enterprise Software | Enterprise Software DevelopmentComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeMU8-South (A) Wing, 7-10 Floor, Nesco … R12d ago
-
Sr Forward Deployed Engineer INR 2400K-3900KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureSenior-level Full TimeRemote - India R13d ago
-
Senior-level Full TimeNoida, India R13d ago
-
Senior Computer Vision Engineer INR 3600K-5560KAgile | Automation | C++ | Computer Vision | Diffusion ModelsSenior-level Full TimeNoida, India R18d ago
-
API Development | Autogen | C# | C++ | Cloud PlatformsLong-term engagement | Paid Holidays | Remote work | Training and professional growthMid-level Full TimeIndia Gate, New Delhi, India - … R19d ago
-
Senior AI/ ML Engineer INR 2000K-6000KArtificial Intelligence | CI/CD | Cloud Computing | Computer Vision | ContainersSenior-level Full TimeIndia - Remote R21d ago
-
Senior-level Full TimeAhmedabad, Gujarat, India R25d ago
-
Software Engineering Expert (AI Training) USD 200K-460KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFast onboarding | Flexible contractor schedule | Remote workMid-level Contract Full TimeIndia - Remote R1mo ago
-
Software Development Engineer- C++/Python - Full Time INR 1500K-2500KAPI Integration | ASP.NET MVC | ASP.NET WebForms | AWS | Agent workflowsFast-moving environment | High ownership | Occasional office visits | Remote-first culture | Work with global teamsMid-level Full TimeIndia - Remote R1mo ago
-
Lead Engineer INR 4000K-5500KC++ | Deep learning | Ethics | Hadoop | Language ModelsDiscretionary bonuses or commissions | Equity awards | Family medical vision and dental coverage | Hybrid workSenior-level Full TimeBengaluru, Karnataka, India R1mo ago
-
Computer Scientist 1 (C++) INR 1900K-2500KC++ | Computer Architecture | Data Structures | Data Structures and Algorithms | Object-OrientedMid-level Full TimeNoida, India R1mo ago