Senior Forward Deployed Engineer I (AI Inference)
Tasks
- Architect distributed multi tenant LLM inference systems
- Build internal tooling and reusable blueprints
- Contribute performance fixes to open source inference ecosystems
- Debug KV cache locality issues
- Deploy production LLM serving with Kubernetes
- Drive compute efficiency with parallelism and batching
- Guide quantization for inference efficiency
- Implement continuous batching
- Implement prefill decode disaggregation
- Implement tiered prefix caching
- Lead AI inference delivery
- Optimize KV cache aware routing
- Optimize latency and throughput for LLMs
- Profile GPU memory utilization
- Support high concurrency production workloads
- Translate latency SLAs into infrastructure solutions
Perks/Benefits
- Conference reimbursement
- Employee assistance program
- Flexible time off
- LinkedIn Learning access
- Local Employee Meetups
- Training reimbursement
Skills/Tech-stack
AI Inference | Continuous batching | Data parallelism | Distributed Systems | FP4 | FP8 | GRPC | Go | KV cache | Kubernetes | LLM serving | Llm-d | MOE | Mixture of Experts | Nvidia Dynamo | Paged Attention | Python | Quantization | Ray Serve | SGLang | Tensor Parallelism | TensorRT-LLM | VLLM
Education
N/A
Related jobs
-
Mid-level Full TimeSaidapet17h ago
-
Senior Software Engineer - Optimization Topics INR 2200K-3465KAWS | AWS QuickSight | Agile | Amazon CloudWatch | AngularSenior-level Full TimePune - Maharashtra - India17h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India18h ago
-
Software Engineer INR 346K-346KAPI Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimePune, MH, India18h ago
-
Staff Software Engineer, GenAI Gaming INR 2000K-5000K3D mathematics | Computer Vision | Data Processing | Diffusion Transformers | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Staff Software Engineer, AI/ML GenAI, Google Ads INR 2500K-5000KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Entry-level Full TimePune, ASIA, India19h ago
-
Mid-level Full TimePune, Maharashtra, India20h ago
-
Senior-level Part TimeGurugram, Haryana, India20h ago
-
Data Integration Specialist INR 1500K-2600KAPI Integration | AWS | Apache Kafka | Azure | Azure DataSenior-level Full TimeBengaluru, IN, 56010321h ago
-
Senior Cloud Engineer - AI-ML Platform INR 2500K-5000KAccess Control | Amazon Web Services | Apache Kafka | Azure DevOps | CloudFormationInclusion and belongingSenior-level Full TimeBangalore, Karnataka, IN, 56010023h ago
-
Software Engineer INR 2500K-4200KAI Large Language Models | AWS Glue | Access Management | Amazon Web Services | CloudFormationSenior-level Full TimeBangalore, Karnataka, IN, 56010023h ago
-
Software Technician (Robotics Software Operations) INR 3000K-4000KBash | Git | Linux | Python | SSHSenior-level Full TimePune, Maharashtra, India23h ago
-
AI Assisted Development | Algorithms | Amazon S3 | Apache Iceberg | Cloud ComputingFlexible work schedule | Remote work optionsSenior-level Full TimeHyderabad, India R1d ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R1d ago
-
ML Engineer INR 2400K-3000KClassification | Clustering | Computer Vision | Deep learning | DevOpsAnnual leave | Digital learning platforms | Employee assistance program | Flexible working arrangements | Learning & development opportunitiesMid-level Full TimeBangalore, IN1d ago
-
Senior Technical Specialist - AWS/AWS Lambda/AWS Glue/AWS SNS INR 1400K-2600KAWS Glue | AWS Lambda | AWS Redshift | AWS SNS | AgileSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R1d ago
-
Lead Software Engineer - Machine Learning INR 5000K-6000KAPI Design | Data pipeline | Distributed Systems | MLOps | Machine LearningSenior-level Full TimeChennai, TN, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Principal Software Engineer INR 2500K-5000KAI orchestration | Artificial Intelligence | By Design | C# | C++Senior-level Full TimeIndia, Telangana, Hyderabad1d ago
-
Data Engineer - Senior 6 INR 1500K-2500KAgile | Cassandra | Data Architecture | Data Catalog | Data GovernanceSenior-level Full TimePune, Maharashtra, India1d ago
-
Entry-level Full TimePune, Maharashtra, India1d ago
-
Entry-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer - Senior 3 INR 1500K-2500KAPI Development | Agile | Apache HBase | Apache Hive | Apache KafkaSenior-level Full TimePune, Maharashtra, India1d ago