Senior Software Engineer I - AI Inference Data Plane
Tasks
- Architect multi tenant AI inference cloud systems
- Collaborate on technical roadmaps
- Design data plane services for AI inference
- Develop microservices hosting large generative AI models
- Implement tensor data parallelism
- Maintain observability and SLOs
- Mentor junior engineers
- Optimize distributed inference performance
- Optimize kv cache
- Route inference requests intelligently
Perks/Benefits
- Conference reimbursement
- Employee assistance program
- Employee stock purchase program
- Equity compensation
- Flexible time off
- LinkedIn Learning access
- Local Employee Meetups
- Training reimbursement
Skills/Tech-stack
Continuous batching | Data parallelism | Databases | Distributed Systems | GPU Optimization | GRPC | Go | Infrastructure as Code | KV cache | Kubernetes | LLM Inference | Messaging Systems | Microservices | Multi-tenant | Multi-tenant architecture | NVLink | Nvidia Dynamo | Observability | Open Source | Python | Quantization | Ray Serve | RoCE | SGLang | SLO | Tenant architecture | Tensor Parallelism | VLLM | XGMI | “as-code”
Education
N/A
Related jobs
-
Senior AI Engineer INR 2475K-4000KAgile | Amazon Web Services | CI/CD | CSS | ConfluenceHome office setup reimbursement | Mental wellness support | Ongoing learning & development | Paid time off | Recharge daysSenior-level Full TimeChennai or Remote, India R4h ago
-
Data Scientist & AI Developer INR 3000K-5000KA/B | A/B Testing | AWS SageMaker | Azure ML | B testingSenior-level Full TimeBangalore, KA, IN, 5600765h ago
-
Senior Data Engineer - BI Data Products & Databricks (Channel) INR 1971K-3000KAWS | Amazon Redshift | Data Modeling | Data Observability | Data QualitySenior-level Full TimeBangalore, KA, IN, 5600765h ago
-
DevOps INR 2000K-4000KAWS | Azure | CI/CD | CloudFormation | DatadogCoworking stipend | Equity | Flexible savings accounts | Flexible work location | Health coverageMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Scala Data Engineer - VOIS INR 800K-800KApache Spark | Big Data | Cassandra | Cloud Composer | Cloud StorageMid-level Full TimePune, IN11h ago
-
Senior Python GenAI Developer – AWS Bedrock & AI Platforms INR 2000K-5000KAWS Bedrock | Amazon Web Services | CI/CD | DevOps | DockerSenior-level Full TimePune, Gera Commerzone SEZ, India11h ago
-
Executive-level Full TimeMumbai, Nirlon Knowledge Park (BX) 9th …11h ago
-
Senior-level Full TimePune, Gera Commerzone SEZ, India11h ago
-
Senior Staff AI Engineer INR 2500K-5000KAWS | Agents | Azure | Code Quality | Code Quality AutomationRelocation assistanceSenior-level Full TimeBengaluru, India14h ago
-
Senior-level Full Timebangalore, India18h ago
-
Staff, Machine Learning Engineer (L4) INR 3000K-3584KAWS | Agile | Apache Spark | Batch Processing | Data PipelinesGenerous time off | Healthcare | Occasional travel | Parental leave | Remote workSenior-level Full TimeRemote - India R18h ago
-
Analytics engineering | Apache Airflow | BigQuery | Cloud platform | DBTAnnual off-site events | Co-working allowance | Equity (ESOP) | Flexible schedule | Fully remoteSenior-level Full TimeIndia R19h ago
-
Senior GenAI Data Integration Engineer INR 3000K-5000KApp Engine | BigQuery | Cloud Functions | Cloud Run | Function CallingSenior-level Full TimeHyderabad, India21h ago
-
Senior-level Full TimeHyderabad, India21h ago
-
Associate Lead Data Scientist INR 1800K-2500KAPI Design | AWS SageMaker | Airflow | Azure Machine Learning | CaptumMid-level Full TimeHyderabad, Andhra Pradesh, India22h ago
-
Senior-level Full TimeIN-HR-Gurgaon22h ago
-
Mid-level Full TimeBengaluru, Karnataka22h ago
-
Mid-level Full TimeBengaluru, Karnataka22h ago
-
Associate Engineer - Data Engineer pyTorch INR 980K-1500KData Pipelines | Data Transformation | Data cleaning | ETL | Feature EngineeringMid-level Full TimeBangalore - Karnataka, India - Kalyani …22h ago
-
AWS | Application development | Artificial Intelligence | Cloud Architecture | Cloud platformMentorship | Professional growth opportunities | Remote-first work environment | Work-life balanceSenior-level Full TimeIndia23h ago
-
Senior Manager INR 3000K-5000KFeature Engineering | Hugging Face | Hugging Face Transformers | Intent detection | Language ProcessingSenior-level Full TimeGurugram, Haryana, India1d ago
-
Software Engineer II - Serverless Inference INR 2000K-3000KAPI Gateway | Automation | Capacity Planning | Distributed Systems | Fault ToleranceEmployee assistance program | Flexible time off | LinkedIn Learning | Reimbursement for trainingMid-level Full TimeBengaluru1d ago
-
Senior Software Engineer I - Serverless Inference INR 2475K-3500KAPI Gateway | Capacity Planning | Distributed Systems | Go | Incident ManagementConference reimbursement | Employee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning accessSenior-level Full TimeBengaluru1d ago
-
Senior-level Full TimeBangalore, Karnataka, India1d ago
-
Executive-level Full TimeBangalore, Karnataka, India1d ago