Director, Engineering - Serverless Inference
Tasks
- Collaborate on GPU utilization and fault tolerance
- Define technical roadmap and architecture
- Design and optimize inference infrastructure
- Develop and maintain highly available inference APIs
- Ensure observability and reliability engineering practices
- Lead serverless inference platform development
- Manage incident response and operational readiness
- Partner cross functionally to deliver production systems
- Raise engineering bar through software design
- Recruit mentor and coach engineers
Perks/Benefits
- Employee assistance program
- Employee stock purchase program
- Flexible time off
- LinkedIn Learning access
- Local Employee Meetups
- Reimbursement for conferences
- Training reimbursement
Skills/Tech-stack
API Gateway | Capacity Planning | Cloud Native | Distributed Systems | Fault Tolerance | GPU Computing | Incident Management | Inference Server | Kubernetes | LLM serving | Microservices | Multi-region | Multi-region architectures | Observability | Operational automation | Reliability Engineering | Service Mesh | TensorRT-LLM | Triton Inference | Triton Inference Server | VLLM
Education
N/A
Related jobs
-
Director of AI/ML Engineering (EDA & Semiconductor Design) INR 2400K-6000KArtificial Intelligence | Cloud Platforms | Compute Infrastructure | Data Pipelines | Data labelingEmployee resource groups | Flexible work environment | Remote workExecutive-level Full TimeHyderabad, India6h ago
-
Manager, Machine Learning Engineering INR 1000K-1800KAWS | Automatic Speech Recognition | Cloud platform | Computer Vision | Distributed SystemsChallenging ML problems | Equal opportunity employer | Fast track growth opportunitiesMid-level Full TimeBangalore - Embassy Tech Village, India16h ago
-
Director of Engineering, Managed Database Service INR 1500K-5199KAlerting | AlloyDB | Amazon RDS | Aurora | Azure DatabaseExecutive-level Full TimeBengaluru1d ago
-
Lead Software Engineer (Cloud Native | Microservices | AWS) INR 3000K-4000K.NET | API | AWS | AWS CDK | Behavior-Driven DevelopmentEnhanced medical benefits | Hybrid work | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
Senior Director of Engineering – Storage Products INR 2755K-3500KAmazon S3 | Block Storage | Capacity Management | Capacity Planning | CephConference reimbursement | Education reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning accessSenior-level Full TimeBengaluru1d ago
-
Engineering Manager INR 2200K-3000KAI-assisted coding | API Gateway | AWS | Angular | Assisted codingMid-level Full TimeHyderabad, India1d ago
-
Manager, Data Engineering INR 1600K-2400KArtificial Intelligence | Azure | Azure Data | Azure Data Lake | Azure Data Lake StorageAccidental insurance | Maternity leave | Medical insurance | Paid leave | Paternity leaveMid-level Full TimeRemote - India R1d ago
-
Director, Engineering - Inference Serving Engine INR 1500K-6000KAuto Scaling | Benchmarking | CRIU | CUDA | Checkpoint RestoreEmployee assistance program | Flexible time off | LinkedIn Learning access | Local Employee Meetups | Training and education reimbursementExecutive-level Full TimeBengaluru2d ago
-
Data Scientist Director INR 4000K-5199KArtificial Intelligence | Attribution measurement | Data Governance | Data publishing | Data readinessExecutive-level Full TimeBengaluru, Karnataka, India2d ago
-
Senior-level Full TimePune City,India2d ago
-
Engineering Manager – AI Platforms INR 3000K-5000KAWS Bedrock | AWS SageMaker | Agentic Workflows | Agile | Azure AICareer growth | Collaborative team environment | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India2d ago
-
Senior-level Full TimeMumbai, Maharashtra, India2d ago
-
Director, Engineering - Forward Deployed Engineering INR 1500K-5199KAI infrastructure | AI orchestration | Agentic Systems | Agents SDK | AutomationConference reimbursement | Employee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning accessExecutive-level Full TimeBengaluru2d ago
-
Director of Software Engineering - GenAI, Python INR 3000K-6000KA/B | A/B Testing | AWS | Agentic Workflows | AnthropicExecutive-level Full TimeBengaluru, Karnataka, India2d ago
-
Engineering Lead /Sr. Associate Director, Technology Management INR 1300K-2000KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud platformCareer development | Health and wellbeing benefits | Performance-based bonus | Training opportunitiesMid-level Full TimePune, Maharashtra, India R2d ago
-
Senior-level Full TimeIndia - Bangalore2d ago
-
Director- Software Engineering Lead INR 3584K-5000KAWS | Angular | Azure | Bias Testing | By DesignSenior-level Full TimeIndia - Bangalore2d ago
-
Director of Software Engineering – AI/ML INR 2400K-6000KArtificial Intelligence | Cloud Computing | Data Pipelines | Data labeling | DeploymentEmployee resource groups | Flexible work environment | Remote work optionExecutive-level Full TimeHyderabad, India3d ago
-
Associate Practice Manager - IT Development INR 1800K-3300KAPI Management | AWS | Agile | Algorithms | AuditabilityMid-level Full TimeHyderabad, Telangana, India3d ago
-
Director of Software Engineering - Big Data, Cloud INR 4000K-6000KAI machine learning | AWS | Agile | Audit Readiness | AutomationExecutive-level Full TimeMumbai, Maharashtra, India3d ago
-
Director, Software Engineering - Big Data Platform & Storage INR 3000K-4000KAWS | Airflow | Apache Hive | Apache Spark | AzureExecutive-level Full TimeIndia - Hyderabad3d ago
-
Senior Director of Engineering, Managed MySQL INR 2475K-3380KAutomated failover | Connection Routing | Database Management | Distributed Systems | High AvailabilityConference reimbursement | Employee assistance program | Employee meetups | Flexible time off | LinkedIn Learning accessSenior-level Full TimeBengaluru4d ago
-
Engineering Manager INR 5000K-8000KAgile | Application development | Automated testing | CI/CD | Cloud NativeMid-level Full TimeBengaluru, Karnataka, India6d ago
-
Amazon Web Services | Apache Spark | Azure Data | Azure Data Engineering | Code reviewExecutive-level Full TimeBengaluru Millenia, India6d ago
-
Cloud Native | Cloud Native Architecture | Distributed Storage | Distributed Systems | High AvailabilityCareer growth | Equity | Flexible time off | Health, dental, vision coverage | Learning and developmentSenior-level Full TimeIndia7d ago