Director, Engineering - Serverless Inference
Tasks
- Collaborate on GPU utilization and fault tolerance
- Define technical roadmap and architecture
- Design and optimize inference infrastructure
- Develop and maintain highly available inference APIs
- Ensure observability and reliability engineering practices
- Lead serverless inference platform development
- Manage incident response and operational readiness
- Partner cross functionally to deliver production systems
- Raise engineering bar through software design
- Recruit mentor and coach engineers
Perks/Benefits
- Employee assistance program
- Employee stock purchase program
- Flexible time off
- LinkedIn Learning access
- Local Employee Meetups
- Reimbursement for conferences
- Training reimbursement
Skills/Tech-stack
API Gateway | Capacity Planning | Cloud Native | Distributed Systems | Fault Tolerance | GPU Computing | Incident Management | Inference Server | Kubernetes | LLM serving | Microservices | Multi-region | Multi-region architectures | Observability | Operational automation | Reliability Engineering | Service Mesh | TensorRT-LLM | Triton Inference | Triton Inference Server | VLLM
Education
N/A
Related jobs
-
Senior Manager of Software Engineering - Data Engineer INR 4000K-6000KAPI Development | AWS | AWS Glue | AWS Lambda | Apache KafkaSenior-level Full TimeHyderabad, Telangana, India18h ago
-
Director, Software Engineering - Big Data Platform & Storage INR 4000K-5000KAWS | Airflow | Alerting | Apache Hive | Apache PhoenixExecutive-level Full TimeIndia - Hyderabad1d ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1300K-2200KApache Airflow | Apache Beam | Apache Flink | Best practices | BigQueryMid-level Full TimePune, Maharashtra, India R1d ago
-
Head of Engineering Applied AI INR 3000K-4000KAgentic SDLC | Architectural Principles | Artificial Intelligence | Automated testing | Cloud ArchitectureExecutive-level Full TimeHyderabad RDT, India2d ago
-
Software Engineering Manager, Enterprise Data Platform INR 3845K-5500KArtificial Intelligence | C# | C++ | Data Architecture | Data EngineeringSenior-level Full TimeHyderabad, Telangana, India2d ago
-
Engineering Manager – AI Platforms INR 3000K-5000KAWS Bedrock | AWS SageMaker | Agile | Azure AI | CI/CDCollaborative team environment | Global consulting experience | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India2d ago
-
Technical Program Manager INR 3584K-5000KAI Agents | APIs | AWS | Analytics | AzureProfessional growthSenior-level Full TimeBengaluru, Pune2d ago
-
Principal Software Engineering Manager-Azure Data INR 2400K-3000KAgent systems | Automation | C# | C++ | Cause analysisSenior-level Full TimeBengaluru, KA, IN2d ago
-
Data Engineer II INR 1000K-2000KAmazon S3 | Apache Kafka | Apache Spark | CDC | CI/CDAutonomy | Inclusive and diverse environment | Learning stipend | Mentorship | Remote environmentMid-level Full TimeIndia - Remote R3d ago
-
AD- Engineering INR 3715K-6000KAgile methodology | Architectural patterns | Automated testing | CI/CD | DevOpsSenior-level Full TimeBellandur, Karnataka, India3d ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Artificial Intelligence | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R3d ago
-
AWS | Amazon EKS | Backfills | CI/CD | Cloud NativeDiversity and inclusion culture | MentorshipExecutive-level Full TimeBengaluru, Karnataka, India3d ago
-
API | AWS | Access Control | Audit Logging | AzureGlobal workforce collaboration | Remote workExecutive-level Full TimeIndia-Contractors R4d ago
-
Senior-level Full TimeBengaluru, India4d ago
-
Generative AI / Associate Director, Software Engineering INR 1200K-2500KAccess Control | Active Directory | Agile | Alerts | AnsibleMid-level Full TimePune, Maharashtra, India R4d ago
-
Director Software Engineering, ITC INR 3000K-6000KAWS | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkExecutive-level Full TimeINDIA TECHNOLOGY CENTER, India5d ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE)7d ago
-
Director - Data Engineering INR 4000K-5199KAWS | Amazon Web Services | Cloud Computing | Cloud platform | ContainerizationBonuses for company approved content | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceExecutive-level Full TimeIndia - Remote R7d ago
-
Senior Manager I - Software Engineering INR 3000K-4800KAWS | Architectural patterns | Azure | Deep learning | DockerSenior-level Full TimeINDIA, Bangalore9d ago
-
Senior Engineering Manager INR 3700K-5876K.NET | AWS | AWS Lambda | Agile | AlgorithmsDEI initiatives | Reward and recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India9d ago
-
AI Evaluation | APIs | AWS | Agent Orchestration | Anomaly DetectionCharity matching | Corporate volunteering | Dental insurance | Employee discounts | Medical insuranceExecutive-level Full TimeBengaluru, KA, IN9d ago
-
Director of Software Engineering - Java & AWS INR 4000K-6000KAWS | Asynchronous programming | C4 model | CI/CD | CQRSExecutive-level Full TimeHyderabad, Telangana, India9d ago
-
Director - Data Engineering INR 4000K-6000KAWS CloudFormation | AWS Glue | AWS Lambda | AWS S3 | Amazon AthenaHybrid work | Professional development | Remote flexibilityExecutive-level Full TimeGurugram - DLF Building, India R10d ago
-
Director of Engineering INR 2100K-6000KAI Governance | AWS Fargate | Anomaly Detection | Apache Kafka | Cause analysisExecutive-level Full TimeBangalore, India10d ago
-
Senior-level Full TimeBengaluru, Karnataka, India10d ago