Software Engineer II - Serverless Inference
Tasks
- Build scalable multi tenant APIs
- Contribute to architecture for traffic management and orchestration
- Debug performance scalability and reliability
- Design serverless inference services
- Develop distributed systems for reliability
- Improve observability and operational tooling
- Manage capacity and automation
- Participate in on-call rotations
- Partner to deliver production grade systems
- Perform incident management and reduce recurring incidents
Perks/Benefits
Skills/Tech-stack
API Gateway | Automation | Capacity Planning | Distributed Systems | Fault Tolerance | GPU Utilization | Go | Incident Management | Kubernetes | LLM serving | Microservices | Observability | Rate Limiting | Reliability Engineering | Service Mesh | Service orchestration | Traffic Routing
Education
N/A
Roles
Related jobs
-
Senior AI Engineer INR 2475K-4000KAgile | Amazon Web Services | CI/CD | CSS | ConfluenceHome office setup reimbursement | Mental wellness support | Ongoing learning & development | Paid time off | Recharge daysSenior-level Full TimeChennai or Remote, India R4h ago
-
DevOps INR 2000K-4000KAWS | Azure | CI/CD | CloudFormation | DatadogCoworking stipend | Equity | Flexible savings accounts | Flexible work location | Health coverageMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Scala Data Engineer - VOIS INR 800K-800KApache Spark | Big Data | Cassandra | Cloud Composer | Cloud StorageMid-level Full TimePune, IN11h ago
-
Senior Python GenAI Developer – AWS Bedrock & AI Platforms INR 2000K-5000KAWS Bedrock | Amazon Web Services | CI/CD | DevOps | DockerSenior-level Full TimePune, Gera Commerzone SEZ, India11h ago
-
Senior-level Full TimePune, Gera Commerzone SEZ, India11h ago
-
Senior Staff AI Engineer INR 2500K-5000KAWS | Agents | Azure | Code Quality | Code Quality AutomationRelocation assistanceSenior-level Full TimeBengaluru, India14h ago
-
Senior Software Engineer I - AI Inference Data Plane INR 3584K-4400KContinuous batching | Data parallelism | Databases | Distributed Systems | GPU OptimizationConference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time offSenior-level Full TimeBengaluru17h ago
-
Senior-level Full Timebangalore, India18h ago
-
Senior-level Full TimeHyderabad, India21h ago
-
Associate Lead Data Scientist INR 1800K-2500KAPI Design | AWS SageMaker | Airflow | Azure Machine Learning | CaptumMid-level Full TimeHyderabad, Andhra Pradesh, India22h ago
-
Senior-level Full TimeIN-HR-Gurgaon22h ago
-
Mid-level Full TimeBengaluru, Karnataka22h ago
-
Mid-level Full TimeBengaluru, Karnataka22h ago
-
AWS | Application development | Artificial Intelligence | Cloud Architecture | Cloud platformMentorship | Professional growth opportunities | Remote-first work environment | Work-life balanceSenior-level Full TimeIndia23h ago
-
Senior Software Engineer I - Serverless Inference INR 2475K-3500KAPI Gateway | Capacity Planning | Distributed Systems | Go | Incident ManagementConference reimbursement | Employee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning accessSenior-level Full TimeBengaluru1d ago
-
Senior-level Full TimeBangalore, Karnataka, India1d ago
-
Staff Software Engineer - AI INR 3584K-5000KAPI Development | Airflow | Cloud Architecture | Compliance | DBTCasual leave | Diversity and inclusion programs | Employee referral bonuses | Employee stock units | Health insuranceSenior-level Full TimeHyderabad1d ago
-
Mid-level Full TimeBengaluru, Karnataka, India1d ago
-
Scientist 4, Data Science INR 3700K-5000KAWS | Azure | Causal Inference | Deep learning | Distributed ComputingSenior-level Full TimeBengaluru, KA, India1d ago
-
Senior Software Engineer - Full Stack & GenAI INR 3264K-5876KAWS | Amazon RDS | Amazon S3 | Angular | AuthenticationHybrid workSenior-level Full TimeBengaluru, KA, India1d ago
-
AI/ML Engineer INR 3700K-5000KCI/CD | Embeddings | Fine Tuning | GCP | GitCustomer engagement opportunities | Professional growth opportunitiesSenior-level Full TimeBengaluru,KA1d ago
-
Principal Platform Engineer-Databricks INR 3000K-4000KAWS | Automation | Azure | CI/CD | ComplianceCareer growth | Engineering culture focused on innovation | Global collaboration | Mission-driven workSenior-level Full TimeBangalore, Karnataka, IN1d ago
-
AI Analyst INR 180K-180KAI Foundry | Agent architecture | Autogen | Azure AI | Azure AI FoundryEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Paid parental leaveEntry-level Full TimeCHANDIGARH, CHANDIGARH, India1d ago
-
Senior Associate — Data Scientist, Applied AI/ML INR 1400K-2800KAWS | Agentic Workflows | Alerting | Azure | CI/CDMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Scientist- Air Quality INR 1400K-1800KAirflow | Ansible | Apache Spark | CI/CD | Code reviewHealth and safety support | Hybrid work model | Mentoring | Professional developmentMid-level Full TimeNoida, Uttar Pradesh, India1d ago