Inference Engineer
Bengaluru, Karnataka, India
INR 2000K-3000K (estimate) Mid-level Full Time
Tasks
- Build optimize model serving pipelines
- Deploy automation and deployment workflows
- Deploy monitor and manage LLMs
- Design scalable LLM inference infrastructure
- Develop APIs and microservices
- Implement monitoring logging benchmarking profiling
- Improve inference latency throughput memory usage
- Optimize GPU resource allocation batching caching model parallelism
- Troubleshoot production model serving issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | Benchmarking | CUDA | Distributed Systems | Docker | GCP | Hugging Face | Hugging Face Transformers | Kubernetes | Language Models | Large Language Models | Logging | MLOps | Microservices | Model Quantization | Monitoring | Performance Profiling | PyTorch | Python | REST API | VLLM
Education
N/A
Related jobs
-
Senior-level Full TimeHyderabad, India1d ago
-
Staff Software Engineer, Looker, Cloud Data Analytics INR 2500K-4200KAI platforms | Artificial Intelligence | Data Storage | Distributed Computing | Enterprise SoftwareSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Senior ML Engineer INR 3000K-4000KAzure | Azure DevOps | Change Management | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform Unmind | Flexible working | Learning and development opportunitiesSenior-level Full TimeChennai, IN1d ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India1d ago
-
AI Model Training | AI model | Bash | Cloud platform | Data IngestionAsynchronous culture | Entrepreneurial team | Flexible management approach | Remote-friendlyMid-level Full TimeBangalore, India1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial team | Friendly work environment | Opportunity for large impactMid-level Full TimeNoida, India1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudEntrepreneurial team | Flexible, async culture | Mission driven product impact | Supportive hands off managementMid-level Full TimeMumbai, India1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial environment | Friendly laid-back atmosphere | Hands-off managementMid-level Full TimeAhmedabad, India1d ago
-
Senior-level Full TimeHyderabad India - Block B1d ago
-
Staff Database Platform Engineer INR 2500K-4200KAWS IAM | AWS RDS | Amazon EC2 | Amazon S3 | AnsibleSenior-level Full TimeIN - India - Bangalore1d ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R1d ago
-
Apache Beam | Apache Cassandra | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India1d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KAgent Orchestration | Agent systems | Agile methodology | Amazon Web Services | C++Employee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KAWS | Agent systems | Agile | Azure | C++Employee networks | Flexible work/life support | Paid volunteer daysSenior-level Full TimeHyderabad, India1d ago
-
Agentic AI Engineer - Assistant Manager INR 2000K-5000KAWS | Azure | C++ | CI/CD | DockerEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KA2A protocol | AWS | Agent Orchestration | Agent systems | Agile DevelopmentEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Agentic AI Engineer - Assistant Manager INR 2000K-5000KAWS | Azure | C++ | CI/CD | DockerEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India1d ago
-
Software Engineer – Java/Go | Distributed Systems | Microservices | Kafka | Cloud | 4–8 Years INR 2000K-3000K12-Factor | 12-Factor App | AI Coding Assistants | AI coding | Asynchronous systemsSenior-level Full TimeIND-BANGALORE, India1d ago
-
Software Engineer – Java/Go | Distributed Systems | Microservices | Kafka | Cloud | 4–8 Years INR 2000K-3000K12 Factor App Methodology | 12-Factor | 12-Factor App | Asynchronous processing | Data StructuresSenior-level Full TimeBangalore, India1d ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India2d ago
-
Senior Manager INR 2000K-5000KAWS | Agents SDK | Anthropic Claude | Anthropic Claude API | AuthenticationSenior-level Full TimeNoida, Uttar Pradesh, India2d ago
-
Mid-level Full TimeHaryana, India R2d ago
-
Storage 170374 INR 2000K-4000KAWS | Automation | Azure | Backup and Recovery | Brocade SAN24x7 operations participation | Cross-functional collaboration | Global team collaborationSenior-level Full TimeHyderabad, IND-TG, India2d ago
-
Associate - Analytics Solution INR 1000K-1500KAgile | Alteryx | Artificial Intelligence | Confluence | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India2d ago
-
AI Developer INR 346K-360KAWS | Agile | Amazon EventBridge | CI/CD | Cloud ComputingMedical benefits | Paid time off | Wellbeing benefits | Work-life balanceEntry-level Full TimeHyderabad, India2d ago