Cloud Machine Learning LLM Serving Staff engineer
Bangalore, Karnataka, India
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Analyze software requirements
- Apply software engineering best practices
- Build AI software tools and ecosystem
- Build deep learning framework extensions
- Build inference abstraction layers
- Collaborate with integration and test teams
- Identify system level issues
- Implement software solutions for SoCs
- Improve and optimize deep learning models
- Lead teams for system design and deliverables
- Optimize deep learning pipeline and graph compiler integration
- Optimize training and inference
- Optimize workloads for multi SoC and multi card
Perks/Benefits
- N/A
Skills/Tech-stack
C# | C++ | CUDA | CUDA toolkit | CUDNN | Deep learning | Executorch | Graph Compiler | Inductor | Java | Language Models | Language Processing | Large Language Models | ML Compiler | MLIR | MLIR Compiler | Machine Learning | Natural Language | Natural Language Processing | PyTorch | Python | TensorFlow | TorchDynamo | Triton | VLLM
Education
Related jobs
-
AI Data Engineer III INR 3000K-3880KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
AI/ML Engineer INR 2000K-2700KAgentic Systems | Apache Spark | Automated testing | Azure OpenAI | Database ConnectivityEntry-level Full TimeChennai, TN, IN4h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2400KAI Pipelines | APIs | Alerting | Data Lineage | Data ModelingSenior-level Full Timebangalore, India6h ago
-
ETL Migration Engineer - Data Integration - Lead Consultant INR 1650K-2600KAPI | AWS | AWS Glue | Amazon EKS | Apache AirflowSenior-level Full TimeChennai, IN, 6000326h ago
-
Data Engineer INR 3000K-3500KAlerting | Amazon Redshift | Apache Spark | Argo Workflows | AzureAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon7h ago
-
IT Analyst INR 950K-1250KAzure | Azure ML | Azure OpenAI | Cognitive Services | EmbeddingsContinuing education program | Continuous learning | Family-friendly perks | Flexible time off | Health care coverageMid-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …11h ago
-
Senior Data Engineer INR 3000K-4000KAzure Databricks | Data Governance | Data Modeling | Data Monitoring | Data QualitySenior-level Full TimeHyderabad, TG, IN11h ago
-
IN_Manager_Data Engineer_D&A_Advisory_Mumbai INR 3000K-4000KAlerting | Azure | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeMumbai Shivaji Park, India11h ago
-
Information Security Automation Engineer INR 1000K-1500KAI Programming | API | AWS | Agile | AuditabilityMid-level Full TimeGurgaon, HR, IN, 12200211h ago
-
POD Engineers (Int) INR 933K-1000KADLS | AWS | AWS Database | AWS Database Migration Service | AWS database migrationTravel opportunityMid-level Full TimeTBD, AN, IN11h ago
-
Technical Program Manager - AI INR 3000K-4000KArtificial Intelligence | Data Quality | Data quality assessment | Evaluation metrics | Feature SelectionCareer growth opportunities | Flexible and inclusive working environment | Learning programs | Social coverage life medical pension | Supportive colleaguesSenior-level Full TimeBangalore, KA, IN11h ago
-
Senior Data Engineer for After-Sales Vehicle Documentation INR 2000K-3200KAWS | Apache Spark | BI | Data Quality | Data quality monitoringAccessibility accommodations | Cafeteria | Childcare | Coaching | Employee eventsSenior-level Full TimeBangalore, IN11h ago
-
Cloud Computing | Computer Vision | Data Pipelines | Data Quality | Data Quality EvaluationAccidental insurance | Hybrid work options | Life insurance | Medical insurance | Paid parental leaveSenior-level Full TimeBangalore, India (Hybrid) R18h ago
-
Senior Machine Learning Engineer - AI-Assisted Data Annotation INR 2400K-3500KConfidence scoring | Few-Shot Learning | Few-shot | Fine Tuning | Human-in-the-loopAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R18h ago
-
Benchmarking | Deep learning | Distributed Training | Efficient Deep Learning | Experiment trackingAccidental insurance | Flexible hours | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeBangalore, India (Hybrid) R18h ago
-
Staff Engineer – Data/AI Platform Engineering INR 3000K-5000KAzure | Batch Processing | Data Catalog | Data Governance | Data IngestionAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R18h ago
-
Cloud Platforms | Computer Vision | Data Quality | Fine Tuning | Language ModelsAccidental insurance | Flexible hours | Hybrid work options | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R18h ago
-
API | AWS | Airflow | CSV | CronFlexible work arrangements | Health and wellness benefits | Hybrid work arrangement | Inclusive work culture | Learning and development opportunitiesMid-level Full TimeIndia21h ago
-
Consultant - Data Warehouse -238 INR 2520K-4000KBusiness Intelligence | Cloud Platforms | Data Governance | Data Modeling | Data VisualizationEmployee engagement initiatives | Training and mentorshipMid-level Full TimeBengaluru, Karnataka22h ago
-
C++ | Knowledge Distillation | Language Models | Large Language Models | Low-bit quantizationFully remote | Publication opportunity | Research freedomSenior-level Full TimeIndia R23h ago
-
Python Robot QA INR 1524K-2541KAgile | Azure DevOps | Backup and Recovery | Case management | Continuous integrationHybrid workSenior-level Full TimeIN-AP-Hyderabad23h ago
-
Senior-level Full TimeIN-KA-Bangalore23h ago
-
Agentic AI Engineer INR 1000K-1500KAPIs | Agentic AI | Automation | Automation Anywhere | Cloud ComputingEnhanced medical benefits | Family well-being benefits | Paid time off | Wellbeing benefits | Work-life balance benefitsMid-level Full TimeHyderabad, India23h ago
-
Senior-level Full Timebengaluru, India23h ago
-
ML and GenAI INR 1000K-1000KAPIs | Algorithms | Data Structures | Event Driven | Event-driven architectureMid-level Full TimeGurgaon, Haryana, India23h ago