Senior System Software Engineer - LocalAI
Tasks
- Align technical requirements and priorities with cross functional teams
- Analyze results to identify gaps and drive fixes
- Build and optimize local AI inference stack
- Debug and tune system performance and accuracy trade offs
- Design and develop inference runtimes and execution stacks
- Develop infrastructure for performance and accuracy sweeps
- Establish engineering guidelines for bring up and production readiness
- Implement model optimization including quantization pruning sparsity distillation
- Optimize AI models data pipelines and inference runtimes
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | DXCGC | DirectX | Llama.cpp | PyTorch | TensorRT | TensorRT-RTX | VLLM | Vulkan | WinML
Education
Related jobs
-
Associate Engineer - AI/ML with Python INR 2800K-4000KAWS | Bitbucket | CSS | Celery | DjangoFlexible growth opportunities | In office 5 days per week | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Senior System Software Engineer - Local AI Automation INR 2500K-4800KC# | CI/CD | Docker | Git | GrafanaSenior-level Full TimeIndia, Pune22h ago
-
Senior System Software Engineer - Local AI INR 2500K-4800KC++ | CUDA | Deep learning | DirectX | Generative AISenior-level Full TimeIndia, Pune22h ago
-
Software Engineer (AI/ML) INR 500KAWS | Attention Mechanisms | Azure | Cloud platform | Domain AdaptationEmployee assistance program | Gratuity | Learning and development | Medical insurance | Paid time offMid-level Full TimeBengaluru, Onsite1d ago
-
Attention Mechanisms | CUDA | Compute Graphs | Data Flow | Distributed SystemsEngineering excellence culture | Equity participation | Ownership | Remote workSenior-level Full TimeIndia1d ago
-
Algorithm Development | Automated trading | C++ | Electronic Trading | Financial MathematicsMid-level Full TimeHyderabad, Telangana, India1d ago
-
Entry-level Full Timehosur road bangalore, India1d ago
-
Staff Software Engineer, Storage AI/ML INR 2000K-3500KAI machine learning | C++ | Cloud Computing | Data Storage | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India1d ago
-
[T] Senior Software Engineer, AI/ML, Google Cloud INR 3000K-5000KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeIndia1d ago
-
AI Engineer (Full stack) INR 2500K-4680KAPIs | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeEmployee engagement | Flexible dress code | Professional development | Team eventsEntry-level Full TimeThane, MH, India1d ago
-
Backpropagation | Bfloat16 | Checkpointing | Data parallelism | Deep learningCollaborative technical team | Equity opportunities | Fast feedback loops | High ownership | Opportunities for technical learningMid-level Full TimeIndia1d ago
-
Deep learning | Distributed Training | Experiment tracking | JAX | Kernel optimizationAsync-first culture | Equity opportunities | High ownership | Remote-friendlySenior-level Full TimeIndia1d ago
-
DE&A - AIML - Data Science - Conventional AI - Search INR 3242K-4500KAlgorithm Design | Computer Vision | Convex Optimization | CudaGraph | Deep learningEntry-level Full TimePune, Maharashtra, India1d ago
-
Core infrastructure engineer 2 INR 2500K-3814KAgentic Harness | Amazon Kinesis | Anomaly Detection | Apache Airflow | Cause analysisLife insurance | Medical insurance | Retirement options | Volunteer programsMid-level Full TimeBENGALURU, KARNATAKA, India1d ago
-
AI / ML Data Scientist (Across levels) INR 2520K-4580KAPI Development | AWS | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBangalore, India1d ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 3242K-4500KAWS | Agent systems | Apache Spark | Azure | DspyRemote workSenior-level Full TimeRemote - India R1d ago
-
Senior Machine learning Engineer INR 4000K-5500KAzure | Azure Blob | Azure Blob Storage | Azure ML | Blob StorageSenior-level Full Timebangalore, India1d ago
-
Senior AI Engineer INR 2500K-5000KAI Search | AWS SageMaker | Apache Airflow | Apache Kafka | Azure AICertification cost support | Dynamic career growth | Informal peer learning sessions | Innovation time | MentorshipSenior-level Full TimeHyderabad, TS, India1d ago
-
Software Engineer - AI/ML INR 3000K-4408KArangoDB | Causal AI | Computer Vision | Continuous Deployment | Continuous integrationMid-level Full TimeChennai1d ago
-
Senior-level Full TimeNew Delhi, India1d ago
-
Principal Machine Learning Engineer INR 5000K-6000KBenchmarking | Cost Optimization | Deep learning | Keras | Language ProcessingSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R1d ago
-
Gen AI/LLM Engineer | Python & GCP INR 2500K-5000KAPI Integration | Agile | BigQuery | CI/CD | Data GovernanceFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeChennai, India1d ago
-
Technical Lead I (Embedded + Linux) INR 1650K-3465KAnalog electronics | C# | C++ | Chip programmer | ConfluenceSenior-level Full TimeJohnson Controls India COEE11d ago
-
Senior-level Full TimeIND-Bangalore-TowerE,RMZ Infin, India1d ago