Senior AI Infra Engineer - Large Model Inference Systems (Multimodal/LLM/VLM)
San Jose, California, United States
USD 198K-368K (estimate) Senior-level Full Time
Tasks
- Build deployment pipelines for inference services
- Build inference systems for online traffic
- Develop high performance inference kernels
- Enable AI driven performance tuning and validation
- Ensure production reliability for inference at scale
- Implement global scheduling across heterogeneous compute
- Improve throughput and latency in production
- Optimize distributed inference for large models
- Support multimodal fusion and attention mechanisms
Perks/Benefits
- N/A
Skills/Tech-stack
Attention Mechanisms | Batching | CUDA | Data parallelism | Distributed Systems | Language Models | Large Language Models | Latency optimization | Load Balancing | Machine Learning | Mixture of Experts | Model Parallelism | Multimodal AI | Pipeline parallelism | Tensor Parallelism | Throughput Optimization | Triton
Education
N/A
Related jobs
-
Staff Full Stack Engineer USD 195K-315KAWS | DSP | FFmpeg | LLM | Machine Learning401k access | Company-sponsored fitness classes | Dental insurance | FSA | HSASenior-level Full TimeSan Francisco1d ago
-
Full Stack Engineer USD 165K-225KAWS | DSP | FFmpeg | LLM | Machine Learning401k access | Company sponsored classes | FSA and HSA Access | Health, dental and vision coverage | Meals and snacksEntry-level Full TimeSan Francisco1d ago
-
Software Engineer, Platform USD 165K-225KAWS | Asynchronous processing | CI/CD | Data Pipelines | Debugging401k access | Company-sponsored fitness classes | FSA and HSA Access | Health, dental and vision coverage | Meals providedEntry-level Full TimeSan Francisco1d ago
-
Staff Software Engineer, Platform USD 195K-315KAPI Design | AWS | Asynchronous processing | Backend Development | CI/CD401k | Dental insurance | FSA | Fitness classes | HSASenior-level Full TimeSan Francisco1d ago
-
Senior Machine Learning Research Engineer USD 210K-360KAPI Development | Audio Processing | Cloud Computing | Data Pipelines | Deep learning401k | Dental insurance | FSA | Gym classes | HSASenior-level Full TimeSan Francisco1d ago
-
Product Engineer USD 165K-225KAWS | DSP | FFmpeg | Full Stack | Full-Stack Development401k access | Company-sponsored fitness classes | Dental insurance | FSA | HSAEntry-level Full TimeSan Francisco1d ago
-
Data Scientist Associate USD 77K-80KAPIs | Access Control | Artificial Intelligence | Audit Logging | BenchmarkingOnsite work locationMid-level Full TimeUniversity1d ago
-
API | Airflow | Amazon Web Services | Apache Spark | AzureLearning and development | Mentorship | Travel opportunitiesEntry-level Full TimeAtlanta, Georgia, United States; Boston, Massachusetts, …1d ago
-
Cyber Data Scientist, Analytics and Insights USD 102K-171KCloud Computing | Data Modeling | Data Pipelines | Jira | Machine LearningMid-level Full TimeHuntsville, Alabama, United States1d ago
-
Head of AI Architecture USD 49KArtificial Intelligence | Cloud Computing | Deep learning | Docker | KubernetesSenior-level Full TimeMorrisville, North Carolina, États-Unis d’Amérique1d ago
-
Research Engineer, Computer Vision USD 147K-208KAR/VR | Algorithm Development | Artificial Intelligence | C++ | Computer VisionSenior-level Full TimeSunnyvale, CA1d ago
-
AI Research Scientist, Modeling & ToolCalling - MSL USD 150K-260KData Curation | LLM post training | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeMenlo Park, CA1d ago
-
Staff Software Engineer, AI Engines 3P TPU Inference USD 207K-300KData Processing | Debugging | Distributed Computing | Fine Tuning | GPUSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer, AI/ML, Google Search Ads USD 147K-210KAlgorithms | C++ | Code review | Data Processing | Data StorageMid-level Full TimeMountain View, CA, USA1d ago
-
Senior Staff Software Engineer, AI/ML, Google Ads USD 262K-364KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1d ago
-
Applied Machine Learning | C++ | Concurrency | Distributed Systems | GoSenior-level Full TimeSan Jose, CA, USA1d ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KComputer Vision | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Staff Software Engineer, Infrastructure, Google Cloud AI USD 207K-300KCompute | Data Storage | Deployment | Distributed Systems | InfrastructureSenior-level Full TimeSunnyvale, CA, USA1d ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | Data durabilitySenior-level Full TimeKirkland, WA, USA1d ago
-
Customer Engineer III, Applied AI, Google Cloud USD 174K-252KAgent tooling | Application Performance Tuning | Application performance | C++ | CI/CDSenior-level Full TimeMountain View, CA, USA; New York, …1d ago
-
AI Deployment Lead – Devin AI | Onsite USD 44K-154KAPI Design | Access Management | Agent Orchestration | Agentic Systems | CI/CD401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States1d ago
-
Senior Engineer, Big Data USD 134K-170KAmazon Web Services | Apache Spark | Automated testing | Azure | CI/CDSenior-level Full TimeUnited States1d ago
-
Data Management | Data Quality | Databases | Knowledge graphs | Machine LearningSenior-level Full TimeGarching bei München (Munich), DE, 857481d ago
-
Embedded Software Engineer, Perception (All Levels) USD 154K-212KARM | C++ | CSI-2 | CUDA | Device treeMid-level Full TimeLos Angeles, CA1d ago
-
AI Engineer II USD 60K-90KAPI Development | Backend Development | Cloud Computing | Databricks | DockerOnsite workMid-level Full TimeLocation Irving, Texas1d ago