Senior AI Infra Engineer - Large Model Inference Systems (Multimodal/LLM/VLM)
San Jose, California, United States
USD 198K-368K (estimate) Senior-level Full Time
Tasks
- Build deployment pipelines for inference services
- Build inference systems for online traffic
- Develop high performance inference kernels
- Enable AI driven performance tuning and validation
- Ensure production reliability for inference at scale
- Implement global scheduling across heterogeneous compute
- Improve throughput and latency in production
- Optimize distributed inference for large models
- Support multimodal fusion and attention mechanisms
Perks/Benefits
- N/A
Skills/Tech-stack
Attention Mechanisms | Batching | CUDA | Data parallelism | Distributed Systems | Language Models | Large Language Models | Latency optimization | Load Balancing | Machine Learning | Mixture of Experts | Model Parallelism | Multimodal AI | Pipeline parallelism | Tensor Parallelism | Throughput Optimization | Triton
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17d ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R9h ago
-
Head of AI USD 244K-282KAI Governance | AWS | Agentic architecture | Anomaly Detection | Bias MitigationComprehensive benefits | Flexible schedule | Remote work | Retirement plan match | Unlimited PTOExecutive-level Full TimeUnited States R16h ago
-
Perception Engineer III USD 155K-185KArduPilot | C++ | CUDA | Coordinate frames | DDS401k company match | Annual Company Holidays | Life insurance | Medical, dental & vision coverage | Paid time offSenior-level Full TimeUnited States16h ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States23h ago
-
Senior Staff Generative AI Scientist USD 185K-210KAWS | Apache Spark | Artificial Intelligence | Azure | Cloud platform401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Machine Learning Engineer USD 117K-177KAWS | Azure | Cloud Computing | Data Visualization | Google CloudMid-level Full TimeSt. Louis, Missouri, United States1d ago
-
Software Engineer - X Data USD 125K-400KApache Flink | Apache Kafka | Apache Spark | BigQuery | Cause analysis401k retirement plan | Dental insurance | Discounts | Health insurance | Life insuranceMid-level Full TimePalo Alto, CA1d ago
-
Site Reliability Engineer, Inference Infrastructure USD 165K-267KAmazon Web Services | C plus plus | Cloud platform | Distributed Systems | GPU401k matching | Co working Benefit | Company offsite | Education and learning stipend | Health and dental benefitsMid-level Full TimeToronto1d ago
-
Staff Software Engineer, Inference Infrastructure USD 160K-220KAmazon Web Services | Azure | C++ | Cloud platform | Distributed Systems401k | Annual company offsite | Arts and culture budget | Education and learning stipend | Health and dental benefitsSenior-level Full TimeSan Francisco1d ago
-
AI Engineer – Routing & Network Optimization USD 80K-210KA Star | A Star Algorithm | AMPL | Bellman Ford Algorithm | CPLEX401k | Equity grant | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
AI Software Engineer USD 80K-210KAWS Kinesis | Apache Airflow | Apache Kafka | C# | C++401k | Equity grant | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
Applied AI Engineer USD 204K-352KBackend Development | Cloud infrastructure | Deep learning | Docker | Fine TuningAnnual membership | Centralized coffee stipend | Flexible PTO | Health and wellness stipend | Health, dental, and vision insuranceSenior-level Full TimeNew York, NY (HQ)1d ago
-
Senior Applied Scientist - Search USD 200K-200KData Science | Embedding | Fine Tuning | Hybrid search | Information Retrieval401k retirement | Annual leave | Equity package | Health coverage | Hybrid scheduleSenior-level Full TimeNew York City R1d ago
-
ML Research Engineer - Hardware Codesign USD 185K-455KC++ | CUDA | Floating point | Floating point numerics | Functional simulationHybrid work schedule | Relocation assistanceSenior-level Full TimeSan Francisco1d ago
-
Senior Quantum Applications Engineer - QEC USD 120K-258KCUDA-Q | Decoder algorithms | Docker | End to End | End-to-End TestingSenior-level Full TimeNew Haven, CT1d ago
-
Staff AI engineer USD 170K-250KAI Evaluation | AWS | Agent Orchestration | Caching | Distributed SystemsFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
C++ | Deep learning | Imitation Learning | Machine Learning | PlanningHealth insurance | Life insurance | Long-term care insurance | Long-term disability insurance | Paid time offSenior-level Full TimeFoster City, CA1d ago
-
Senior AI Engineer USD 125K-145KAPI Management | AWS | Azure | Azure DevOps | C#401k plan | Career advancement | Dental insurance | Dependent care | Flexible spending accountSenior-level Full TimeCleveland, OH, United States1d ago
-
Apple Neural Engine | C++ | Computer Vision | CoreFoundation | CoreMLMid-level Full TimeSunnyvale1d ago
-
Software Engineer, Machine Learning RecSys USD 147K-208KArtificial Intelligence | BERT | Bias Mitigation | C# | C++Mid-level Full TimeSunnyvale, CA | Bellevue, WA | …2d ago
-
C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learningSenior-level Full TimeBurlingame, CA2d ago
-
Software Engineer Leadership, Machine Learning RecSys USD 170K-244KAgent Orchestration | Artificial Intelligence | BERT | Bias Mitigation | C#Senior-level Full TimeSunnyvale, CA2d ago
-
Senior Staff Software Engineer, Knowledge Catalog For AI USD 262K-365KBig Data | C++ | Computer Vision | Data Governance | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA2d ago
-
Asynchronous programming | BigQuery | C++ | Concurrency | Data ProcessingSenior-level Full TimeKirkland, WA, USA2d ago