AI Infra Engineer - Large Model Inference Systems (Multimodal/LLM/VLM)
San Jose, California, United States
USD 198K-387K (estimate) Mid-level Full Time
Tasks
- Build inference systems
- Develop high performance inference kernels
- Implement intelligent operations for inference platforms
- Improve throughput and latency
- Optimize distributed inference
Perks/Benefits
- N/A
Skills/Tech-stack
Attention Mechanisms | Batching | CUDA | DP | Distributed Systems | EP | Latency optimization | Load Balancing | Mixture of Experts | Multimodal fusion | TP | Throughput Optimization | Triton
Education
N/A
Roles
AI | AI Infrastructure Engineer | Engineer | Infrastructure Engineer
Related jobs
-
Software Engineer, Platform USD 165K-225KAWS | Asynchronous processing | CI/CD | Data Pipelines | Debugging401k access | Company-sponsored fitness classes | FSA and HSA Access | Health, dental and vision coverage | Meals providedEntry-level Full TimeSan Francisco1d ago
-
Staff Software Engineer, Platform USD 195K-315KAPI Design | AWS | Asynchronous processing | Backend Development | CI/CD401k | Dental insurance | FSA | Fitness classes | HSASenior-level Full TimeSan Francisco1d ago
-
Research Engineer, Computer Vision USD 147K-208KAR/VR | Algorithm Development | Artificial Intelligence | C++ | Computer VisionSenior-level Full TimeSunnyvale, CA1d ago
-
Applied Machine Learning | C++ | Concurrency | Distributed Systems | GoSenior-level Full TimeSan Jose, CA, USA1d ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KComputer Vision | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Staff Software Engineer, Infrastructure, Google Cloud AI USD 207K-300KCompute | Data Storage | Deployment | Distributed Systems | InfrastructureSenior-level Full TimeSunnyvale, CA, USA1d ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | Data durabilitySenior-level Full TimeKirkland, WA, USA1d ago
-
AI Deployment Lead – Devin AI | Onsite USD 44K-154KAPI Design | Access Management | Agent Orchestration | Agentic Systems | CI/CD401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States1d ago
-
Senior Engineer, Big Data USD 134K-170KAmazon Web Services | Apache Spark | Automated testing | Azure | CI/CDSenior-level Full TimeUnited States1d ago
-
Embedded Software Engineer, Perception (All Levels) USD 154K-212KARM | C++ | CSI-2 | CUDA | Device treeMid-level Full TimeLos Angeles, CA1d ago
-
Staff Software Engineer - Streaming USD 182K-247KApache Spark | Data Storage | Database systems | Distributed Systems | Latency optimizationSenior-level Full TimeSeattle, Washington1d ago
-
Software Engineer, API Multimodal USD 293K-385KConcurrency | Distributed Systems | Go | Latency | ObservabilitySenior-level Full TimeSan Francisco1d ago
-
Senior AI Engineer - Services Special Projects USD 150K-260KAdversarial evaluation | Airflow | CI/CD | Cloud Platforms | Content ModerationSenior-level Full TimeSan Francisco Bay Area1d ago
-
Computer Vision Engineer USD 140K-260KC++ | CUDA | Cloud processing | Computer Vision | Deep learningSenior-level Full TimeSan Jose, California, United States1d ago
-
AI Engineer USD 180K-200KAgent Orchestration | Data Pipelines | Distributed Systems | LLM | Machine Learning401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …1d ago
-
Machine Learning Engineer I, Network USD 151K-189KClassification | Data Pipelines | Deep learning | Experiment tracking | Feature Engineering401k match | Commuting support | Flexible PTO | Free lunch | Gym accessSenior-level Full TimeSan Francisco, CA1d ago
-
Principal AI Engineer USD 185K-265KAPI Integration | Agent systems | Artificial Intelligence | Cloud Native | Cloud-native ArchitecturesEducation reimbursement | Health plans | Paid time off | Parental leave | Remote workSenior-level Full TimeRemote - USA R1d ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer USD 102K-209KAnalytics Cloud | Analytics Platforms | Apache Airflow | Apache Kafka | Apache Spark401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeNashville, TN, United States1d ago
-
Autonomy | C++ | DDS | Data Ingestion | Edge Computing401k | Healthcare coverage | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R1d ago
-
A/B | A/B Testing | API Development | AWS Bedrock | Access Control401k plan | Healthcare premium coverage | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | CPU GPU | CPU GPU Debugging | DDS401k | Healthcare | Paid Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Staff Data Engineer USD 190K-250KAWS | Agent systems | Airflow | Alation | Amazon KinesisDental insurance | Flexible working hours | Health insurance | Hybrid options | Learning resourcesSenior-level Full TimeDallas, TX, United States2d ago
-
Staff Software Engineer USD 190K-250KAPI Design | AWS | Autogen | Azure | C#Dental insurance | Flexible working hours | Growth and learning resources | Health insurance | Hybrid optionsSenior-level Full TimeChicago, IL, United States2d ago
-
Staff Software Engineer USD 190K-250KAWS | Autogen | Azure | C# | CI/CDDental insurance | Flexible working hours | Health insurance | Hybrid options | Learning resourcesSenior-level Full TimeChicago, IL, United States2d ago