AI Infra Engineer - Large Model Inference Systems (Multimodal/LLM/VLM)
San Jose, California, United States
USD 198K-387K (estimate) Mid-level Full Time
Tasks
- Build inference systems
- Develop high performance inference kernels
- Implement intelligent operations for inference platforms
- Improve throughput and latency
- Optimize distributed inference
Perks/Benefits
- N/A
Skills/Tech-stack
Attention Mechanisms | Batching | CUDA | DP | Distributed Systems | EP | Latency optimization | Load Balancing | Mixture of Experts | Multimodal fusion | TP | Throughput Optimization | Triton
Education
N/A
Roles
AI | AI Infrastructure Engineer | Engineer | Infrastructure Engineer
Related jobs
-
Senior-level Full TimeUS - Remote; Canada - Remote R5h ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States19h ago
-
Software Engineer - X Data USD 125K-400KApache Flink | Apache Kafka | Apache Spark | BigQuery | Cause analysis401k retirement plan | Dental insurance | Discounts | Health insurance | Life insuranceMid-level Full TimePalo Alto, CA1d ago
-
Site Reliability Engineer, Inference Infrastructure USD 165K-267KAmazon Web Services | C plus plus | Cloud platform | Distributed Systems | GPU401k matching | Co working Benefit | Company offsite | Education and learning stipend | Health and dental benefitsMid-level Full TimeToronto1d ago
-
Staff Software Engineer, Inference Infrastructure USD 160K-220KAmazon Web Services | Azure | C++ | Cloud platform | Distributed Systems401k | Annual company offsite | Arts and culture budget | Education and learning stipend | Health and dental benefitsSenior-level Full TimeSan Francisco1d ago
-
AI Software Engineer USD 80K-210KAWS Kinesis | Apache Airflow | Apache Kafka | C# | C++401k | Equity grant | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
ML Research Engineer - Hardware Codesign USD 185K-455KC++ | CUDA | Floating point | Floating point numerics | Functional simulationHybrid work schedule | Relocation assistanceSenior-level Full TimeSan Francisco1d ago
-
Staff AI engineer USD 170K-250KAI Evaluation | AWS | Agent Orchestration | Caching | Distributed SystemsFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
Senior Staff Software Engineer, Knowledge Catalog For AI USD 262K-365KBig Data | C++ | Computer Vision | Data Governance | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Asynchronous programming | BigQuery | C++ | Concurrency | Data ProcessingSenior-level Full TimeKirkland, WA, USA1d ago
-
Staff Software Engineer, Infrastructure, Google Cloud AI USD 207K-301KCompute Technologies | Data Structures | Data Structures and Algorithms | Distributed Systems | Network ArchitectureSenior-level Full TimeSunnyvale, CA, USA1d ago
-
AWS | Azure | CI/CD | Cloud Native | Distributed SystemsCareer development support | Flexible working models | Health and wellbeing benefits | Hybrid work | MentoringEntry-level InternshipSan Ramon, CA, US, 945 832d ago
-
API Design | Agent Optimization | Agent systems | Atomic operations | Caching401k plan | Calm app access | Disability insurance | In Home Office Setup Support | Internet stipendSenior-level Full TimeUnited States and Canada - Remote … R2d ago
-
Sr. Staff Production Engineer - Data Platform USD 228K-314KAWS | Automation | Change Management | Chaos Engineering | Cloud ComputingAnnual leave | Annual performance bonus | Comprehensive health benefits | EquitySenior-level Full TimeMountain View, California; San Francisco, California2d ago
-
Software Engineer, AIML Evaluation USD 138K-250KCapacity Planning | Distributed Systems | JavaScript | Load Balancing | NoSQLMid-level Full TimeCupertino2d ago
-
Cleared Palo Alto Networks SASE/SD-WAN Engineer USD 90K-205KApplication delivery | BGP | Citrix Virtual Apps | Citrix Virtual Apps and Desktops | CloudgenixFlexible work arrangements | Health benefits | Ongoing learning and development | Onsite work | Relocation Assistance PackageSenior-level Full TimeFort Meade, MD, US2d ago
-
Senior Applied AI Engineer USD 175K-210KAPIs | Agent Design | CI/CD | Code review | Cost OptimizationEquity grants | Health benefits | Paid time offSenior-level Full TimeBoston, MA, USA2d ago
-
AWS | Azure | CI/CD | Cloud Platforms | Cloud platformBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planSenior-level Full TimeJersey City, NJ, United States2d ago
-
Senior Software Engineer, Marketplace Optimization USD 166K-230KAPI Design | AWS | Cloud Native | Distributed Systems | Event Driven401k | Dental insurance | Disability insurance | Employee assistance program | Employee stock purchase planSenior-level Full TimeUnited States | Remote R2d ago
-
Senior-level Full TimeUnited States, California, Mountain View; United …2d ago
-
AWS | Airflow | Apache Beam | Apache Spark | Autoscaling401k match | Equity | Fertility benefits | Flexible PTO | Learning stipendSenior-level Full TimeSan Francisco, CA2d ago
-
AFDX | ARM DS | ARM DS IDE | ASIC | Assembly401k match | Certification assistance | Employer paid medical dental life disability coverage | Flexible work environment | Professional development supportSenior-level Full TimeEndicott, NY2d ago
-
Applied AI ML Lead, Chief Data & Analytics Office USD 177K-215KAWS | Azure | CI/CD | Cloud platform | Deep learningBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States2d ago
-
Senior Site Reliability Engineer - Azure Storage USD 119K-261KAutomation | Azure | Benchmarking | Cause analysis | Distributed SystemsSenior-level Full TimeUnited States; United States, Washington, Redmond2d ago
-
Staff Software Engineer, AI Developer Tooling USD 240K-320KAI Agents | API | CI/CD | Code review | Code review toolingEmployee benefit plans | Equity grants | Health insurance | Incentive compensation | Paid time offSenior-level Full TimeSan Francisco, California2d ago