Software Engineer, AI Inference Systems - New College Graduate 2026
US, CA, Santa Clara, United States
USD 108K-195K Entry-level Full Time
Tasks
- Architect scheduling for containerized inference deployments
- Build compiler and DSL infrastructure
- Conduct and publish ML systems research
- Contribute features to vLLM
- Contribute to MLPerf Inference benchmarks
- Define inference benchmarking methodologies
- Develop optimize and benchmark GPU kernels
- Orchestrate multi GPU multi node inference across clouds
- Profile and optimize inference framework
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | C++ | CI/CD | CUDA | CUDA graph | Cgroups | Cutlass | Docker | GCP | Go | Inductor | Infrastructure as Code | Kubernetes | LLVM | Linux | Linux Namespaces | MLIR | MLPerf | NCCL | Nsight Compute | Nsight Systems | PyTorch | Python | Rust | SGLang | Slurm | Tensor cores | TorchDynamo | Triton | VLLM | XLA | “as-code”
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
C++ | Constrained optimization | Controls theory | Differentiable physics | Dimensionality ReductionSenior-level Full TimeRedmond, WA1h ago
-
Software Engineer, AI/ML, Geo Data Protection USD 147K-211KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalMid-level Full TimeMountain View, CA, USA1h ago
-
Software Engineer, AI/ML, Google Ads USD 174K-252KC plus plus | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsMid-level Full TimeMountain View, CA, USA1h ago
-
Accelerator Virtualization | Artificial Intelligence | Container Orchestration | Container Runtime | Distributed SystemsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA1h ago
-
Senior Software Engineer, Compiler Optimization USD 174K-252KC# | C++ | Compiler optimization | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KC++ | Data Analysis | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1h ago
-
Application development | C++ | Data Analysis | Data Processing | Data Processing PipelinesMid-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Code review | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KAlgorithms | C++ | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA1h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeKirkland, WA, USA1h ago
-
Software Engineer, Computer Vision, Geo USD 147K-211KAlgorithms | C++ | Computer Vision | Data Structures | Image classificationMid-level Full TimeMountain View, CA, USA; Seattle, WA, …1h ago
-
Senior-level Full TimeBoston, MA7h ago
-
Senior-level Full TimeBelmont, CA, US, 9400212h ago
-
AWS S3 | Active IQ | Ansible | Azure Blob | Azure Blob Storage401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
AI Agents | AI Search | AWS | AWS Bedrock | Agentic Workflows401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
Senior Data & ML Engineer USD 151K-205KDBT | Data Governance | Data Observability | Data Quality | Data Security401k match | Dental insurance | Equity | Family planning resources | Flexible vacation policySenior-level Full TimeRemote - USA R12h ago
-
Senior Machine Learning Engineer USD 198K-287KArtificial Intelligence | Data Engineering | Fine Tuning | Foundation Models | GenAIOccasional travel for offsites | On-call rotation participation | Reasonable accommodation for applicantsSenior-level Full TimeRemote - US R13h ago
-
Staff Machine Learning Engineer USD 141K-210KCI/CD | Computer Vision | Deep learning | Distributed Training | DockerSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Senior Software Engineer, Data Platform USD 196K-245KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureEquity | Inclusion and reasonable accommodations | Relocation assistanceSenior-level Full TimeSan Francisco Bay Area14h ago
-
Senior AI Technologist USD 122K-180KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R14h ago
-
Senior AI Systems Engineer USD 122K-188KAlerting | Bash | CI/CD | CMMC | Cause analysisFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R14h ago
-
Senior Data Engineer USD 150K-220KClustering | Common table expressions | DBT | Dagster | Data LineageIn-office work 4 days per week | On-call rotationSenior-level Full TimeNew York, NY15h ago
-
Senior-level Full TimeNew York, NY15h ago
-
Data Engineer (Hybrid) USD 120K-140KAzure | DAX | Data Governance | Data Modeling | Data QualityHybrid workSenior-level Full TimeSanta Ana, CA, US15h ago
-
Staff AI Engineer USD 200K-240KAWS | Agentic Workflows | ClickHouse | Distributed Systems | DockerParental leave | Tuition reimbursement | Unlimited PTOSenior-level Full TimeHybrid (NYC Metro) R15h ago