Engineering Manager, Inference Benchmarking — AI Perf
US, CA, Santa Clara, United States
USD 224K-356K Senior-level Full Time
Tasks
- Advise upstream engine integrations
- Drive technical roadmap for AIPerf core infrastructure
- Hire mentor and grow engineering team in open source environment
- Maintain AIPerf relevance across hardware and inference configurations
- Own accuracy and statistical soundness of benchmark results
Perks/Benefits
- N/A
Skills/Tech-stack
DCGM | Distributed Systems | GPU Telemetry | GPU observability | Helm | ITL | KV cache | Kubernetes | Kubernetes Operators | LLM Inference | Load generation | Microservices | Open Source | Open source communities | Prefill Decode | Prometheus | PyNVML | SGLang | Speculative decoding | Statistical Analysis | Systems engineering | TTFT | TensorRT-LLM | VLLM | ZMQ
Education
Regions
Countries
States
Cities
Related jobs
-
Director, Back-End Engineering (Fulfillment Tech) USD 170K-319KAlgorithms | CI/CD | Code review | Data Structures | Distributed ComputingExecutive-level Full TimeSeattle, USA1d ago
-
Sr. Manager, Engineering Configuration Platform Team USD 222K-300KAWS | Auto rollback | Azure | Configuration Management | Distributed SystemsSenior-level Full TimeBellevue, Washington1d ago
-
Director, Data & AI/ML Platform Engineering USD 213K-284KAWS | Agent architecture | Apache Airflow | Apache Iceberg | Delta LakeExecutive-level Full TimeRemote, USA R1d ago
-
Senior Manager, Data Science - Styling Algorithms) USD 200K-246KA/B | A/B Testing | Agentic AI | Artificial Intelligence | B testingAnnual bonus | Dental insurance | Equity grants | Medical insurance | Restricted stock unitsSenior-level Full TimeRemote USA R1d ago
-
Program Manager l, Supply Chain Analytics, Google Cloud USD 108K-153KAcceptance Testing | Analytics | Chain management | Dashboarding | Data interchangeCross-functional collaboration | Travel 20 percent timeMid-level Full TimeAtlanta, GA, USA; Wisconsin, USA2d ago
-
Technical Program Manager, NPI, AI/ML (GPU) Systems USD 192K-278KCloud infrastructure | Consensus building | Cross-Functional Collaboration | Cross-functional | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA2d ago
-
VP, Engineering USD 185K-210KAWS | Apache Airflow | Azure | Cloud Computing | Data GovernanceHybrid work option | Remote workExecutive-level Full TimeUnited States R2d ago
-
Software Engineering Manager USD 180K-220KAPI Development | C plus plus | CUDA | Cirq | Cloud Integration401K company matching | Dental insurance | Dependent care benefits | FSA | Life insuranceMid-level Full TimeBoulder, CO2d ago
-
Delivery Lead USD 90K-130KData Operations | Data Quality | Data labeling | Distributed Systems | JavaScriptSenior-level Full TimeColumbus, Ohio2d ago
-
Fraud Analytics Group Manager, SVP USD 153K-230KCross-Functional Collaboration | Cross-functional | Data Analysis | Decisioning | Defect Analysis401k retirement plan | Accident insurance | Dental insurance | Disability insurance | Health insuranceExecutive-level Full Time14000 CITI CARDS WAY BUILDING B …2d ago
-
Capacity Operations and Analytics Manager USD 168K-270KAWS | Artificial Intelligence | Azure | Capacity Management | Cloud ArchitectureMid-level Full TimeUS, CA, Santa Clara, United States2d ago
-
Enterprise GenAI and DevOps Technical Lead USD 176K-296KAPIs | AWS | Azure | CI/CD | Docker401k | Medical/Dental/Vision insurance | Paid time offExecutive-level Full TimeFlorham Park, NJ, United States2d ago
-
Enterprise GenAI and DevOps Technical Lead USD 176K-296KAPI | AWS | Azure | CD pipeline | CI/CD401k long term incentive program | Dental insurance | Health insurance | Paid time off | Vision insuranceExecutive-level Full TimeNorth Chicago, IL, United States2d ago
-
Senior Manager, Data Science USD 200K-246KA/B | A/B Testing | B testing | Cloud Computing | Deep learningSenior-level Full TimeRemote USA R2d ago
-
Technical Product Manager, AI Storage USD 170K-240KBeeGFS | Block Storage | DAOS | Data Protection | Dynamic provisioningConference attendance | Professional development | Remote work | Training opportunities | Workstation providedMid-level Full TimeAustin, TX, United States2d ago
-
Product Manager - AI Inference & Model Serving USD 165K-275KAI Inference | Artificial Intelligence | Autoscaling | Cache Management | Continuous batchingConference attendance | Professional development | Stock options | Training | Workstation providedMid-level Full TimeAustin, TX, United States3d ago
-
Technical Product Manager, AI Storage USD 170K-235KBacklog Management | BeeGFS | CSI | DAOS | Data ProtectionCompetitive benefits plan | Conference attendance | Customized workstation | Professional development and training | Remote workMid-level Full TimeAustin, TX, United States3d ago
-
Technical Program Manager, FAIR (AI Research) USD 183K-271KBias Mitigation | Compute Infrastructure | Data Engineering | Data Management | Data QualitySenior-level Full TimeNew York, NY3d ago
-
Technical Lead, YouTube Ads Data Infrastructure USD 207K-300KC++ | Compute Infrastructure | Data Infrastructure | Data Storage | Data analyticsSenior-level Full TimeKirkland, WA, USA3d ago
-
Senior Product Data Scientist Manager, Android USD 240K-334KClassification | Data Visualization | Machine Learning | Personalization | PythonSenior-level Full TimeSan Jose, CA, USA; Kirkland, WA, …3d ago
-
Senior Director, AI Engineering and Delivery USD 190K-380KAPI first | AWS | Access Control | Azure | CI/CDSenior-level Full TimeUnited States - Abbott Park : …3d ago
-
Manager, Business Analytics USD 66K-145KBusiness Intelligence | Data Modeling | Data Quality | Data integration | Delivery systemsDental insurance | Medical insurance | Paid time off | Retirement savings options | Vision insuranceMid-level Full TimeWork At Home-California, United States3d ago
-
3D Modeling | Agile | Artificial Intelligence | Data Ingestion | Data ProcessingFinancial benefits | Health benefits | Hybrid work environment | Time off | Wellness programsSenior-level Full TimeAMER - United States - Georgia …3d ago
-
VP, Global Data & Analytics USD 200K-275KArtificial Intelligence | Business Intelligence | Dashboarding | Data Engineering | Data GovernanceExecutive-level Full TimeGlobal Resource Center, United States3d ago
-
Sr Director, AI Engineering USD 286K-392KAI Governance | AWS | Artificial Intelligence | Azure | C#Senior-level Full TimeSan Francisco, CA, United States3d ago