Engineering Manager, Inference Benchmarking — AI Perf
US, CA, Santa Clara, United States
USD 224K-356K Senior-level Full Time
Tasks
- Advise upstream engine integrations
- Drive technical roadmap for AIPerf core infrastructure
- Hire mentor and grow engineering team in open source environment
- Maintain AIPerf relevance across hardware and inference configurations
- Own accuracy and statistical soundness of benchmark results
Perks/Benefits
- N/A
Skills/Tech-stack
DCGM | Distributed Systems | GPU Telemetry | GPU observability | Helm | ITL | KV cache | Kubernetes | Kubernetes Operators | LLM Inference | Load generation | Microservices | Open Source | Open source communities | Prefill Decode | Prometheus | PyNVML | SGLang | Speculative decoding | Statistical Analysis | Systems engineering | TTFT | TensorRT-LLM | VLLM | ZMQ
Education
Regions
Countries
States
Cities
Related jobs
-
Engineering Manager - Embedded DevSecOps Enablement USD 138K-207KAI-powered development | AI-powered development tools | AWS | Automated testing | CI/CDAdoption Assistance | Charitable contribution match | Discount programs | Employee assistance programs | Employee purchase planSenior-level Full TimeUrbandale,Iowa,United States19h ago
-
Senior Director, Inference Products and Optimizations USD 274K-343KAI workload | AI workload orchestration | AMD GPU | CUDA | Container RuntimeConference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensationSenior-level Full TimeSeattle20h ago
-
Senior Director, Inference Products and Optimizations USD 274K-343KAI workload | AI workload orchestration | AMD | Benchmarking | Call ManagementEmployee assistance program | Flexible time off | LinkedIn LearningSenior-level Full TimeSan Francisco R20h ago
-
Director, Engineering - Cloud Observability USD 296K-370KAI-powered Tooling | AWS | Azure | Cloud Computing | Cloud Economics401k match | Career pathing | Community guilds | Continuous professional development | Dental benefitsExecutive-level Full TimeBoston, Massachusetts, USA; New York, New …20h ago
-
API Integration | Agile | Artificial Intelligence | Automated testing | CI/CDMid-level Full TimeCupertino1d ago
-
Data Science Manager, Kids and Families, Core USD 207K-301KBy Design | Classification | Data Modeling | Data Quality | Data reproducibilitySenior-level Full TimeSan Jose, CA, USA; San Francisco, …1d ago
-
Manager, Business Reporting & Analytics USD 118K-178KAnalytics | Business Intelligence | Data Storytelling | Data Visualization | Data integrationDental insurance | Health insurance | Paid time off | Retirement benefits | Sick leaveSenior-level Full TimeWhippany, New Jersey, US1d ago
-
Senior Machine Learning Engineering Manager USD 295K-345KCloud services | Computer Vision | Data Pipelines | Data Quality | Distributed SystemsEquity compensation | Health benefitsSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Tech Lead, Applied AI USD 230K-270KAPIs | Agent architecture | Applied AI | Backend architecture | Data Modeling401k Fees Coverage | Commuter benefits | HSA contributions | Health coverage | Life and disability insuranceSenior-level Full TimeSan Francisco1d ago
-
Head of AI and Data Platform USD 172K-344KA/B | A/B Testing | AWS | Artificial Intelligence | Automated retrainingEducation benefit | Free medical coverage | Retirement savings plan | Student debt program | Tuition reimbursementExecutive-level Full TimeUnited States - Alameda : 2901 …1d ago
-
Technical Lead/Databricks/Senior Java/Angular Developer USD 136K-184KAWS | Agile | Angular | Bash | CI/CD401k match | Comprehensive health and wellness packages | Dental plan | Paid education and certifications | Paid leave optionsSenior-level Full TimeUSA FL Home Office (FLHOME), United … R1d ago
-
Service Delivery Center, AI Developer - Manager USD 76K-197KAI Search | API Design | AWS Bedrock | Arize | Artificial IntelligenceMid-level Full TimeTampa, FL, US, 33602 R1d ago
-
Data Analyst - Tech Cons-Data-Analytics-Data Arch-Eng-FSO - Manager - Multiple Positions - 1726163 USD 158KAWS | Apache Kafka | Apache Spark | Apache Spark Streaming | Apache Storm401k plan | Continuous learning | Dental coverage | Flexible vacation policy | Hybrid work modelMid-level Full TimeSan Antonio, TX, US, 78205 R1d ago
-
Manager, Data Analytics USD 124K-174KA/B | A/B Testing | AI modeling | Attribution | B testing401k | Child care and family care discounts | Commuter benefits | Employee stock purchase plan | Fertility and adoption supportMid-level Full TimeNew York, New York1d ago
-
Anomaly Detection | DAX | DAX Query | Dashboard governance | Data ModelingMid-level Full TimeMarietta, GA, 30067, US1d ago
-
Customer Success | Data Engineering | Distributed Systems | Presales | Program ManagementHybrid work | Travel up to 30%Senior-level Full TimeRemote - California; Remote - Colorado; … R1d ago
-
Dashboarding | Data Visualization | Demand forecasting | Excel | Experimentation401k match | Bonding Leave | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeNorth Bethesda, MD1d ago
-
Cost Management | Cross-Functional Collaboration | Cross-functional | Functional collaboration | MetricsEmployee assistance programs | Health benefits | Paid time off | Recovery BenefitsSenior-level Full TimeCosta Mesa, California, United States1d ago
-
Senior Data Engineer II - Enterprise Data Platforms and Data Management - Enterprise Data & AI USD 89K-150KAPI | CI/CD | Cloud Native | Cloud platform | Data GovernanceMid-level Full TimePhoenix, AZ, United States2d ago
-
Distributed Systems | Fault Tolerance | GPU Computing | JAX | Low LatencyBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, California2d ago
-
Manager, Data Analytics and Insights USD 120K-141KAcceptance Testing | Alpha generation | Anomaly Detection | Bloomberg | Cause analysisMid-level Full Time155 Seaport Blvd, Boston MA, United … R2d ago
-
Assortment Planning | Communication | Cross-Functional Collaboration | Cross-functional | Data InterpretationMid-level Full TimeNonstore B187 Jacksonville FL, United States2d ago
-
AWS | AWS Cloud | Artificial Intelligence | Azure | C#Senior-level Full TimeSan Jose, CA, United States2d ago
-
Staff Engineer - Data Engineering USD 145K-223KAWS | AWS SageMaker | Agile | Azure | Business Intelligence401k retirement plan | Flexible work/hybrid | Healthcare coverage | Paid parental leave | Paid time offSenior-level Full TimeChicago, United States2d ago
-
Associate Director, Quantitative Pharmacology and Pharmacometrics – Immuno-Oncology (QP2‑IO) USD 156K-247KClinical Trial Simulation | Clinical trial | Data Modeling | Dose response | Dose-response analysis401k | Comprehensive health insurance | Hybrid work possible | Long term incentive bonus | Paid HolidaysMid-level Full TimeUSA - New Jersey - Rahway, …2d ago