Engineering Manager, Inference Benchmarking — AI Perf
US, CA, Santa Clara, United States
USD 224K-356K Senior-level Full Time
Tasks
- Advise upstream engine integrations
- Drive technical roadmap for AIPerf core infrastructure
- Hire mentor and grow engineering team in open source environment
- Maintain AIPerf relevance across hardware and inference configurations
- Own accuracy and statistical soundness of benchmark results
Perks/Benefits
- N/A
Skills/Tech-stack
DCGM | Distributed Systems | GPU Telemetry | GPU observability | Helm | ITL | KV cache | Kubernetes | Kubernetes Operators | LLM Inference | Load generation | Microservices | Open Source | Open source communities | Prefill Decode | Prometheus | PyNVML | SGLang | Speculative decoding | Statistical Analysis | Systems engineering | TTFT | TensorRT-LLM | VLLM | ZMQ
Education
Regions
Countries
States
Cities
Related jobs
-
Practice Manager - AI & Data USD 160K-190KAWS | Agent systems | Amazon SageMaker | Apache Spark | AzureCareer growth opportunities | Comprehensive benefits | MentorshipSenior-level Full TimeBroomfield, CO. Greensboro, NC. Troy, Michigan14h ago
-
Networking AI Technical Lead USD 207K-301KAlgorithms | Artificial Intelligence | C++ | Compute Technologies | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA22h ago
-
APIs | AWS | Agile | Agile tools | AngularDental insurance | Medical insurance | Paid time off | Retirement savings options | Vision insuranceSenior-level Full TimeWork At Home-Connecticut, United States1d ago
-
Manager - XP Analytics Growth, ECP USD 149K-205KA/B | A/B Testing | B testing | Credit Risk | Credit risk modelingMid-level Full TimeMcLean, VA, United States1d ago
-
Sales Data & Analytics Product Manager USD 131K-190KAmazon Web Services | Analytics reporting | Apache Airflow | Apache Kafka | Apache Spark401k | Bonus | Dental coverage | Holidays | Medical coverageMid-level Full TimeUS, MA, Wilmington, United States1d ago
-
Senior AI Engineer – Agentic AI & Automation - VP USD 170K-230KBPMN | Camunda | Containers | Context Management | Embeddings401k | Incentive award | Life insurance | Medical, dental, and vision coverage | Paid leaveSenior-level Full TimeBuilding 400-Whippany Campus, Jefferson Park, United …1d ago
-
Executive Director, Biostatistics USD 256K-320KBayesian statistics | Biostatistics | Causal Inference | Clinical data | Clinical trialsCaregiver support | Health insurance | Hybrid work | Wellness programsExecutive-level Full TimeCambridge, MA, United States2d ago
-
API Gateway | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHouston, TX, United States2d ago
-
Manager, Business Analytics USD 120K-132KAgile | Capacity Planning | Clustering | DB2 | Data Mining401k retirement plan | CVS store discount | Education assistance | Employee stock purchase plan | Free development coursesMid-level Full TimeWoonsocket-1 CVS Drive, United States3d ago
-
Manager, Business Analytics USD 98K-199KBig Data | Clustering | Data Mining | Data Modeling | Data Privacy401k retirement savings plan | CVS store discount | Dental insurance | Discount programs | Education assistanceMid-level Full TimeWoonsocket-1 CVS Drive, United States3d ago
-
Manager, Business Analytics USD 72K-145KAmazon Web Services | Azure | Cloud platform | Confluence | Data Modeling401k retirement savings plan | CVS store discount | Discount programs with partners | Education assistance | Employee stock purchase planMid-level Full TimeWoonsocket-1 CVS Drive, United States3d ago
-
Asset & Wealth Management, Quantitative Equity Solutions, Client Portfolio Manager, Associate USD 100K-170KC# | C++ | Excel | Financial Analysis | Financial marketsMid-level Full TimeNew York, NY, United States3d ago
-
Engineering Manager, Data Flow Agentic Data Cloud USD 207K-301KApache Beam | BigQuery | C# | C++ | Cloud StorageSenior-level Full TimeSeattle, WA, USA3d ago
-
Data & Analytics Manager USD 145K-150KData Governance | Data Modeling | Data Warehousing | ELT | ETLMid-level Full TimeDenver, CO, 80237, US3d ago
-
AWS | Agile | Cloud Computing | Data platform | Distributed SystemsRemote eligibleSenior-level Full TimeSan Francisco, CA, United States R4d ago
-
Senior Manager Data Analytics USD 103K-174KA/B | A/B Testing | Adobe Analytics | B testing | Data VisualizationVisa sponsorshipSenior-level Full TimeNew York, NY, United States4d ago
-
AI Assisted Development | Backend architecture | C++ | Cybersecurity | Distributed SystemsCareer growth opportunities | Flexible work hours | Hybrid work | Team eventsExecutive-level Full TimeAustin, Texas, United States4d ago
-
Senior Vice President, Applied AI Product Manager USD 104K-253KAI Lifecycle | AI Lifecycle Management | APIs | Agentic Workflows | Distributed SystemsFlexible global resources | Health and wellbeing programs | Paid leave | Paid volunteer timeSenior-level Full TimeNew York, NY, United States4d ago
-
Principal Technical Program Manager- AI/ML- Payments USD 177K-215KApplied AI | Audit Readiness | Batch Scoring | CI/CD | Cost OptimizationSenior-level Full TimeNew York, NY, United States4d ago
-
Senior-level Full TimeNew York4d ago
-
AI/ML | AI/ML evaluation | Artificial Intelligence | Cloud infrastructure | Cross-Functional CollaborationDental coverage | Health benefits | Hybrid work | Inclusive culture | Leadership developmentSenior-level Full TimeCanada4d ago
-
Digital Execution Lead, Digital Delivery for Construction Execution, Google Data Centers USD 163K-237KApache Airflow | Automated Monitoring | BigQuery | CI/CD | DBTSenior-level Full TimeSunnyvale, CA, USA; Atlanta, GA, USA4d ago
-
Technical Lead, AI/ML Infrastructure USD 207K-301KC# | C++ | Compute architecture | Cryptography | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA4d ago
-
Inference Optimization Manager USD 229K-286KCloud infrastructure | Distributed Systems | GPU Kernel | GPU kernel programming | Inference engine401k matching | Flexible paid time off | Health insurance | Remote work options | Team onsite eventsMid-level Full TimeUnited States / Canada5d ago
-
Senior Analytics Manager - AI Model & Prompt Engineering USD 172K-258KA/B | A/B Testing | AI Evaluation | APIs | AWS401k | Career development | Employee assistance program | Flexible spending accounts | Health savings accountSenior-level Full TimeChicago, Illinois, United States5d ago