Inference Optimization Manager
Tasks
- Build continuous optimization loop for customer workloads
- Drive full stack performance optimizations
- Lead optimization platform for LLM inference
- Manage and develop engineering team
- Own technical direction for inference performance
- Partner with GTM for workload specific tuning
- Publish technical content on inference optimization best practices
- Set engineering priorities and execution plan
- Translate customer insights into technical roadmap
Perks/Benefits
Skills/Tech-stack
Cloud infrastructure | Distributed Systems | GPU Kernel | GPU kernel programming | Inference engine | Kernel programming | Kubernetes | Language Models | Large Language Models | Machine Learning | Performance Engineering | Workload Analysis
Education
N/A
Related jobs
-
Project Manager, Abusive Actor Operations USD 72K-109KAI Governance | Data Auditing | Data Drift | Data Visualization | Data labelingMid-level Full TimeAustin, TX5h ago
-
AAI Deployment Program Manager, Cloud Applied AI USD 188K-274KAPIs | Agentic AI | CRM Integrations | Compliance | Customer SuccessSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago
-
Group Product Manager, Generative AI, Google Cloud USD 240K-333KGenerative AI | Go-to-market | Language Models | Large Language Models | Market AnalysisSenior-level Full TimeKirkland, WA, USA; New York, NY, …5h ago
-
Product Manager II, Generative AI, Google Cloud USD 163K-236KGenerative AI | Go-to-market | Language Models | Large Language Models | Market AnalysisMid-level Full TimeSan Francisco, CA, USA; Sunnyvale, CA, …5h ago
-
Artificial Intelligence | Computer Vision | Data Debiasing | Data Pipelines | Data ScienceSenior-level Full TimeKirkland, WA, USA; Mountain View, CA, …5h ago
-
APIs | Back-end | Back-end infrastructure | Data Chunking | Developer platformsHealth insurance | Paid time off | Retirement planMid-level Full TimeSan José, CA, USA; San Francisco, …5h ago
-
Data Science Manager - GTM Sales USD 141K-216KAI Automation | Account Health | Account Health Scoring | Business Intelligence | Churn Prediction401k company match | Equity packages | Flexible leave options | Flexible work options | Health benefits planMid-level Full TimeAustin, United States9h ago
-
Cost Optimization | Data Pipelines | Feature Engineering | Machine Learning | Machine Learning InfrastructureEquity compensationMid-level Full TimeSan Mateo, CA, United States R10h ago
-
Principal Applied Science Manager USD 165K-296KComputer Vision | Content Generation | Data-Driven Decision Making | Data-driven | Decision MakingSenior-level Full TimeUnited States, Washington, Redmond; United States, …15h ago
-
Senior Director, Data Platform Engineering USD 156K-225KAirflow | Ansible | Architecture | Batch Processing | CI/CDBonus program | Global perks | Health and wellness benefits | RSU equity programsSenior-level Full TimeUnited States R17h ago
-
Sr. Manager, AI Cloud Engineering USD 150K-185KAPI Integration | Azure | Azure Cognitive | Azure Cognitive Services | CI/CDHybrid work schedule | Training opportunitiesSenior-level Full TimeOakland, CA, United States19h ago
-
Senior Data Science Manager, User Growth USD 204K-306KAttribution Modeling | Business Intelligence | Causal Inference | Data Visualization | ExperimentationSenior-level Full TimeNew York, NY19h ago
-
Senior Data Science Manager, User Growth USD 204K-306KAttribution Modeling | Causal Inference | Data Engineering | Data Science | Data analyticsSenior-level Full TimePittsburgh, PA19h ago
-
Manager, Customer Data, Analytics & Tools USD 132K-250KCloud platform | Dashboard Development | Data Automation | Data Preparation | Data VisualizationAdoption surrogacy expense reimbursement | Backup Child Care | Employee resource groups | Fertility treatment support | Fertility treatmentsMid-level Full TimeDearborn, MI, United States20h ago
-
AI integration | API Design | Canonical Data | Canonical Data Modeling | Cross-functional401k match | Disability insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeUtah | Hybrid R22h ago
-
Senior Product Manager - Bits Agent Builder USD 192K-240KAPI | Context Sources | Developer tools | Distributed Systems | Evaluation Frameworks401k match | Community guilds | Continuous professional development | Employee stock purchase plan | Fitness reimbursementsSenior-level Full TimeNew York, New York, USA23h ago
-
Analytics Manager USD 77K-89KBusiness Intelligence | Classification | Clustering | DAX | Data GovernanceMid-level Full TimeROHNERT PARK, CA, United States23h ago
-
Data & AI Lead Senior Manager USD 148K-306KAI Innovation | Cloud Platforms | Data Modeling | Data integration | DatabricksSenior-level Full TimeWashington, DC1d ago
-
Sr. Manager, AI Software Engineering USD 200K-275KAWS | CI/CD | Cloud Native | Distributed Systems | Docker401k match | Dental insurance | Employee assistance program | Fertility coverage | Flexible time offSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Product Manager - AI Data and Safety USD 228K-492KBias Mitigation | Cost monitoring | Data Production | Data Quality | Data acquisitionSenior-level Full TimeSan Jose, California, United States1d ago
-
Business Analytics Advisor - Executive Director USD 122K-193KAnalytics | Business Strategy | Data Governance | Data Visualization | HR AnalyticsBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeNew York, NY, United States1d ago
-
Embedded Engineering Manager, Networking USD 180K-230KAccess Points | Budget Management | C# | C++ | Computer Architecture401k contributions | Dental insurance | Gym membership | Health insurance | Paid HolidaysSenior-level Full TimeIrvine, California, United States1d ago
-
Analytics | Artificial Intelligence | Cost Optimization | Customer Success | Enterprise SalesSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA1d ago
-
Business & Marketing Data Science Manager USD 240K-334KArtificial Intelligence | Cloud Machine Learning | Dashboarding | Data Engineering | Data VisualizationBenefits determined by role level and location | Hybrid scheduleSenior-level Full TimeSeattle, WA, USA R1d ago
-
Artificial Intelligence | Cloud Computing | Cross-Functional Collaboration | Cross-functional | Functional collaborationSenior-level Full TimeSunnyvale, CA, USA; New York, NY, …1d ago