Inference Optimization Manager
Tasks
- Build continuous optimization loop for customer workloads
- Drive full stack performance optimizations
- Lead optimization platform for LLM inference
- Manage and develop engineering team
- Own technical direction for inference performance
- Partner with GTM for workload specific tuning
- Publish technical content on inference optimization best practices
- Set engineering priorities and execution plan
- Translate customer insights into technical roadmap
Perks/Benefits
Skills/Tech-stack
Cloud infrastructure | Distributed Systems | GPU Kernel | GPU kernel programming | Inference engine | Kernel programming | Kubernetes | Language Models | Large Language Models | Machine Learning | Performance Engineering | Workload Analysis
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R12d ago
-
Director of AI & Data Analytics USD 175K-224KAmazon Web Services | Anomaly Detection | Apache Airflow | DBT | Data Governance401k match | Autonomy | Collaborative culture | Generous PTO | Health and wellness benefitsExecutive-level Full TimeDallas, TX, US16h ago
-
Sr. Manager Procurement Systems & Analytics USD 115K-141KArtificial Intelligence | Business Process | Business Process Analysis | Change Management | Data GovernanceSenior-level Full TimeWesterville, OH, United States19h ago
-
Senior Manager - Rental Analytics USD 44K-52KAS400 | Access | Capacity modeling | Data Analysis | Data QualityCoaching and Mentorship | Continuous learning culture | On site work location | Travel as neededSenior-level Full TimeReading, PA, United States19h ago
-
Staff AI Solutions Deployment Developer, Applied AI USD 183K-266KAgentic AI | Cloud Architecture | Cloud platform | Conversational AI | DebuggingSenior-level Full TimeWaterloo, ON, Canada; Cambridge, MA, USA21h ago
-
Senior Product Data Scientist Manager, Android USD 240K-334KData Manipulation | Data Visualization | Data extraction | Machine Learning | PythonSenior-level Full TimeSan Jose, CA, USA; Kirkland, WA, …21h ago
-
APIs | Access Management | C++ | Cloud infrastructure | Content ManagementSenior-level Full TimeChicago, IL, USA; New York, NY, …21h ago
-
Global Consolidated Customer Data & AI Lead USD 144K-216KAI Governance | Analytics | CCPA | Data Architecture | Data DeduplicationDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeWhippany, New Jersey, US1d ago
-
Senior Product Manager - Customer Data Platform USD 210K-335KAI-powered monitoring | Anomaly Detection | Cloud Data | Cloud Data Warehouse | Data Observability401k match | Catered lunch | Extra leave | Flexible work hours | Health insuranceSenior-level Full TimeNew York, New York, United States1d ago
-
AI tools | Business Strategy | Business reviews | Change Management | Data GovernanceNo immigration sponsorship | Onsite work 5 days per weekSenior-level Full TimeSan Diego, California, United States of …1d ago
-
Data Engineering Manager USD 172K-254KArtificial Intelligence | Automated testing | CI/CD | Data Architecture | Data Pipelines401k matching | Childcare FSA | Employee stock purchase plan | Family planning support | HolidaysMid-level Full TimeSan Francisco or Remote (U.S.) R1d ago
-
Financial Crimes Compliance Modeling & Analytics Manager USD 149K-208KAML Compliance | BSA/AML | Data analytics | False Positive | False positive reductionMid-level Full TimeSan Francisco, CA, New York, NY, … R1d ago
-
Senior Customer Success Manager, Managed Inference USD 190K-215KAPIs | Account Management | Autoscaling | Cloud Computing | Containers401k match | Cell phone stipend | Commuter benefits | Daily meals allowance | Dental insuranceSenior-level Full TimeNew York, NY - US1d ago
-
Senior Customer Success Manager, Managed Inference USD 190K-215KAPIs | Agentic Workflows | Artificial Intelligence | Autoscaling | Cloud Computing401k match | Cell phone stipend | Commuter benefits | Daily meals allowance | Dental insuranceSenior-level Full TimeDenver, CO - US1d ago
-
Senior Customer Success Manager, Managed Inference USD 190K-215KAPIs | Account Management | Artificial Intelligence | Autoscaling | Cloud Computing401k match | Cell phone stipend | Commuter benefits | Daily meals allowance | Dental insuranceSenior-level Full TimeSan Francisco, CA - US1d ago
-
Advanced Analytics | Benchmarking | Business Intelligence | Dashboards | Data GovernanceExecutive-level Full TimeMettawa, IL, United States1d ago
-
Manager, Innovation and Transformation CAD 96K-130KAWS | Agile | Artificial Intelligence | Automated testing | AzureMid-level Full TimeMontreal, Quebec, Canada1d ago
-
AI/LLM Product Director - Executive Director USD 235K-285KAWS | Agents | Boolean search | Elasticsearch | Faceted searchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimePalo Alto, CA, United States1d ago
-
Senior Technical Program Manager, Robotics USD 180K-226KAgile | Architecture Review | Autonomous Vehicles | Cross-functional | Cross-functional leadershipCommuter stipend | Generous paid time off | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA1d ago
-
Manager, GTM Strategic Intelligence & Advanced Analytics USD 120K-180KAirflow | Automation | Excel | Experimentation | GitTravel for onboardingSenior-level Full TimeDenver, CO1d ago
-
Manager, GTM Strategic Intelligence & Advanced Analytics USD 120K-180KAirflow | Automation | Excel | Experimentation | ForecastingSenior-level Full TimeBoston, MA1d ago
-
Tech Lead Manager, Inference USD 207K-300KAutoscaling | Cache Management | Caching | Continuous batching | Deployment PipelinesSenior-level Full TimeSF Bay Area, CA1d ago
-
Engagement Manager - Data & Analytics USD 150K-170KBayesian Methods | Decision Trees | Hierarchical models | Machine Learning | Neural NetworksTelecommutingMid-level Full TimeNewton, Massachusetts, United States R1d ago
-
ML Engineer Manager, AI Conversation Platform CAD 244K-366KArtificial Intelligence | Data Pipelines | Fine Tuning | Language Models | Language ProcessingMid-level Full TimeToronto, Canada1d ago
-
Manager, Digital Applied Analytics USD 162K-205KA/B | A/B Testing | Artificial Intelligence | Attribution Modeling | B testing100 percent preventive care | 401k matching | Adoption Assistance | Carwash | DiscountsMid-level Full TimeIrvine, CA, United States1d ago