Sr. Manager, Engineering - AI Gateway (LLM Inference)
Tasks
- Build AI gateway products
- Capture production data for cost performance and quality
- Collaborate with product and research
- Define product direction for AI and data applications
- Govern route and monitor LLM endpoints
- Grow existing products
- Launch new products
- Lead engineering teams
- Secure and observe LLM inference traffic
Perks/Benefits
- N/A
Skills/Tech-stack
Cost Optimization | Generative AI | LLM Inference | Language Models | Large Language Models | Machine Learning | Model Serving | Monitoring | Performance Tuning | Quality Assurance | Routing | Security
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Manager of Business Intelligence and Analytics USD 104K-145KAPIs | Agile | Analytics engineering | Azure Data | Azure Data FactoryMid-level Full TimeDallas, Texas, United States; Tyler, Texas, …19h ago
-
Apptio Target Process | Artificial Intelligence | Automation | Clarity | ConfluenceCareer development and training opportunities | Company retirement match | Comprehensive medical dental vision life insurance disability benefits | Flexible working model | Free counseling supportSenior-level Full TimeUS-Florida-Sunrise22h ago
-
Project Manager - Knowledge Graph Group USD 110K-140KArtificial Intelligence | BQL | Data Governance | Data Management | Data ModelingMid-level Full TimeNew York22h ago
-
Project Manager - Knowledge Graph Group USD 110K-140KAI | Automation | Data Governance | Data Modeling | Data integration401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimePrinceton22h ago
-
GenAI Product Policy Manager USD 158K-228KAI Policy | Adversarial Simulation | Agent Orchestration | Artificial Intelligence | Bias MitigationMid-level Full TimeAustin, TX | Washington, DC23h ago
-
Senior Engineering Analyst, Trust and Safety, Cloud USD 159K-231KAI Agents | API | Anomaly Detection | Artificial Intelligence | BenchmarkingSenior-level Full TimeWashington D.C., DC, USA23h ago
-
Senior Technical Program Manager II, Applied AI USD 240K-334KAgent architecture | Cross-functional | Cross-functional leadership | Dashboards | Data ValidationSenior-level Full TimeWaterloo, ON, Canada; Cambridge, MA, USA23h ago
-
Artificial Intelligence | Change Management | Cross-Functional Collaboration | Cross-functional | Data AnalysisMid-level Full TimeAtlanta, GA, USA23h ago
-
Senior Director, Engineering, Data Integration USD 365K-505KApache Airflow | Artificial Intelligence | Big Data | Cloud platform | Cross-Functional CollaborationSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Software Engineer Manager, Embedded Systems and Firmware USD 207K-300KARM | Bootloader | C# | C++ | Computer ArchitectureSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Senior Engineering Manager, Cloud BI, AI Looker USD 262K-365KData Engineering | Data Processing | Debugging | Distributed Computing | Fine TuningSenior-level Full TimeSunnyvale, CA, USA1d ago
-
AI | Agile | Alteryx | Data Mining | Data Visualization401k matching | Flexible spending accounts | Healthcare (Medical Dental Vision) | Hybrid work schedule | Parental leaveMid-level Full TimeBoston, MA1d ago
-
Vertical AI Lead USD 150K-250KAPI Integration | Agentic Systems | Artificial Intelligence | Customer discovery | Go-to-marketBenefits | Equity | Visa sponsorshipSenior-level Full TimeNew York City / San Francisco1d ago
-
AI Engineering Manager/ Delivery Lead (Remote) USD 116K-325KAutomation | CI/CD | Data Structures | Data Structures and Algorithms | JavaSenior-level Full TimeDurham, North Carolina, United States of … R1d ago
-
Senior Group Software Development Manager, Generative AI USD 163K-292KAI Automation | API Design | Asynchronous programming | Automated testing | Batch ProcessingSenior-level Full TimeAMER - United States - Massachusetts …1d ago
-
Manager, Data Science USD 48K-70KAWS | Data Quality | Data Science | Data Wrangling | Diagnostic AnalyticsHybrid workMid-level Full TimeMalvern, PA, United States1d ago
-
CTIO AI Engineering Manager USD 73K-244KAWS | Artificial Intelligence | CI/CD | Cloud Computing | Cloud platform401k | Annual discretionary bonus | Dental insurance | Holiday pay | Medical insuranceMid-level Full TimeNew York - 300 Madison Avenue, …1d ago
-
Payer Healthcare Data Scientist, Manager USD 99K-232KCMS Star Ratings | Claims data | Clinical data | Data Science | Data integration401k | Annual discretionary bonus | Dental insurance | Health insurance | Holiday paySenior-level Full TimeBoston - 101 Seaport Boulevard, United …1d ago
-
Director, Product Management, GenAI Video Models USD 172K-334KAnalytics | Competitive Analysis | Functional Requirements | Generative AI | Key Performance IndicatorsExecutive-level Full TimeSan Jose, United States1d ago
-
Account Planning | Artificial Intelligence | Cloud Computing | Decision Intelligence | Enterprise SalesSenior-level Full TimeSeattle, Washington, USA1d ago
-
Sr. Applied Science Manager, AGI Information USD 218K-295KA/B | A/B Testing | Artificial Intelligence | B testing | Data-Driven Decision MakingSenior-level Full TimeSeattle, Washington, USA1d ago
-
Sr. Software Development Manager, Frontier AI Robotics USD 220K-342KCloud Computing | Continuous integration | Machine Learning | Multimodal Learning | Reinforcement LearningSenior-level Full TimeSan Francisco, California, USA1d ago
-
Automation | Data Governance | Data Modeling | Data Visualization | Data WarehousingEmployee scholar programSenior-level Full TimeUS-CT-EAST HARTFORD-ETC ~ 400 Main St …1d ago
-
Artificial Intelligence | Automation | Data Architecture | Data Governance | Data SecurityCareer Development Programs | Dental insurance | Health insurance | Paid time off | Retirement savings planMid-level Full TimeRichmond, VA, US, 232331d ago
-
Manager- Applied Sciences / Machine Learning USD 163K-331KAlgorithms | C# | C++ | Data Processing | Data StructuresMid-level Full TimeRedmond, WA, US; Mountain View, CA, …1d ago