Senior Engineering Manager - Model Inference & Serving, AI Platform
Tasks
- Build cross-functional partnerships
- Communicate vision progress and priorities to senior leadership
- Define model inference and serving strategy
- Drive experimentation and serving frameworks
- Ensure reliability, scalability, and performance
- Lead engineering managers and technical leads
- Oversee model routing and inference systems
- Own observability SLOs and incident response
- Transition from legacy serving to unified modular platform
Perks/Benefits
- 401k retirement plan
- Disability programs
- Family-forming benefits
- Flexible spending account
- Health insurance
- Health savings account
- Life and serious injury benefits
- Mental health support
- Paid leave
- Paid time off
- Stock options
Skills/Tech-stack
Batch inference | CPU | Deep learning | Distributed Systems | Experimentation | GPU | Generative AI | Incident Response | Language Models | Large Language Models | Machine Learning | Model Serving | Observability | PyTorch | Real Time | Real-time Inference | SLAs | SLO | TensorFlow | Triton | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Data Warehousing | Databricks | Fine Tuning | LLM APIsSenior-level Full TimeSan Francisco, CA, United States4h ago
-
Product Lead, Applied AI, Data and Analytics Platform USD 192K-278KAccess Control | Analytics | Artificial Intelligence | BigQuery | Data LineageSenior-level Full TimeMountain View, CA, USA5h ago
-
Senior Technical Program Manager, AI/ML, Finance USD 192K-278KArtificial Intelligence | Business Intelligence | Data Architecture | Data Governance | Data WarehousingSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Technical Program Manager III, Machine Learning, Core USD 163K-237KArtificial Intelligence | Automation | Deep learning | Machine Learning | Speech RecognitionSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Cloud Computing | Co-marketing | Content Creation | Data analytics | Demand GenerationSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago
-
Manager, IT AI Engineering - Agent Engineering USD 96K-131KA/B | A/B Testing | API Design | Access Control | Agent architecture401k program | Car discounts | Cruise discounts | Employee assistance program | Flexible spending accountsMid-level Full TimeFort Worth, TX, US8h ago
-
AWS CloudFormation | Amazon Web Services | Anomaly Detection | Attribution Modeling | Budget Quota ManagementSenior-level Full TimeMountain View, California16h ago
-
Engineering Manager - Robotics & Drones USD 170K-200K5G | Autonomous Mobile Robots | CAN | Cloud Integration | Computer VisionMid-level Full TimeUSA Boston Software Office 100 Northern …16h ago
-
Sr Manager, People Analytics Insight Partner USD 182K-235KAWS | Advanced Statistics | Analytics | Business Analytics | Data ManagementDental insurance | Health insurance | Life insurance | Paid time off | Vision insuranceSenior-level Full TimeUS - CA - Foster City, …16h ago
-
Manager, Digital Analytics - Amazon USD 120K-150KAmazon Vendor Central | Business planning | CPG analytics | Competitive Analysis | Data Analysis401k match | Equity | Flexible time off | Flexible work schedule | Free productsMid-level Full TimeNew York, NY21h ago
-
Engineering Manager - AI Cloud Platform USD 330K-440KBackend Development | Cluster Lifecycle Automation | Cluster lifecycle | Distributed Systems | Go401k match | Commuter stipend | Dental insurance | Flexible paid time off | Health insuranceMid-level Full TimeSan Francisco Office21h ago
-
Analytics | Analytics Strategy | Business Intelligence | Causal analysis | DashboardsSenior-level Full TimeUnited States23h ago
-
Architecture Review | Cloud Data | Cloud Data Architecture | Consumption-based models | Customer Architecture ReviewSenior-level Full TimeUS-NY-New York23h ago
-
Senior Manager, Machine Learning USD 141K-187KAWS SageMaker | Amazon ECS | Amazon EKS | Amazon Web Services | Apache SparkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R23h ago
-
Sr. Manager Of AI Cloud Engineering USD 139K-184KAzure | Azure Cognitive | Azure Cognitive Services | CI/CD | Cloud ArchitectureHybrid work modelSenior-level Full TimeOakland, CA, United States1d ago
-
Manager, AI Deployment Engineering - Codex USD 251K-335KCloud Computing | Development Lifecycle | Generative AI | JavaScript | PythonHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco1d ago
-
Assistant Director, Analytics USD 135K-135KAgile | Apache Airflow | Business Intelligence | DBT | Data VisualizationExecutive-level Full TimeWashington, District of Columbia, United States; …1d ago
-
Senior Technical Product Manager - ML & Analytics USD 92K-142KAgile | Analytics | Artificial Intelligence | Automation tools | Data Pipelines401k plan | Commuter benefits | Dental insurance | Employee stock purchase program | Medical insuranceSenior-level Full TimeAustin, TX; Toronto, Canada1d ago
-
APIs | AWS | Agile | Artificial Intelligence | Azure401k match | Dental insurance | Educational reimbursement | Flexible work schedules | Health insuranceSenior-level Full TimeRemote, United States R1d ago
-
Engineering Manager, Data Infrastructure USD 165K-242KAgile | Apache Airflow | Apache Iceberg | Apache Spark | Automation401k match | Catered lunch | Employee stock purchase program | Family forming support | Flexible PTOSenior-level Full TimeNew York, NY/Bellevue, WA1d ago
-
Sr. Product Manager - Intelligence Data Platform & AI USD 150K-190KAnalytics | Artificial Intelligence | Business Strategy | Data Architecture | Data Ingestion401k match | Caregiver leave | Flexible vacation | HSA contribution | Health insuranceSenior-level Full TimeUnited States1d ago
-
Technical Lead Manager, AI/ML Networking USD 207K-300KArtificial Intelligence | C++ | Compute Technologies | Dataplane Encryption | Deep Learning Execution ProviderSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA1d ago
-
AI Agents | AppScript | Artificial Intelligence | Business Intelligence | Change ManagementSenior-level Full TimeSan Bruno, CA, USA1d ago
-
Senior Engineering Analyst, AI, Safety USD 159K-231KAbuse detection | C++ | Data Analysis | Fine Tuning | Fraud DetectionEquity compensation | Health insurance | Mentorship | Paid time off | Retirement benefitsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA1d ago
-
Data Pipelines | Data Processing | Debugging | Distributed Systems | Engineering ManagementSenior-level Full TimePittsburgh, PA, USA1d ago