Senior Engineering Manager - Model Inference & Serving, AI Platform
Tasks
- Build cross-functional partnerships
- Communicate vision progress and priorities to senior leadership
- Define model inference and serving strategy
- Drive experimentation and serving frameworks
- Ensure reliability, scalability, and performance
- Lead engineering managers and technical leads
- Oversee model routing and inference systems
- Own observability SLOs and incident response
- Transition from legacy serving to unified modular platform
Perks/Benefits
- 401k retirement plan
- Disability programs
- Family-forming benefits
- Flexible spending account
- Health insurance
- Health savings account
- Life and serious injury benefits
- Mental health support
- Paid leave
- Paid time off
- Stock options
Skills/Tech-stack
Batch inference | CPU | Deep learning | Distributed Systems | Experimentation | GPU | Generative AI | Incident Response | Language Models | Large Language Models | Machine Learning | Model Serving | Observability | PyTorch | Real Time | Real-time Inference | SLAs | SLO | TensorFlow | Triton | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
Product Lead, Applied AI, Data and Analytics Platform USD 192K-278KAccess Control | Analytics | Artificial Intelligence | BigQuery | Data LineageSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior Technical Program Manager, AI/ML, Finance USD 192K-278KArtificial Intelligence | Business Intelligence | Data Architecture | Data Governance | Data WarehousingSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Technical Program Manager III, Machine Learning, Core USD 163K-237KArtificial Intelligence | Automation | Deep learning | Machine Learning | Speech RecognitionSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Cloud Computing | Co-marketing | Content Creation | Data analytics | Demand GenerationSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2h ago
-
Manager, IT AI Engineering - Agent Engineering USD 96K-131KA/B | A/B Testing | API Design | Access Control | Agent architecture401k program | Car discounts | Cruise discounts | Employee assistance program | Flexible spending accountsMid-level Full TimeFort Worth, TX, US5h ago
-
AWS CloudFormation | Amazon Web Services | Anomaly Detection | Attribution Modeling | Budget Quota ManagementSenior-level Full TimeMountain View, California12h ago
-
Manager, Digital Analytics - Amazon USD 120K-150KAmazon Vendor Central | Business planning | CPG analytics | Competitive Analysis | Data Analysis401k match | Equity | Flexible time off | Flexible work schedule | Free productsMid-level Full TimeNew York, NY17h ago
-
Engineering Manager - AI Cloud Platform USD 330K-440KBackend Development | Cluster Lifecycle Automation | Cluster lifecycle | Distributed Systems | Go401k match | Commuter stipend | Dental insurance | Flexible paid time off | Health insuranceMid-level Full TimeSan Francisco Office18h ago
-
Architecture Review | Cloud Data | Cloud Data Architecture | Consumption-based models | Customer Architecture ReviewSenior-level Full TimeUS-NY-New York20h ago
-
Senior Manager, Machine Learning USD 141K-187KAWS SageMaker | Amazon ECS | Amazon EKS | Amazon Web Services | Apache SparkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R20h ago
-
Manager, AI Deployment Engineering - Codex USD 251K-335KCloud Computing | Development Lifecycle | Generative AI | JavaScript | PythonHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco21h ago
-
Assistant Director, Analytics USD 135K-135KAgile | Apache Airflow | Business Intelligence | DBT | Data VisualizationExecutive-level Full TimeWashington, District of Columbia, United States; …21h ago
-
Senior Technical Product Manager - ML & Analytics USD 92K-142KAgile | Analytics | Artificial Intelligence | Automation tools | Data Pipelines401k plan | Commuter benefits | Dental insurance | Employee stock purchase program | Medical insuranceSenior-level Full TimeAustin, TX; Toronto, Canada22h ago
-
APIs | AWS | Agile | Artificial Intelligence | Azure401k match | Dental insurance | Educational reimbursement | Flexible work schedules | Health insuranceSenior-level Full TimeRemote, United States R23h ago
-
Engineering Manager, Data Infrastructure USD 165K-242KAgile | Apache Airflow | Apache Iceberg | Apache Spark | Automation401k match | Catered lunch | Employee stock purchase program | Family forming support | Flexible PTOSenior-level Full TimeNew York, NY/Bellevue, WA23h ago
-
Sr. Product Manager - Intelligence Data Platform & AI USD 150K-190KAnalytics | Artificial Intelligence | Business Strategy | Data Architecture | Data Ingestion401k match | Caregiver leave | Flexible vacation | HSA contribution | Health insuranceSenior-level Full TimeUnited States1d ago
-
Technical Lead Manager, AI/ML Networking USD 207K-300KArtificial Intelligence | C++ | Compute Technologies | Dataplane Encryption | Deep Learning Execution ProviderSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA1d ago
-
AI Agents | AppScript | Artificial Intelligence | Business Intelligence | Change ManagementSenior-level Full TimeSan Bruno, CA, USA1d ago
-
Senior Engineering Analyst, AI, Safety USD 159K-231KAbuse detection | C++ | Data Analysis | Fine Tuning | Fraud DetectionEquity compensation | Health insurance | Mentorship | Paid time off | Retirement benefitsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA1d ago
-
Data Pipelines | Data Processing | Debugging | Distributed Systems | Engineering ManagementSenior-level Full TimePittsburgh, PA, USA1d ago
-
Anomaly Detection | CCPA | Circumvention Detection | Connected Account Detection | Data GovernanceSenior-level Full TimeUnited States1d ago
-
Architecture Reviews | Distributed Systems | Engineering processes | Engineering workflows | File systemsCareer advancement opportunities | Health and wellbeing benefits | Mentorship | Professional development | Work-life balance flexibilitySenior-level Full TimeMassachusetts R1d ago
-
Call Management | Distributed Systems | File systems | Incident Response | LinuxCareer advancement | Health and wellbeing benefits | Mentorship | Professional development | Work-life flexibilitySenior-level Full TimeMinnesota R1d ago
-
Architecture Reviews | Capacity Management | Capacity Planning | Design reviews | Distributed SystemsCareer advancement opportunities | Health and wellbeing benefits | Mentorship | Personal and professional development | Work from home flexibilitySenior-level Full TimeIdaho R1d ago
-
Distributed Systems | Filesystems | Incident Management | Linux | NetworkingCareer advancement opportunities | Health and wellbeing benefits | Mentorship | Personal and professional development | Work-life flexibilityMid-level Full TimeIllinois R1d ago