Principal Product Manager, AI Infrastructure and Orchestration
Remote WA, United States
R
USD 187K-240K (estimate) Senior-level Full Time
Tasks
- Define deployment and workload API
- Define reliability SLOs and error budget
- Define tenancy boundaries and private connectivity
- Design ingress and routing for agent and model endpoints
- Design quota and priority behavior under contention
- Diagnose degraded deployment using operational surface
- Drive resource model lifecycle semantics and versioning
- Establish governance and audit for deployments and invocations
- Hold product roadmap across engineering pods
- Lead autoscaling strategy
- Manage workload placement and capacity
- Own agent runtime isolation and state persistence
- Own metering quota attribution and packaging
- Own workload and agent runtime orchestration
- Set headroom policy and cost vs latency tradeoff
Perks/Benefits
- Flexible time off program
- Global employee assistance program
- Medical, dental, and vision insurance
- Paid Holidays
- Paid parental leave
Skills/Tech-stack
API Design | API Versioning | API server | Accelerators | Access Control | Admission controllers | Audit Logging | Autoscaling | Backward Compatibility | Batching | CRDs | Container Runtime | Controllers | Custom Resource Definitions | DNS | Device plugins | Driver Plumbing | Error budget | Fairness | GPU | GPU Topology | GPU Topology Awareness | Ingress | Isolation | KV cache | Kubernetes | Kubernetes API | Kubernetes API Server | Kubernetes Scheduler | Load Balancing | Long Running Workloads | MIG | Memory Constraints | Multi-tenancy | Node Pools | Noisy Neighbor | Operators | Private Connectivity | Quantization | Quotas | Resource Limits | Resource Requests | Role-Based Access | Role-Based Access Control | Routing | SLO | Session Affinity | State management | TLS Termination | Topology awareness | VLLM
Education
Related jobs
-
Team Lead, AI Engineering USD 157K-254KAI Search | AKS | Agent workflows | Async Programming | AuthenticationRemote work hybrid flexibilitySenior-level Full TimeUSA - Atlanta, GA; USA - … R1d ago
-
Principal AI Software Engineer, GTM USD 194K-263KAWS | AWS CDK | AWS Lambda | Airflow | Amazon BedrockSenior-level Full TimeUnited States R1d ago
-
Staff Product Manager, Infrastructure & AI Dev Tools (Seattle, WA / West Coast Preferred) USD 169K-242KAI Agents | APIs | As-a-Service | CI/CD | GitOpsGlobal distributed team | Remote-first teamSenior-level Full TimeUnited States R1d ago
-
Principal Applied AI Solutions Architect USD 170K-216KAPI Design | AWS | AWS SageMaker | Amazon EMR | Amazon Redshift401k plan company match | Annual learning and development stipend | Dental insurance | Home office & equipment stipend | Learning and developmentSenior-level Full TimeUS - Remote R1d ago
-
Manager, Software Engineering, Machine Learning USD 170K-277KCaching | Data Modeling | Deep learning | Efficient Fine Tuning | Fine TuningHealth and wellness programs | Time away for employeesMid-level Full TimeMountain View, CA, United States R1d ago
-
Principal Enterprise Data Platform Architect USD 141K-211KAccess Control | Active Directory | Apache Airflow | Apache Arrow | Apache Iceberg401k retirement plan | Inclusive healthcare network | Medical insurance | Paid time off | Remote workSenior-level Full TimeMentor, OH, United States R2d ago
-
API Design | Agentic AI | Artificial Intelligence | Chatbot | Computer use401k employer match | Dental insurance | Equity opportunities | Health insurance | Paid parental leaveSenior-level Full TimeNew York, New York R2d ago
-
Technical Product Manager, AI Engineering & Systems USD 130K-170KAPI Design | Agentic AI | Artificial Intelligence | Chatbot | LLM integration401k matching | Dental insurance | Full-time remote | Health insurance | Paid parental leaveMid-level Full TimeNew York, New York R2d ago
-
Sr Technical Account Manager - East USD 150K-200KAWS | Active Directory | Apache Spark | Azure | Cloud platform401k company match | Commuter benefits | Dental insurance | Employer paid disability coverage | Flexible spending accountsSenior-level Full TimeUnited States, Remote R2d ago
-
Mid-level Full TimeUnited States R2d ago
-
Principal Machine Learning Engineer USD 206K-379KAPI Design | CUDA | Diffusion Models | Distributed Systems | GPU schedulingSenior-level Full TimeSan Jose, United States R3d ago
-
Principal Machine Learning Engineer USD 172K-250KApache Arrow | Apache Spark | Bias Mitigation | DPO | Data-parallelSenior-level Full TimeUnited States R4d ago
-
Head of Fund Analytics & Automation — Credit Fund USD 140K-230KAccess Control | Apache Airflow | Audit Logs | Budgeting | Cost monitoringCompany-paid dental | Company-paid medical | Company-paid vision | Personalized career roadmap | Supportive work environmentExecutive-level Full TimeRemote USA R5d ago
-
Sr. Manager, Data Platform Engineering USD 171K-228KAPI Integration | AWS | Access Control | Amazon S3 | Apache IcebergEmployee resource groups | Free home security system and monitoring | Hybrid work modelSenior-level Full TimeBoston, MA R5d ago
-
Senior-level Full TimeBellevue R5d ago
-
Ansible | Automation | Bare Metal | Bare-metal provisioning | Containerization401k plan | Dental insurance | Health insurance | Paid Holidays | Relocation assistanceMid-level Full TimeBellevue R5d ago
-
AI SME - Applied AI & Machine Learning USD 176K-264KAI Assisted Development | API Design | Agile | Architecture Frameworks | Artificial IntelligenceSenior-level Full TimeRemote - US R5d ago
-
AI Agents | Artificial Intelligence | CUDA | Cost Optimization | Distributed SystemsFull benefit package | Remote workSenior-level Full TimeSan Francisco R5d ago
-
Applied AI Strategist - Senior Manager - Location OPEN USD 150K-343KAI Governance | Access Control | Agent systems | Amazon Web Services | Artificial Intelligence401k plan | Flexible vacation | Hybrid work | Medical and dental coverage | Paid HolidaysSenior-level Full TimeChicago, IL, US, 60606 R6d ago
-
Applied AI Strategist - Manager - Location OPEN USD 128K-235KAWS | Agentic Workflows | Apache Kafka | Apache Spark | CI/CD401k plan | Dental coverage | Flexible vacation policy | Hybrid work model | Medical coverageSenior-level Full TimeChicago, IL, US, 60606 R6d ago
-
Principal Engineer, Database as a Service USD 199K-274KAPIs | Amazon Web Services | As-a-Service | Automation | Cloud NativeSenior-level Full TimeUSA - IL (Remote), United States R6d ago
-
Principal Machine Learning Engineer USD 185K-260KAgentic AI | Airflow | Automated testing | CI/CD | CachingSenior-level Full TimeRemote (United States); United Kingdom R6d ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R7d ago
-
AI Observability | AI Platform | AI Platform Architecture | AI orchestration | APIsFour Days per Week On Site | Remote work one day per weekExecutive-level Full TimeNew Jersey Office - 210 Hudson … R7d ago
-
Apache Iceberg | Catalog Services | Change Data Capture | Compaction | Data CaptureInsurance coverage | Paid time off | Parental leave | Parental leave benefitsSenior-level Full TimeUnited States - Remote R7d ago