Senior Software Engineering Manager – KV Cache Platform
San Francisco - Remote, CA, United States
R
USD 220K-275K Senior-level Full Time
Tasks
- Architect and deliver distributed systems for AI inference
- Define and execute technical strategy and roadmap
- Drive RDMA networking and GPUDirect Storage integration
- Ensure scalability reliability security and operational excellence
- Establish software quality observability automation and testing best practices
- Lead and mentor distributed engineering teams
- Manage engineering execution release planning and bug triage
- Optimize GPU memory and enable distributed caching
- Own production readiness and handle customer escalations
Perks/Benefits
Skills/Tech-stack
AI infrastructure | BlueField DPUs | C++ | Cloud Native | Distributed Caching | Distributed Systems | GPUDirect Storage | Go | HPC | Kubernetes | LLM serving | Linux | NVIDIA TensorRT | NVIDIA TensorRT-LLM | NVIDIA Triton | Networking | Nvidia BlueField DPUs | Nvidia Bluefield | Performance Engineering | Python | RDMA | TensorRT-LLM
Education
N/A
Regions
Countries
States
Related jobs
-
Head of AI Engineering & Enablement USD 224K-256KAPI Integration | Agent Orchestration | Agent systems | Audit trails | Data PrivacyHealthcare benefits | Remote work | Work from home supportExecutive-level Full TimeUnited States - Remote R1d ago
-
VP of Research, Machine Learning (ML), Artificial Intelligence (AI) Required, Work From Home A USD 250K-300KAgent systems | Artificial Intelligence | GPU | JAX | Knowledge DistillationDental insurance | Medical insurance | Paid time off | Remote work | Savings plan optionsExecutive-level Full TimeSan Francisco, CA, United States R1d ago
-
Principal Data Analyst, Enterprise Data Solutions USD 148K-185KAPI | DBT | Data Aggregation | Data Governance | Data ModelingCommuting cost coverage | Daily free lunch | Employee resource groups | Flexible-hybrid work | Meditation and fitness appsSenior-level Full TimeBoston, Massachusetts, United States R1d ago
-
Technical Program Manager - Release Management USD 170K-225KAgile | CI/CD | DevOps | Development Lifecycle | DockerCoworking stipend | Flexible savings accounts | Flexible work location | Health coverage | Remote workMid-level Full TimeEast Coast Remote; US Remote R1d ago
-
Manager, Advanced Data Analytics and Insights USD 80K-153KAdobe Analytics | Amazon Athena | Big Data | Power BI | PythonMid-level Full Time900 Salem St, Smithfield RI, United … R1d ago
-
VP, Global Analytics USD 114K-210KAI Automation | Actuarial Science | Alteryx | Capital modeling | Databricks401k savings | Employee assistance programs | Health and welfare benefits | Retirement programs | Tuition assistanceExecutive-level Full TimePhiladelphia - South 17th, United States R1d ago
-
Manager, Predictive Modeling and Machine Learning USD 158K-170KCausal Inference | Deep learning | Ensemble learning | Generative AI | Language Processing401k match | Adoption Assistance | Great place to work | Medical, dental, and vision insurance | Parental leaveMid-level Full TimeSilver Triangle Building, United States R1d ago
-
Sr. Product Analytics Manager (Remote) USD 190K-213KA/B | A/B Testing | Apache Airflow | B testing | Churn analysis401k | 401k plan access | Employee assistance program | Health benefits | Home office stipendSenior-level Full TimeRemote - United States R1d ago
-
Manager, Data Science USD 160K-195KA/B | A/B Testing | AWS | Azure | B testing401k match | Company events and outings | Employee discounts | Health, dental, vision coverage | Paid sabbaticalMid-level Full TimeBrooklyn, NY (Rent the Runway HQ) R1d ago
-
Product Manager - SRE and Data Engineer USD 200K-220KBigQuery | Business Intelligence | CCPA | Cloud IAM | Cloud platformFlexible paid time off | Health and wellness stipend | Home office stipend | Learning stipend | MacBook Pro providedMid-level Full TimeUnited States R2d ago
-
Associate Director, Data Engineering (Remote) USD 130K-140KAutomated testing | CI/CD | Continuous Delivery | Continuous integration | Data Governance401k company match | Career growth opportunities | Company holidays | Generous PTO | Medical/Dental/Vision insuranceMid-level Full TimePortland R2d ago
-
Senior Manager, Healthcare Analytics USD 107K-199KCause analysis | Change Management | Data Governance | Data Management | Data Mining401k | Hybrid work options | Paid time off | Remote work options | Stock purchase planSenior-level Full TimeRemote-FL, United States R2d ago
-
Data Engineering Manager USD 172K-254KArtificial Intelligence | Automated testing | CI/CD | Data Architecture | Data Pipelines401k matching | Childcare FSA | Employee stock purchase plan | Family planning support | HolidaysMid-level Full TimeSan Francisco or Remote (U.S.) R2d ago
-
Financial Crimes Compliance Modeling & Analytics Manager USD 149K-208KAML Compliance | BSA/AML | Data analytics | False Positive | False positive reductionMid-level Full TimeSan Francisco, CA, New York, NY, … R2d ago
-
Data Science & Engineering Manager (2262) USD 185K-225KAlgorithms | Compliance | Data Analysis | Data Quality | Data Structures401k | Dependent care | Discounted tickets | Entertainment Perks Program | Flexible work scheduleMid-level Full TimeNew York, New York, United States R3d ago
-
Attribution Modeling | Brand Analytics | Cloud Computing | Conversion Tracking | Conversion measurementAnnual product gift card | Company-matched RRSP | Dedicated break period | Employer paid medical dental and vision | Family building and fertility supportSenior-level Full TimeCanada R3d ago
-
Manager, Data Analytics USD 158K-224KA/B | A/B Testing | Amazon Redshift | Amazon S3 | AmplitudeEquity | Healthcare coverage | LifeTime Membership | Parental leave | Retirement savings matchMid-level Full TimeSanta Monica, California, United States R3d ago
-
Senior Manager, Enterprise Data Platform USD 196K-245KAIOps | Automated testing | CI/CD | DBT | Data GovernanceSenior-level Full TimeRemote - USA R4d ago
-
AWS | Apache Flink | Apache Spark | Architecture Decision | Architecture Decision RecordsAccess to modern AI development tools | Equity and long term incentive programs | Flexible work environment | Fully remote within Canada | Health dental and wellness benefitsMid-level Full TimeCanada R4d ago
-
Data Science Research Manager - Accenture Research USD 80K-266KA2A | Agent Orchestration | Agentic AI | BigQuery | Cloud Computing401k plan | Bonus opportunities | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeNew York, One Manhattan West, Corp, … R4d ago
-
Analytics | Credit Risk | Data Engineering | Data Governance | Model DevelopmentCareer development opportunities | Entrepreneurial environment | High degree of individual responsibilitySenior-level Full TimeChicago, Illinois, United States - Remote R4d ago
-
Data Manager – AI Development USD 80K-120KDashboards | Data Annotation | Data Governance | Data Management | Data Operations401k plan | Accident insurance | Dental insurance | Disability insurance | Life insuranceMid-level Full TimeRemote, United States R4d ago
-
AWS | Access Management | Agent Development | BigQuery | CI/CD401k | Disability insurance | EAP Resources | Holidays | Life insuranceMid-level Full TimeSeattle WA, United States R4d ago
-
Backtesting | Barra | Data Infrastructure | Data Quality | Derivatives pricingEducational assistance | Emotional well-being support | Health care coverage | Paid time off | Parental leaveSenior-level Full Time499 Washington Blvd., Jersey City NJ, … R5d ago
-
AI Agents | APIs | Application Programming | Application Programming Interfaces | CI/CDFlexible work location | Professional development opportunities | Remote-first work environmentSenior-level Full TimeUnited States R7d ago