Tech Lead Manager, Inference
Tasks
- Architect and build serving stack
- Build scheduling and queueing systems
- Debug production incidents
- Integrate serving with online reinforcement learning
- Lead grow and develop inference engineering team
- Manage and optimize inference workloads
- Own SLOs and unit economics
- Own hiring coaching and career growth
- Partner with research to ship model architectures
- Set technical roadmap for serving platform
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | Cache Management | Caching | Continuous batching | Deployment Pipelines | Distributed Systems | Infiniband | KV cache | KV-cache management | Kubernetes | NVLink | Observability | Online Reinforcement Learning | Pipeline parallelism | PyTorch | Python | Quantization | RDMA | Ray | Reinforcement Learning | Request Routing | SGLang | Scheduling | Speculative decoding | Tensor Parallelism | TensorRT-LLM | VLLM
Education
N/A
Roles
Related jobs
-
Alteryx | Auditing Standards | Automation Anywhere | Business Intelligence | Continuous AuditingEntry-level Full TimeMiami, FL, United States4h ago
-
AI Computing | AI Systems Roadmap | AI infrastructure | AI systems | Cross-functionalSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Analytics Lead, Safety Reporting USD 104K-131KDashboarding | Data Documentation | Data Quality | Data Reconciliation | Data analytics401k match | Child care benefits | Commuter benefits | Dental insurance | Family building benefitsSenior-level Full TimeSan Francisco, CA R21h ago
-
E&C Segment Applied AI Lead USD 145K-180KClaude Code | Claude Cowork | Data Pipelines | Document processing | LLM401k match | AD and D insurance | Accident and illness coverage | Business travel | Company-Paid HolidaysSenior-level Full TimeUnited States21h ago
-
I&M Segment Applied AI Lead USD 145K-180KAPI Integration | Agentic AI | CMMS | Claude Code | Claude Cowork401k match | AD and D insurance | Business travel reimbursement | Dental insurance | Disability insuranceSenior-level Full TimeSan Jose, CA, US21h ago
-
Senior Manager, Data Engineering USD 175K-220KAWS | Apache Iceberg | Apache Spark | Argo | CI/CDContinuous learning | Hybrid work | Leadership development | Professional certifications | Quarterly perks programSenior-level Full TimeAlpharetta, GA22h ago
-
Analytics Manager USD 100K-125KBusiness Strategy | Consulting | Data Analysis | Data Modeling | Data VisualizationMid-level Full TimeJersey City, New Jersey, United States22h ago
-
AWS QuickSight | DBT | Data Analysis | Data Modeling | Data Quality401k benefits | Baby bonding leave | Commuter benefits | Dental insurance | Disability insuranceMid-level Full TimeUS Remote R23h ago
-
VP, Portfolio Analytics & Reporting USD 300K-405KAttribution | Capital reporting | Cash Flow | Cash Flow Reporting | Commitment Pacing401k match | Casual dress code | Childcare services | Community happy hours | Free catered foodExecutive-level Full TimeNew York, NY R1d ago
-
AWS | Ansible | Automation | BAM | Bioinformatics401k match | Commuter benefits | Employee referral program | Fertility care benefits | Free employee genetic testingSenior-level Full TimeUS Remote R1d ago
-
Data Scientist Lead - Customer Analytics USD 150K-195KA/B | A/B Testing | B testing | Data Visualization | Experimental DesignBackup childcare | Financial coaching | Health care | Mental health support | Retirement savings planSenior-level Full TimeOH, United States1d ago
-
Associate, Process Optimization USD 87K-114KData Analysis | Data metrics | Excel | Lean | Process Improvement401k plan | Life and disability insurance | Medical, dental, and vision insurance | Paid Holidays | Paid parental leaveMid-level Full TimeTempe, Arizona, United States R1d ago
-
Manager, Account Sales Analytics and Reporting USD 83K-133KDashboarding | Data Governance | Data Quality | Data Reconciliation | Data Validation401k plan | Childcare discounts | Commuter benefits | Dental insurance | Disability insuranceMid-level Full TimeBethesda, MD, United States R1d ago
-
Sr Manager, Data Engineering USD 135K-170KAgile | Amazon Web Services | Azure | Cloud Computing | Cost OptimizationSenior-level Full TimeClearwater, FL, United States1d ago
-
Associate Director of Analytics USD 110K-163KBusiness Intelligence | Cluster Analysis | Data Mining | Data Modeling | Data VisualizationMid-level Full TimeNashville, Tennessee, United States1d ago
-
Senior Manager, BizOps & Analytics USD 180K-230KClickHouse | Excel | GitHub | Jupyter | Metabase401k matching | Dental insurance | Health insurance | Paid parental leave | Paid time offSenior-level Full TimeNew York, New York R1d ago
-
Manager, BizOps & Analytics USD 160K-180KClickHouse | Data Analysis | Excel | Experiment design | GitHub401k match | Dental insurance | Health insurance | Paid parental leave | Paid time offMid-level Full TimeNew York, New York R1d ago
-
Manager, BizOps & Analytics USD 160K-180KClickHouse | Excel | GitHub | Jupyter | Metabase401k matching | Dental insurance | Full remote work | Health insurance | Paid parental leaveMid-level Full TimeLos Angeles, California R1d ago
-
Sr Technical Account Manager - West USD 150K-200KAWS | Active Directory | Apache Spark | Azure | Cloud platform401k match | Commuter benefits | Dental insurance | Employer paid disability coverage | Flexible spending accountsSenior-level Full TimeUnited States, Remote R1d ago
-
Associate Director, Statistical Programming USD 166K-242KADaM | CDISC | Data analytics | Development Life Cycle | ECOA401k plan | Dental insurance | Health and wellness program | Life insurance | Medical insuranceMid-level Full TimeBoston, MA R1d ago
-
CRM Analytics Lead - Vice President USD 170K-197KAlteryx | Data Visualization | Excel | Pivot Tables | Power BIBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planSenior-level Full TimeNew York, NY, United States1d ago
-
Data & Analytics Engineering Manager USD 185K-200KA/B | A/B Testing | AI tools | Agile | Alert triageSenior-level Full TimeNew York, NY R1d ago
-
AWS | Automated testing | Big Data | Cloud Native | Code reviewSenior-level Full TimePlano, TX, United States1d ago
-
Junior Project Manager/Analytics Developer USD 65K-100KPower Automate | Power BI | Power Query | Powershell | Predictive AnalyticsEntry-level Full TimeFalls Church, VA, United States1d ago
-
Lead AI Engineer-Machine Learning USD 100K-115KAWS | Agile | Azure | CI/CD | Computer Vision401k match | Dental insurance | Disability insurance | Growth opportunities | HolidaysSenior-level Full TimeParsippany, NJ, United States1d ago