Tech Lead Manager, Inference
Tasks
- Architect and build serving stack
- Build scheduling and queueing systems
- Debug production incidents
- Integrate serving with online reinforcement learning
- Lead grow and develop inference engineering team
- Manage and optimize inference workloads
- Own SLOs and unit economics
- Own hiring coaching and career growth
- Partner with research to ship model architectures
- Set technical roadmap for serving platform
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | Cache Management | Caching | Continuous batching | Deployment Pipelines | Distributed Systems | Infiniband | KV cache | KV-cache management | Kubernetes | NVLink | Observability | Online Reinforcement Learning | Pipeline parallelism | PyTorch | Python | Quantization | RDMA | Ray | Reinforcement Learning | Request Routing | SGLang | Scheduling | Speculative decoding | Tensor Parallelism | TensorRT-LLM | VLLM
Education
N/A
Roles
Related jobs
-
Head of Engineering USD 200K-280KAWS | Data Processing | Distributed Systems | FFmpeg | Machine Learning401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsExecutive-level Full TimeSan Francisco, CA, US1d ago
-
Data Solutions Analyst USD 100K-160KApache Spark | Big Data | Dashboards | Data Streaming | Data WarehousingMid-level Full TimeSan Mateo, CA, US1d ago
-
Data Solutions Analyst USD 100K-160KApache Spark | Big Data | Data Warehousing | Data integration | GrafanaMid-level Full TimeSan Francisco, CA, US1d ago
-
Engineering Manager, Data Residency and Fast Compliance USD 207K-300KAutomation | Batch Processing | Cloud Computing | Cloud platform | ComplianceSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Agent systems | Artificial Intelligence | Cloud platform | Context engineering | Data GovernanceSenior-level Full TimeSan Francisco, CA, USA; Sunnyvale, CA, …1d ago
-
AI Deployment Lead – Devin AI | Onsite USD 44K-154KAPI Design | Access Management | Agent Orchestration | Agentic Systems | CI/CD401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States1d ago
-
PIIM Analytics Lead USD 105K-160KBigQuery | DAX | Data Governance | Data Quality | Data VisualizationDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeClay, NY, US1d ago
-
Data Management | Data Quality | Databases | Knowledge graphs | Machine LearningSenior-level Full TimeGarching bei München (Munich), DE, 857481d ago
-
Manager, Software Engineering, Machine Learning USD 170K-277KCaching | Data Modeling | Deep learning | Fine Tuning | GPUHealth and wellness programs | Time away from workMid-level Full TimeMountain View, CA, United States1d ago
-
Power BI Consultant USD 80K-110KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks401k plan | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeWashington, United States1d ago
-
APIs | AWS CloudWatch | AWS Kinesis | Agile | Amazon DynamoDB401k savings plan | Adoption benefits | Career development | Disability benefits | Employee assistance programSenior-level Full TimeIrving, Texas, United States1d ago
-
AWS Glue | AWS Glue Catalog | AWS S3 | Apache Atlas | Apache FlinkSenior-level Full TimeCupertino1d ago
-
AWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon RedshiftSenior-level Full TimeCupertino1d ago
-
AWS | Adversarial evaluation | C++ | Cloud platform | Content ModerationSenior-level Full TimeSan Francisco Bay Area1d ago
-
API Design | AWS | AWS CloudWatch | AWS Lambda | AWS Step FunctionsBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planSenior-level Full TimePlano, TX, United States1d ago
-
Engineering Manager, Data Platform USD 220K-300KApache Druid | Apache Pinot | ClickHouse | Data Storage | Distributed SystemsSenior-level Full TimeSan Francisco, California1d ago
-
API Design | AWS | Access Control | Amazon S3 | Apache AirflowEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNashville, TN1d ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R1d ago
-
Sr. Staff, Technical Program Management USD 222K-305KArtificial Intelligence | Autonomous Agents | Change Management | Cloud infrastructure | Data analyticsSenior-level Full TimeMountain View, California1d ago
-
Autonomy | C++ | CPU GPU | CPU GPU Debugging | DDS401k | Healthcare | Paid Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Artificial Intelligence | Business Intelligence | Data Governance | KPI Dashboards | Machine LearningExecutive-level Full TimeUnited States R1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Hive | Apache HudiContinuing education | Dental insurance | FSA | HSA | Health insuranceSenior-level Full TimeRochester, MN, United States R1d ago
-
Big Data Lead USD 100K-150KAWS | Apache Storm | Azure | Cassandra | Cloud platformOnsite flexibility | Work-life balanceSenior-level Full TimeUnited States2d ago
-
Engineering Manager, Data Platform USD 125K-150KAmazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | CI/CD401k company match | Cell phone stipend | Commuter benefits | Daily meals allowance | Employer HSA contributionsMid-level Full TimeSan Francisco, CA - US2d ago
-
Senior Manager, Data Engineering USD 190K-215KAccess Controls | Airbyte | Amazon Redshift | Apache Airflow | Automation401k employer match | Accident insurance | Commuter benefits | Disability coverage | Employee assistance programSenior-level Full TimeUnited States R2d ago