Engineering Manager, Model Inference
Tasks
- Architect and scale inference infrastructure
- Benchmark and eliminate inference bottlenecks
- Collaborate with ML research on model optimization quantization deployment
- Define inference system technical direction
- Develop AI inference APIs
- Ensure reliability efficiency observability
- Establish engineering standards and operational processes
- Lead and grow AI inference engineering team
- Lead incident response
- Optimize batching throughput latency GPU utilization
- Plan and execute cross-functional projects
- Recruit, mentor, and develop engineering talent
Perks/Benefits
- 401k matching
- Commuter benefits
- Flexible PTO
- Flexible spending accounts
- Generous time off
- HSA contribution
- Lifestyle Wallet
- Mental health support
- Paid parental leave
- Personal device allowance
- Sabbatical leave
- Therapy and coaching
Skills/Tech-stack
APIs | Attention Mechanism | Batching | Distributed Systems | Docker | Expert parallelism | FlashAttention | GPU Performance | GPU performance analysis | Grouped Query Attention | Incident Response | Kernel Fusion | Kubernetes | Multi-head attention | Observability | Performance Analysis | Pipeline parallelism | PyTorch | Quantization | Real Time | Real-time Systems | Tensor Parallelism | TensorFlow | TensorRT | Time Systems | Transformer | VLLM
Education
Regions
Countries
States
Related jobs
-
Manager, AI Engineering USD 122K-152KAI Act | AI RMF | Agent Frameworks | Bias Testing | Data Lineage401k match | Business travel coverage | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimePrinceton, New Jersey, United States; San … R13h ago
-
Senior Lead AI Software Engineer USD 216K-324KAgentic Workflows | Alerting | Architectural patterns | Coding assistants | Cost OptimizationSenior-level Full TimeBoston, MA22h ago
-
Engineering Manager - Embedded RTOS Platforms USD 130K-190KAgile | Automated testing | Backlog Management | CI/CD | Continuous DeliveryHealth and welfare benefits | Paid time off | Retirement benefits | Unpaid time offMid-level Full TimeRaleigh, North Carolina, USA, 276151d ago
-
Senior Manager-Software Engineering - EDAI USD 123K-215KAPI Design | Agile | Code review | Data Governance | Data PrivacySenior-level Full TimeSunrise, FL, United States1d ago
-
Sr. Manager Platform Engineering USD 156K-200KBMC | Bring-up | CloudFormation | Distributed Systems | GolangRemote workSenior-level Full TimeRaleigh, NC, United States R1d ago
-
Machine Learning Engineer USD 150K-260KAWS | Agile | Algorithms | Apache Spark | Artificial IntelligenceSenior-level Full Time420 National Business Parkway, Jessup, MD, …1d ago
-
Agentic Architectures | Agile | CI/CD | Cloud infrastructure | Continuous Delivery401k | Employee discount | Health benefits | Long-term disability | Paid national holidaysSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN …1d ago
-
Sr. Director, Embedded Engineering USD 228K-377KAutomated testing | BSP Development | Bluetooth Low Energy | CI/CD | Code Signing401k employer match | Annual bonus | Dental insurance | Employee discounts | Employee resource groupsSenior-level Full TimeVIRTUAL, WA, US, 00000 R1d ago
-
API Design | API Testing | C++ | Caching | CheckpointingSenior-level Full TimeSan Francisco1d ago
-
AWS | Apache Spark | Azure | Cloud Architecture | Data WarehousingTravel up to 30%Senior-level Full TimeRemote - California; Remote - Colorado; … R1d ago
-
Manager of Software Engineering: Data Analytics USD 169K-201KAWS | Agile | Apache Airflow | Application Resiliency | AutomationBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersMid-level Full TimeNew York, NY, United States1d ago
-
Manager, Data Engineering USD 205K-261KAWS | AWS Lambda | Airflow | Amazon Kinesis | Amazon RedshiftCompany retreats | Wellness programMid-level Full TimeNew York, New York1d ago
-
Senior AI Engineering USD 150K-275KADLS | AI Search | Agentic Workflows | Azure AI | Azure AI SearchSenior-level Full TimePasadena, CA, United States2d ago
-
Access Management | BigQuery | CI/CD | Cloud Functions | Cloud RunOn-site collaborationSenior-level Full TimeAustin, TX, United States2d ago
-
Head of Data Platform Engineering, MD USD 170K-267KAWS | Airflow | Automated testing | Azure | Azure DataEmployee assistance program | Family care support | Flexible work/life support | Insurance coverage | Long-term disability insuranceExecutive-level Full TimeCR1 - 700 District, United States2d ago
-
AWS | Apache Spark | CI/CD | Causal Inference | CondaMid-level Full TimeMcLean, VA, United States2d ago
-
Lead Machine Learning Engineer (Manager IC) USD 179K-225KAI Governance | AWS | Agentic AI | Azure | BedrockSenior-level Full TimeCambridge, MA, United States2d ago
-
AVP, AI Engineering & Delivery USD 156K-290KAIOps | API Integration | Artificial Intelligence | Automation | DeploymentExecutive-level Full TimeEdina, MN 55435, United States2d ago
-
Global Customer Data Platform Lead USD 137K-235KAPIs | Attribution | Audience Management | Azure | Azure EventCross-functional collaboration | Inclusive work environmentSenior-level Full TimeUS244 FL Palm Beach Gardens - …2d ago
-
Manager, Data Engineering USD 96K-135KAWS Athena | AWS Glue | AWS S3 | Batch Processing | CI/CDHybrid work | Visa sponsorshipMid-level Full TimeUSA - 2 West Liberty Boulevard, …2d ago
-
API Integration | APIs | Azure Synapse | Data Governance | Data ModelingEducational assistance | Flexible vacation policy | Remote work | Travel opportunitiesSenior-level Full TimeAny city, TX, US, 999992d ago
-
Sr Manager, Site Reliability (SASE) USD 182K-294KAWS | Anomaly Detection | Azure | CI/CD | Canary DeploymentSenior-level Full TimeSanta Clara, CA2d ago
-
Director SW Engineering (ML Engineering and Platform) USD 232K-320KAI Safety | Apache Spark | Architecture | Big Data | Cloud ComputingExecutive-level Full TimeSanta Clara, CA2d ago
-
AI Research Manager - Machine Learning USD 190K-287KCausal Inference | Contrastive Learning | Deep learning | Distributed Systems | Embeddings401k | Dental and vision insurance | Extended maternity leave | Extended paternity leave | Flexible spending accountMid-level Full TimeUSA, Palo Alto4d ago
-
Director, Data Platform & Operations USD 133K-172KAmazon Web Services | Apache Airflow | Automation | Azure | Azure Service401k retirement match | Company paid life insurance | Company-paid disability insurance | Flexible work options | Health savings accountsExecutive-level Full TimeSaint Louis, Missouri, United States4d ago