Software Development Manager, LLM Inference Model Enablement, Neuron SDK
Tasks
- Build distributed inference pipelines
- Drive inference automation
- Enhance inference usability and quality
- Improve model enablement speed and experience
- Lead engineering team
- Maintain engineering quality and operations
- Manage project plans and delivery commitments
- Manage resources and staffing
- Mentor and coach engineers
- Onboard and optimize open source and customer LLMs
- Optimize LLM inference performance
- Optimize inference infrastructure and tooling
- Oversee day to day engineering activities
- Report status to management
Perks/Benefits
- 401k matching
- Employee assistance program
- Flexible spending accounts
- Health insurance
- Mental health support
- Paid time off
- Parental leave
Skills/Tech-stack
Amazon Trainium | Automation | Collectives | Design Patterns | Distributed inference | Inference Optimization | LLM | Model Architecture | Model Performance Optimization | Model performance | Neuron SDK | Neuron compiler | Performance optimization | PyTorch | Python | Runtime | System Reliability | System Scalability
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Associate Director, Applied AI Engineering-PxE Talent USD 130K-268K.NET | A/B | A/B Testing | AI Agent | AI agent orchestrationMid-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …4h ago
-
Algorithms | C++ | CUDA | Computer Systems | Continuous batchingEntry-level Full TimeSan Jose, California, United States6h ago
-
Staff Data Scientist Manager, Search AI Overview USD 207K-300KData Analysis | Data measurement | GenAI | Machine Learning | PythonSenior-level Full TimeMountain View, CA, USA7h ago
-
AI Research Intern - Optexity USD 100K-129KBenchmarking | Language Models | Language Processing | Large Language Models | Machine LearningCompute and data provided | Direct founder access | Visa sponsorshipEntry-level InternshipSan Francisco R14h ago
-
AI Research Scientist - Optexity USD 150K-250KBenchmarking | Computer use | Data pipeline | Deep learning | Language ModelsVisa sponsorshipMid-level Full TimeSan Francisco Bay Area15h ago
-
C++ | Computer Vision | Deep learning | Information Retrieval | Java401k matching | Adoption reimbursement | Flexible spending accounts | Health insurance | Paid time offMid-level Full TimeSunnyvale, California, USA18h ago
-
AI/ML Software Developer USD 137K-167KAlgorithms | Data Structures | Java | JavaScript | LLM401k | Community outreach initiatives | Commuter benefits | Dental insurance | Federal HolidaysSenior-level Full TimeRedwood City, California, United States18h ago
-
Praktikum AI Solutions & Macro Analytics (m/f/d) USD 52K-61KFlask | LLM | Langchain | Language Processing | Natural LanguageFlat hierarchies | Open company culture | Professional development opportunitiesEntry-level Full Time InternshipMünchen, Bayern, DE18h ago
-
Marketing Analytics Manager USD 92K-137KAPI Integration | Attribution | CRM | Data Governance | Data PipelinesMid-level Full TimeBoston, MA19h ago
-
Applied AI Researcher, Agent Systems & Evaluation USD 193K-352KArtificial Intelligence | Evaluation Data | Experiment design | Fine Tuning | Human FeedbackDirect access to compute | Hands on research with production data | Work with CEO | Work with engineering leadershipEntry-level Full TimeMountain View, California (HQ)20h ago
-
Senior-level Full TimeAustin, Texas20h ago
-
Applied AI Engineer, Office of the CEO USD 140K-170KAgentic Orchestration | Business Intelligence | Data Analysis | Data Governance | Data ModelingMid-level Full TimeNew York, NY21h ago
-
Senior AI Engineer USD 144K-236KA/B | A/B Testing | B testing | Classification | Data MiningFlexible work arrangement | Health and wellness programs | Time off for employeesSenior-level Full TimeMountain View, CA, United States R21h ago
-
Manager, Applied Science USD 300K-390KAWS | Experimentation | Heuristics | Huggingface | LLM401k company match | Flexible PTO | Flexible spending accounts | Medical/Dental/Vision | Teladoc HealthMid-level Full TimeNew York City, New York22h ago
-
Applied AI Architect, People & Culture USD 117K-167KAI Agents | Artificial Intelligence | Automation | Change Management | ClaudeEducation reimbursement | Health plans | Hybrid work model | Parental leave | Retirement optionsSenior-level Full TimeSanta Clara, California, USA R22h ago
-
Multimodal AI Researcher USD 166K-300KComputer Graphics | Computer Vision | Deep learning | Diffusion Models | Generative AIMid-level Full TimeSunnyvale22h ago
-
AI Engineer USD 121K-140KAPIs | Azure | Azure OpenAI | Embeddings | Event Driven401k matching | 529 College Savings Plan | Dental insurance | Health insurance | Health savings accountMid-level Full TimeUnited States23h ago
-
Senior Engineering Manager - Enzyme USD 228K-317KApache Spark | Database systems | Distributed Systems | Performance optimization | Quality AssuranceSenior-level Full TimeMountain View, California23h ago
-
Global Contact Center Reporting and Analytics Manager USD 139K-205KAmazon QuickSight | Cloud platform | Data Analysis | Data Engineering | Data VisualizationEmployee resource groups | Flexible family care | Health insurance | Paid Holidays | Paid time offMid-level Full TimeAllen Park, MI, United States R23h ago
-
Executive-level Full TimeRemote, United States1d ago
-
AI/ML Solutions Manager of Software Engineering USD 160K-201KAI Platform | AWS CloudFormation | AWS SageMaker | Agile | AirflowBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planMid-level Full TimePalo Alto, CA, United States1d ago
-
AI analytics | AWS | Agile | Automation | AzureMid-level Full TimeDallas, TX, United States1d ago
-
Data Analytics Manager USD 105K-135KAPIs | Analytics | Anomaly Detection | Automation | DashboardingHybrid work | Inclusion and collaboration culture | Onsite three days per weekMid-level Full TimeMadhive HQ (New York, NY) R1d ago
-
Senior-level Full TimeAuburn Hills, MI, United States1d ago
-
CTMS | Clinical Trial Metrics | Clinical trial | Competitive Intelligence | Data VisualizationAnnual bonus | Comprehensive benefits | Equity participationMid-level Full TimeWatertown, MA1d ago