Inference Systems Performance Architect
San Jose, California, United States
USD 245K-325K Senior-level Full Time
Tasks
- Build workload capture and benchmarking
- Create end to end profiling tooling
- Define inference systems performance strategy
- Develop performance modeling and simulation
- Lead cross team performance trade off decisions
- Localize bottlenecks across host accelerator and fabric
- Mentor senior engineers
- Represent performance story to customers and partners
- Resolve ambiguous cross boundary performance challenges
Perks/Benefits
- Counseling services
- Dental insurance
- Employee assistance program
- Gym membership
- Health insurance
- Health savings account
- One Medical membership
- Vision insurance
- Wellbeing subscription
Skills/Tech-stack
Benchmarking | Bottleneck analysis | Capacity Planning | Continuous batching | Distributed Systems | KV cache | LLM Inference | Language Model | Large Language Model | Machine Learning | Performance Engineering | Profiling | Prompt Caching | Service Level | Service-Level Objectives | Simulation Modeling | Tail Latency | Workload modeling
Education
N/A
Roles
AI | AI Performance Architect | Architect | Performance Architect
Regions
Countries
States
Cities
Related jobs
-
Manager, AI Engineering USD 219K-351KAI architecture | API Integration | Agentic Systems | Artificial Intelligence | AutomationIn-person onboarding | Remote work flexibilityMid-level Full TimeRemote - USA R9h ago
-
Principal, AI Solutions USD 145K-200KAI Agents | Artificial Intelligence | Business Analysis | Change Management | Enterprise Architecture401k match | Flexible spending account | Health benefits | Long-term disability | Professional growth opportunitiesSenior-level Full TimeUS-Remote R19h ago
-
Agentic Workflows | Automation | Data integration | Enterprise Integration | GenAIMedical/Dental/Vision insurance | Unlimited PTO | Wellness stipendMid-level Full TimeSan Francisco, California, United States1d ago
-
AWS | Adversarial Machine Learning | Azure | Bias and fairness | C++401k profit sharing | Dental insurance | Education reimbursement | Employee referral incentive | Flexible spending accountsSenior-level Full TimeHuntsville, Alabama, United States1d ago
-
Consultant (LLM/AI Skillset) USD 110K-160KAPI Development | Agile | Language Models | Large Language Models | Machine LearningMid-level Full TimeDallas, Texas, United States1d ago
-
Senior / Principal Business Impact Lead – Manufacturing & Supply Chain (AI Solution Architect) - NYC USD 140K-175KAI | Analytics | Data collection | Data readiness | DeploymentContinuous learning | Freedom to experiment | Hybrid work | Open feedback culture | Team off-sitesMid-level Full TimeUS (New York)1d ago
-
AI Fine-tuning | Analytics | Artificial Intelligence | Data collection | Data readinessHybrid work in NYC office | Learning culture | Performance-based rewards | Team off-sitesMid-level Full TimeUS (New York)1d ago
-
Agent systems | Enterprise Data | Fine Tuning | LLM Fine-tuning | Language ModelsRemote workSenior-level Full TimeAustin R1d ago
-
Enterprise AI Solutions Consultant USD 110K-150KAccount Management | Artificial Intelligence | Consultative selling | Data Annotation | Data SecurityMid-level Full TimeNew York City, New York, United …1d ago
-
Enterprise AI Solutions Consultant USD 110K-150KArtificial Intelligence | Consultative selling | Data Annotation | Data Security | Enterprise SalesMid-level Full TimeNew York City, New York, United …1d ago
-
AI Software Engineer, Systems ML - Wearables AI USD 146K-208KBias Mitigation | C plus plus | C# | Deep learning | Device Machine LearningSenior-level Full TimeSeattle, WA2d ago
-
Principal Engineer, Data Center Systems Architecture USD 256K-356KArchitecture tradeoffs | Artificial Intelligence | Cross Disciplinary Systems Integration | Cross-disciplinary | Cross-disciplinary systemsSenior-level Full TimeAtlanta, GA, USA2d ago
-
Technical Product Manager, AI Systems USD 195K-305KAlgorithms | Cost Optimization | Data Pipelines | Data Structures | Experiment designMid-level Full TimeUnited States R2d ago
-
AI Intern USD 44K-50KData Analysis | Data Preparation | Data Preprocessing | Data Validation | Data cleaningMentorship | Professional developmentEntry-level InternshipBaton Rouge, Louisiana2d ago
-
Senior-level Full TimeNew York, NY, United States2d ago
-
Specialist Solutions Architect - AI/ML USD 180K-247KAI guardrails | AWS | Agent Orchestration | Artificial Intelligence | AzureSenior-level Full TimeUnited States2d ago
-
Artificial Intelligence | Data Cleansing | Data Enrichment | Data Governance | Data PrivacyFlexible work arrangements | Health insurance | Paid time off | Retirement planExecutive-level Full TimeSan Jose, CA, United States2d ago
-
Junior AI Engineer (Pittsburgh, PA) USD 74K-106KAI Governance | Agentic AI | Amazon Web Services | Azure OpenAI | Cloud Computing401k match | Bonus eligible | Employee stock options plan | Medical/Dental/Vision | Paid time offEntry-level Full TimePittsburgh, PA, United States2d ago
-
Junior AI Engineer - Onsite USD 54K-60KAPI | Anthropic | Docker | JSON | JavaScriptOnsite work locationEntry-level Full TimeGrand Rapids, Michigan2d ago
-
AI Engineer - On Site USD 65K-87KAPI | Automation | Billing automation | Compliance Automation | ConnectwiseEntry-level Full TimeGrand Rapids, Michigan2d ago
-
Senior Lead Software Engineer- AI/ML Platform USD 176K-215KAPI Development | AWS | Access Control | Automated testing | CI PipelineBackup childcare | Financial coaching | Health care | Mental health support | Retirement savings planSenior-level Full TimeWilmington, DE, United States2d ago
-
Senior Computer Vision Architect USD 170K-300KCamera Calibration | Computer Vision | Computer Vision Transformers | Foundation Models | Human RecognitionSenior-level Full TimeSunnyvale2d ago
-
Real-Time Computer Vision Architect USD 170K-300KCalibration | Color correction | Computer Camera | Computer Vision | DebuggingSenior-level Full TimeSunnyvale2d ago
-
API Integration | Agentic Workflows | Artificial Intelligence | Autogen | Code AutomationSenior-level Full TimeNorthbrook, IL, United States2d ago
-
AI Solution Engineer USD 89K-209KAI Evaluation | API Integration | Agent Orchestration | Artificial Intelligence | Code platformsSenior-level Full TimeUnited States2d ago