Staff Applied AI Inference Engineer
Tasks
- Deploy low latency high throughput inference
- Draft feature and technical requirement documents
- Implement request routing for serving
- Optimize CUDA kernels
- Optimize model-serving architectures
- Own inference stack end to end
- Profile kernel level performance
- Profile latency and cost bottlenecks
- Run proofs of concept and experiments
- Support production inference and monitoring
- Tailor deployments to customer models and constraints
- Tune prefill and decode disaggregation
Perks/Benefits
- Commuter benefits
- Dental insurance
- Health insurance
- Life insurance
- Long-term disability
- Mental health support
- Paid Holidays
- Paid parental leave
- Paid time off
- Professional development
- Short-term disability
- Tuition reimbursement
- Vision insurance
- Volunteer time off
Skills/Tech-stack
C++ | CUDA | Docker | High Throughput | Kubernetes | Language Models | Large Language Models | Low Latency | Machine Learning | Profiling | Python | SGLang | VLLM
Education
Related jobs
-
AI Software Engineer USD 91K-169KAgile | Bash | C++ | Cloud Computing | Containers401k match | Dental insurance | Education assistance | Employee assistance program | Flexible schedulesMid-level Full TimeManassas, VA, US14h ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R17h ago
-
Enterprise Deployment Strategist (AI/ML Product) USD 150K-240KAPI | Excel | JSON | Language Models | Large Language Models401k option | Accidental insurance | Annual company offsites | Commuter benefits | Daily catered lunchesSenior-level Full TimeSan Francisco or New York City R17h ago
-
Applied Research Scientist, AI Research USD 261K-299KAudio Compression | Audio Synthesis | Computer Vision | Deep learning | Generative Modeling401k matching | Catered lunches | Flexible vacation | Health insurance | Hybrid work optionsSenior-level Full TimeSan Francisco; Hybrid or Remote R17h ago
-
AI/ML Solutions Engineer USD 139K-200KAI Explainability | AWS Glue | AWS SageMaker | AWS Step Functions | Amazon AthenaMid-level Full TimeMiami Lakes, FL, United States19h ago
-
Principal Machine Learning Engineer USD 240K-420KAgent systems | Architecture | C plus plus | Compliance | Deep learning401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R20h ago
-
Agent architecture | Benchmarking | Biomedicine | Context engineering | Data integrationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R21h ago
-
Senior Manager, AI Engineering & Platform USD 118K-145KAI-assisted software development | API Integration | AWS | Authentication | Backup and Recovery401k | Continuous professional development | Entrepreneurial culture | Health, dental, and vision | Minimal travelSenior-level Full TimeOverland Park, KS R22h ago
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R23h ago
-
Senior Data Engineer- People Analytics USD 180K-207KAccess Control | Airflow | Amazon Redshift | CI/CD | Cloud platformSenior-level Full TimeUnited States R23h ago
-
Artificial Intelligence | Big Data | Cloud Computing | Machine Learning | Model Based Systems EngineeringTS/SCI clearanceSenior-level Full TimeChantilly, Virginia, United States; Springfield, Virginia, …1d ago
-
Staff Software Engineer, Applied AI USD 200K-260KDataset curation | FastAPI | Golden datasets | Langchain | Langgraph401k retirement plan | Annual learning and development stipend | Employer HSA contribution | Equity incentive plan | Flexible vacation policySenior-level Full TimeU.S. Remote R1d ago
-
Semantic AI Engineer USD 158K-202KAPI | CI/CD | Data integration | Entity Resolution | FAIR-Data401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimeNorth Chicago, IL, United States1d ago
-
Software Engineer II, Big Data, tvScientific USD 123K-254KAPIs | AWS | Access Controls | Apache Iceberg | Apache SparkFlexible work modelMid-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Mid-level Full Time10 Park Plaza, Boston1d ago
-
Principal Engineer, AI Architect USD 190K-210KCloud Architecture | Cloud Native | Conversational AI | Data analytics | Enterprise Architecture401k retirement plan | Development resources | Employee assistance program | Employee stock purchase program | Flexible paid time offSenior-level Full TimeNew York, New York R1d ago
-
Principal Engineer, AI Architect USD 190K-210KCloud Architecture | Conversational AI | Data analytics | Enterprise SaaS | GCP401k retirement plan | Employee assistance program | Employee stock purchase program | Flexible paid time off | Fully remoteSenior-level Full TimeNew York, New York R1d ago
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R1d ago
-
AI Engineer Co-Op USD 60K-68KAI output evaluation | Agentic Frameworks | Azure OpenAI | Data Engineering | Fine Tuning401k | Disability insurance | Family support services | Health insurance | Life insuranceMid-level Full TimeBoston, MA1d ago
-
AWS | Bitbucket | Confluence | Data Analysis | Eclipse401k employer contribution | Direct contribution to 401k vesting | Educational assistance | Federal Holidays | Healthcare benefitsSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …1d ago
-
Software Engineer 1 - (Python, UI/UX, LLM) USD 169K-207KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Healthcare coverage | PTOMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 241K-295KAI Agents | APIs | Backend Development | Data Pipelines | Docker401k matching | Education assistance | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland1d ago
-
Cloud Software Engineer 3 - (Cloud, Hadoop, Java) USD 228K-278KAnsible | Apache Kafka | Apache Lucene | Apache Solr | Avro401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeFort Meade, Maryland R1d ago
-
Part Time Student - Robotics Engineer - Ames, IA USD 30K-80KArduino | C plus plus | Computer Vision | Data Analysis | JavaAdoption Assistance | Employee assistance programs | Fitness subsidies | Flexible work arrangements | Healthcare benefitsEntry-level Part TimeAmes, IA,Iowa,United States1d ago
-
AI Engineer USD 80K-100KAI | API Development | Cloud infrastructure | Database Design | GitHub401k retirement plan | Employee assistance program | Health Spending Account HSA | Life insurance | Long-term disabilityMid-level ContractOmaha, Nebraska, USA R1d ago