Founding Engineer – AI/LLM
San Francisco, CA
We're looking for a Founding Engineer focused on AI/LLMs to build the intelligence layer of Pump’s platform. You’ll work closely with our Head of Engineering and founding team to design, prototype, and ship systems that understand, optimize, and automate cloud infrastructure decisions at scale.
This is a highly cross-functional role where you’ll influence product, architecture, and team direction - while staying close to the code.
Key Responsibilities
- Influence our product roadmap and AI technical strategy
- Own end-to-end development of LLM-integrated features - from concept to deployment
- Build and optimize workflows using OpenAI, Anthropic, and open-source models (e.g., Mistral, LLaMA)
- Work on Retrieval-Augmented Generation (RAG), prompt tuning, embeddings, and agent pipelines
- Ship user-facing AI features that drive real business value to our customers
- Build reliable, scalable backend services to support LLM-powered systems
- Help shape engineering culture and mentor future AI team members
What We’re Looking For
- 2–5 years of backend or full-stack engineering experience
- Hands-on experience working with LLMs (OpenAI, Claude, Cohere, etc.) and/or open-source models
- Strong Python and/or TypeScript (we use both)
- Solid grasp of cloud infra (AWS, GCP), APIs, and microservices
- Familiarity with LangChain, Pinecone, Weaviate, or similar tools in the RAG ecosystem
- Proven experience shipping AI/LLM-powered features to production
- Bonus: experience with cloud cost optimization, observability, or DevOps
- Bonus: startup experience or 0→1 product building
Benefits (for U.S.-based full-time employees)
- 100% medical coverage for you
- 401k
- Unlimited PTO
- Free Weekly Lunch & Dinner in the Office
- Yearly company-paid team retreats.
- Developmental Bonuses
Tags: Anthropic APIs Architecture AWS Claude CoHere DevOps Engineering GCP LangChain LLaMA LLMs Microservices OpenAI Open Source Pinecone Pipelines Python RAG TypeScript Weaviate
Perks/benefits: Health care Startup environment Team events Unlimited paid time off
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.