Founding Engineer – AI/LLM

San Francisco, CA

Apply now Apply later

About the Role

We're looking for a Founding Engineer focused on AI/LLMs to build the intelligence layer of Pump’s platform. You’ll work closely with our Head of Engineering and founding team to design, prototype, and ship systems that understand, optimize, and automate cloud infrastructure decisions at scale.

This is a highly cross-functional role where you’ll influence product, architecture, and team direction - while staying close to the code.

Key Responsibilities

  • Influence our product roadmap and AI technical strategy
  • Own end-to-end development of LLM-integrated features - from concept to deployment
  • Build and optimize workflows using OpenAI, Anthropic, and open-source models (e.g., Mistral, LLaMA)
  • Work on Retrieval-Augmented Generation (RAG), prompt tuning, embeddings, and agent pipelines
  • Ship user-facing AI features that drive real business value to our customers
  • Build reliable, scalable backend services to support LLM-powered systems
  • Help shape engineering culture and mentor future AI team members

What We’re Looking For

  • 2–5 years of backend or full-stack engineering experience
  • Hands-on experience working with LLMs (OpenAI, Claude, Cohere, etc.) and/or open-source models
  • Strong Python and/or TypeScript (we use both)
  • Solid grasp of cloud infra (AWS, GCP), APIs, and microservices
  • Familiarity with LangChain, Pinecone, Weaviate, or similar tools in the RAG ecosystem
  • Proven experience shipping AI/LLM-powered features to production
  • Bonus: experience with cloud cost optimization, observability, or DevOps
  • Bonus: startup experience or 0→1 product building

Benefits (for U.S.-based full-time employees)

  • 100% medical coverage for you
  • 401k 
  • Unlimited PTO
  • Free Weekly Lunch & Dinner in the Office
  • Yearly company-paid team retreats.
  • Developmental Bonuses
Compensation$110,000—$180,000 USD
Apply now Apply later
Job stats:  3  0  0

Tags: Anthropic APIs Architecture AWS Claude CoHere DevOps Engineering GCP LangChain LLaMA LLMs Microservices OpenAI Open Source Pinecone Pipelines Python RAG TypeScript Weaviate

Perks/benefits: Health care Startup environment Team events Unlimited paid time off

Region: North America
Country: United States

More jobs like this