Model Behavior Architect

New York Metro Area; San Francisco Bay Area

Apply now Apply later

Perplexity is looking for a Model Behavior Architect to help shape systems that reliably answer users' questions.

Responsibilities

  • Design, refine, and implement prompt engineering strategies to guide model behavior across research and general knowledge use cases
  • Identify edge cases and behavioral inconsistencies in model outputs through structured testing and prompt iteration
  • Develop automated and semi-automated pipelines for evaluating prompt effectiveness at scale
  • Work cross-functionally with researchers, PMs, and engineers to align model behavior with product goals
  • Collect and synthesize qualitative and quantitative feedback to inform prompt design improvements
  • Collaborate on prompt libraries and reusable frameworks for internal and production-facing systems
  • Stay current with the latest prompt engineering, alignment, and evaluation techniques from both industry and academia

Qualifications

  • Demonstrated passion for AI and can share specific prompt engineering and chaining projects you're proud of
  • Background in data science, philosophy, psychology, linguistics, data science, or related fields
  • Familiar with Python and running simple scripts
  • High-level understanding of LLMs, training, RL
  • Excellent communication skills, particularly in teaching complex concepts
  • Creative problem-solving abilities with a "hacker spirit" for solving puzzles

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  1  0  0
Category: Architecture Jobs

Tags: Databricks Engineering Linguistics LLMs Pipelines Prompt engineering Python Research Teaching Testing

Perks/benefits: Equity / stock options Health care

Region: North America
Country: United States

More jobs like this