Prompt Engineer (LLM Systems, Evals & Safety)

Tasks

• Build evaluation harnesses
• Create prompt libraries with A B testing
• Design prompts and system instructions
• Handle PII and enforce content policy checks
• Implement jailbreak and prompt injection safety tests
• Integrate prompts into production features
• Maintain prompt versioning and improvements
• Reduce hallucinations with verification and tool use

Perks/Benefits

• N/A

Skills/Tech-stack

A/B | A/B Testing | B testing | Constrained decoding | Feature Flags | Function Calling | LLM Evaluation | Langchain | Prompt engineering | Python | Red Teaming | Reranking | Retrieval-Augmented Generation | Telemetry | Tool use | TypeScript | Vector Databases