Prompt Caching
say it: “PROMPT KASH-ing” /prɒmpt ˈkæʃɪŋ/
Reusing a repeated prompt prefix to save time and cost.
What is Prompt Caching?
Prompt caching reuses the processing of a long, repeated prompt prefix (like instructions or a document), making repeat calls faster and cheaper.
Level: Freelancer · More AI Basics terms at this level
Updated