Prompt Caching

say it: “PROMPT KASH-ing” /prɒmpt ˈkæʃɪŋ/

Reusing a repeated prompt prefix to save time and cost.

What is Prompt Caching?

Prompt caching reuses the processing of a long, repeated prompt prefix (like instructions or a document), making repeat calls faster and cheaper.

Level: Freelancer · More AI Basics terms at this level

Updated