Rate Limits and Token Costs
say it: “RAYT LIM-its and TOH-kun KAWSTS” /reɪt ˈlɪmɪts ænd ˈtoʊkən ˈkɔsts/
AI APIs charge per token and cap usage per minute.
What is Rate Limits and Token Costs?
AI APIs charge by input and output tokens and enforce rate limits (requests or tokens per minute), which shape app design and budgets.
Level: Journeyman · More AI Basics terms at this level
Updated