Rate Limit
Definition
API request throttles restricting requests per minute (RPM) or tokens per minute (TPM) to prevent overload.
Example Case
OpenAI returning 429 Too Many Requests after exceeding 80,000 TPM.
API request throttles restricting requests per minute (RPM) or tokens per minute (TPM) to prevent overload.