Limits are set per project and per API key during the closed beta, so they can differ between projects. Contact support if you need higher limits.
Rate limits
Each API key can make a limited number of requests per minute, counted in fixed one-minute windows. Every response includes the current state:
When you exceed the limit, the API returns
429 with RATE_LIMITED and a Retry-After header with the number of seconds to wait:
Retry-After before sending more requests. To stay under the limit, ask several questions about the same text in one request instead of one request per question.
Quotas
A project can have monthly limits on:- decisions: each question in a successful request counts as one decision,
- input tokens: the sum of
usage.input_tokensof successful requests.
429 with QUOTA_EXCEEDED until the next calendar month (UTC). Retrying doesn’t help.
Quotas are checked before each request, so concurrent requests can go slightly over a quota.