SHVYDKO / API
Limits and context
Three different limits: JSON size, model tokens, and organization request rate.
Current configuration
Loading service configuration…
Settings for this deployment. This panel does not run the model or verify that it is working.
Check the current configuration
The current configuration panel reads its settings from GET /api/config. They may change between deployments. More keys do not increase an organization's quota.
Body size is measured in UTF-8 bytes, while model context is measured in tokens. Text in any language, JSON syntax, and criteria descriptions take up space. Character count is not an exact token count.
| Limit | What it limits |
|---|---|
| max_request_bytes | The full JSON request in bytes |
| max_questions | The number of questions in one request |
| requests_per_minute | The organization's shared API and Playground request rate |
| preview_request_limit | The organization's daily preview request count |
| preview_global_request_limit | Daily preview capacity across the entire service |
| reserve_tokens / max_input_tokens | The gateway's upper bound for usage accounting and financial reservations; this is not the model's context size |
The model service defines the context
Read the current state and question-branch limits in GET /v1/models → models[].context. The max_input_tokens value from /api/config does not mean a state of that size will fit the model.
A large request can pass the byte-size check and still be rejected for exceeding model context. Select relevant excerpts, remove repetition, and split independent documents into separate requests. Evaluate long-context quality separately.
Preview and quota resets
Preview has separate daily limits for each organization and the entire service; they reset at 00:00 UTC. Requests accepted for processing that later fail also consume daily quota. HTTP errors before a request is accepted do not create an inference record.
An organization shares one per-minute quota across API and Playground. For parallel processing, limit concurrent requests in your application.