Skip to main content

Limits and quotas

Fixed in Studio​

LimitValue
Built-in tools per agent5
Workflows as a tool per agent1
Documents in Fuentes (Sources) per agent5
Tool calls per response1 to 5 (Herramientas (Tools) preset)
Maximum response length1 024 to 12 288 tokens
Message history0 to 6 messages in presets; customizable
PasswordMinimum 8 characters
Items per page in the Agents APIMaximum 100

Per request (InferNode)​

LimitValue
Prompt plus max_tokensTogether they cannot exceed the model's context_window. The window is shared between the question and the answer, so max_tokens equal to the window always fails
Request durationAbout 300 seconds; after that it responds 504 with provider_timeout
Usable response tokensAs many as the model manages to generate in that time. With a reasoning model, about 13 800 (Measured performance)
Window and output per modelGET /v1/models/{name}: context_window and max_output_tokens

Per batch (InferNode)​

Only if the installation has batches enabled. Guide in Process requests in batches. These values are the factory defaults, and the installation can change them.

LimitDefault value
Input file size100 MiB; above that, 413 file_too_large
Line size1 MiB
Lines per file50 000
Embedding inputs per file, summed across all lines50 000
custom_id length512 characters, not empty and unique within the file
Supported endpoints/v1/chat/completions and /v1/embeddings, only one per file
Models per fileOnly one
File storage per Client10 GiB by default; above that, 400 storage_quota_exceeded on upload
Active batches at onceDepends on the plan; above that, 429 too_many_active_batches
Queued linesDepends on the plan; above that, the file fails with enqueued_request_limit_exceeded
Delivery timeNo commitment. completion_window only accepts "24h" and is stored for compatibility
File retention30 days, for the input file and the output files. Each file carries its expires_at

Depend on the Client's plan (InferNode)​

LimitWhere to see it
Requests per minute and per dayX-RateLimit-*-Requests headers; applied per organization, user and key
Tokens per minute and per dayX-RateLimit-*-Tokens
Images per minute429 with details.dimension: "ipm"
Spending caps (organization, user, key)GET /v1/billing/balance → spending_caps
CreditsX-Credits-Remaining, GET /v1/billing/usage
Available modelsGET /v1/models

Depend on the installation (Labs)​

LimitWhere to see it
Sizes and default sizeNuevo laboratorio (New lab) form; GET /workbenches/v1/plan
Maximum per resource in custom mode"Máximo:" (Maximum:) on each field; the plan's ceiling
Objects per lab (notebooks, volumes)Rejection "tantos objetos de este tipo como permite su presupuesto" (as many objects of this type as its budget allows)
Disk classesOnly the default one
Client's total GPU capacityInfrastructure dashboard

Retention​

DataRetention
Runs, messages and tracesKept when you delete the agent or workflow; period per the agreement with the Client
Platform logs14 days by default
Access and recovery linksSingle use, they expire
Idempotency key when creating agents24 hours