Skip to main content
A single request can ask several questions about the same context. Krun answers all of them together:
This is faster and simpler than one request per question: you make one round trip, handle one response and one request id, and all answers come from the same model job.

Example

Classify a support message by department, priority and sentiment in one call:
Response

How answers work

  • Same ids, same order. answers has one entry per question, under your question ids, in request order.
  • Independent decisions. Each question is scored on its own. One answer can abstain while the others don’t, like priority above.
  • Per-answer abstention status. Each answer has its own abstention_status. Here sentiment uses label-only options, so it is calibrated. The others have descriptions, so they are advisory.
  • Summed usage. usage.input_tokens is the sum over all questions. See Usage and tokens.
  • One request id for the whole request. Feedback names the question with question_id. See Feedback.

Limits

If any question is invalid, the whole request fails with 400 and no question is answered.

When to use separate requests

Use separate requests when the questions are about different contexts, or when the second question depends on the answer to the first, such as choosing an intent inside a category.