kernl

Interface: LanguageModelRequest

Defined in: packages/protocol/src/language-model/request.ts:15

A request to a large language model.

Properties

PropertyTypeDescriptionDefined in
abort?AbortSignalAbort signal for cancelling the operation.packages/protocol/src/language-model/request.ts:46
includeRawChunks?booleanInclude raw chunks in the stream. Only applicable for streaming calls.packages/protocol/src/language-model/request.ts:41
inputLanguageModelItem[]The input to the model.packages/protocol/src/language-model/request.ts:19
responseType?LanguageModelResponseTypeResponse format. The output can either be text or JSON. Default is text. If JSON is selected, a schema can optionally be provided to guide the LLM.packages/protocol/src/language-model/request.ts:31
settingsLanguageModelRequestSettingsThe model settings to use for the request.packages/protocol/src/language-model/request.ts:24
tools?LanguageModelTool[]The tools that are available for the model.packages/protocol/src/language-model/request.ts:36

On this page