kernl

Interface: LanguageModel

Defined in: packages/protocol/src/language-model/model.ts:11

Defines the standard interface for language model providers in kernl.

Properties

PropertyModifierTypeDescriptionDefined in
modelIdreadonlystringProvider-specific model ID.packages/protocol/src/language-model/model.ts:25
providerreadonlystringProvider ID.packages/protocol/src/language-model/model.ts:20
specreadonly"1.0"The language model must specify which language model interface version it implements.packages/protocol/src/language-model/model.ts:15

Methods

generate()

generate(request: LanguageModelRequest): Promise<LanguageModelResponse>;

Defined in: packages/protocol/src/language-model/model.ts:32

Get a response from the model.

Parameters

ParameterTypeDescription
requestLanguageModelRequestThe request to get a response for.

Returns

Promise<LanguageModelResponse>


stream()

stream(request: LanguageModelRequest): AsyncIterable<LanguageModelStreamEvent>;

Defined in: packages/protocol/src/language-model/model.ts:39

Get a streamed response from the model.

Parameters

ParameterTypeDescription
requestLanguageModelRequestThe request to get a response for.

Returns

AsyncIterable<LanguageModelStreamEvent>

On this page