Configuration related to the model.

interface LDModelConfig {
    maxTokens?: number;
    modelId?: string;
    temperature?: number;
    [index: string]: unknown;
}

Indexable

  • [index: string]: unknown

    And additional model specific information.

Properties

maxTokens?: number

The maximum number of tokens.

modelId?: string

The ID of the model.

temperature?: number

Tuning parameter for randomness versus determinism. Exact effect will be determined by the model.