Interface SamplingParams

interface SamplingParams {
    max_completion_tokens?: number;
    seed?: number;
    temperature?: number;
    top_p?: number;
}

Properties

max_completion_tokens?: number

The maximum number of tokens in the generated output.

seed?: number

A seed value to initialize the randomness, during sampling.

temperature?: number

A higher temperature increases randomness in the outputs.

top_p?: number

An alternative to temperature for nucleus sampling; 1.0 includes all tokens.