Interface EvalStoredCompletionsDataSourceConfig

A StoredCompletionsDataSourceConfig which specifies the metadata property of your stored completions query. This is usually metadata like usecase=chatbot or prompt-version=v2, etc. The schema returned by this data source config is used to defined what variables are available in your evals. item and sample are both defined when using this data source config.

interface EvalStoredCompletionsDataSourceConfig {
    metadata?: null | Metadata;
    schema: Record<string, unknown>;
    type: "stored_completions";
}

Properties

metadata? schema type

Properties

Optionalmetadata

metadata?: null | Metadata

Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard.

Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.

schema

schema: Record<string, unknown>

The json schema for the run data source items. Learn how to build JSON schemas here.

type

type: "stored_completions"

The type of data source. Always stored_completions.

Settings

Member Visibility

On This Page

Properties