Interface LabelModel

A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.

interface LabelModel {
    input: (SimpleInputMessage | OpenAIClient.Evals.EvalCreateParams.LabelModel.EvalItem)[];
    labels: string[];
    model: string;
    name: string;
    passing_labels: string[];
    type: "label_model";
}

Properties

A list of chat messages forming the prompt or context. May include variable references to the item namespace, ie {{item.name}}.

labels: string[]

The labels to classify to each item in the evaluation.

model: string

The model to use for the evaluation. Must support structured outputs.

name: string

The name of the grader.

passing_labels: string[]

The labels that indicate a passing result. Must be a subset of labels.

type: "label_model"

The object type, which is always label_model.