Interface LabelModel

A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.

interface LabelModel {
    input: (SimpleInputMessage | OpenAIClient.Evals.EvalCreateParams.LabelModel.InputMessage | OpenAIClient.Evals.EvalCreateParams.LabelModel.OutputMessage)[];
    labels: string[];
    model: string;
    name: string;
    passing_labels: string[];
    type: "label_model";
}

Index

Properties

input labels model name passing_labels type

Properties

input

input: (SimpleInputMessage | OpenAIClient.Evals.EvalCreateParams.LabelModel.InputMessage | OpenAIClient.Evals.EvalCreateParams.LabelModel.OutputMessage)[]

labels

labels: string[]

The labels to classify to each item in the evaluation.

model

model: string

The model to use for the evaluation. Must support structured outputs.

name

name: string

The name of the grader.

passing_labels

passing_labels: string[]

The labels that indicate a passing result. Must be a subset of labels.

type

type: "label_model"

The object type, which is always label_model.