Interface CreateEvalCompletionsRunDataSource

A CompletionsRunDataSource object describing a model sampling configuration.

interface CreateEvalCompletionsRunDataSource {
    input_messages?: OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.Template | OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.ItemReference;
    model?: string;
    sampling_params?: OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.SamplingParams;
    source: OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.FileContent | OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.FileID | OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.StoredCompletions;
    type: "completions";
}

Properties

input_messages? model? sampling_params? source type

Properties

Optionalinput_messages

input_messages?: OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.Template | OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.ItemReference

Used when sampling from a model. Dictates the structure of the messages passed into the model. Can either be a reference to a prebuilt trajectory (ie, item.input_trajectory), or a template with variable references to the item namespace.

Optionalmodel

model?: string

The name of the model to use for generating completions (e.g. "o3-mini").

Optionalsampling_params

sampling_params?: OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.SamplingParams

source

source: OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.FileContent | OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.FileID | OpenAIClient.Evals.Runs.CreateEvalCompletionsRunDataSource.StoredCompletions

Determines what populates the item namespace in this run's data source.

type

type: "completions"

The type of run data source. Always completions.

Settings

Member Visibility

On This Page

Properties