Interface Custom

A CustomDataSourceConfig object that defines the schema for the data source used for the evaluation runs. This schema is used to define the shape of the data that will be:

  • Used to define your testing criteria and
  • What data is required when creating a run
interface Custom {
    include_sample_schema?: boolean;
    item_schema: Record<string, unknown>;
    type: "custom";
}

Properties

include_sample_schema? item_schema type

Properties

Optionalinclude_sample_schema

include_sample_schema?: boolean

Whether the eval should expect you to populate the sample namespace (ie, by generating responses off of your data source)

item_schema

item_schema: Record<string, unknown>

The json schema for each row in the data source.

type

type: "custom"

The type of data source. Always custom.

Settings

Member Visibility

On This Page

Properties