A CustomDataSourceConfig object that defines the schema for the data source used for the evaluation runs. This schema is used to define the shape of the data that will be:

  • Used to define your testing criteria and
  • What data is required when creating a run
interface Custom {
    include_sample_schema?: boolean;
    item_schema: Record<string, unknown>;
    type: "custom";
}

Properties

include_sample_schema?: boolean

Whether to include the sample schema in the data source.

item_schema: Record<string, unknown>

The json schema for the run data source items.

type: "custom"

The type of data source. Always custom.