Interface Usage

Token usage details for the sample.

interface Usage {
    cached_tokens: number;
    completion_tokens: number;
    prompt_tokens: number;
    total_tokens: number;
}

Properties

cached_tokens: number

The number of tokens retrieved from cache.

completion_tokens: number

The number of completion tokens generated.

prompt_tokens: number

The number of prompt tokens used.

total_tokens: number

The total number of tokens used.