A detailed breakdown of the input tokens.

interface InputTokensDetails {
    cached_tokens: number;
}

Properties

Properties

cached_tokens: number

The number of tokens that were retrieved from the cache. More on prompt caching.