Type Alias InputTokenDetails

InputTokenDetails: {
    audio?: number;
    cache_creation?: number;
    cache_read?: number;
}

Breakdown of input token counts.

Does not need to sum to full input token count. Does not need to have all keys.

Optionalaudio?: number
Audio input tokens.
Optionalcache_creation?: number
Input tokens that were cached and there was a cache miss.

Since there was a cache miss, the cache was created from these tokens.
Optionalcache_read?: number
Input tokens that were cached and there was a cache hit.

Since there was a cache hit, the tokens were read from the cache. More precisely, the model state given these tokens was read from the cache.