Optional
apiOptional
cache?: undefined | boolean | BaseCache<Generation[]>Optional
callbackOptional
callbacks?: undefined | CallbacksOptional
maxThe maximum number of concurrent calls that can be made.
Defaults to Infinity
, which means no limit.
Optional
maxThe maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Optional
metadata?: undefined | Record<string, unknown>Optional
model?: undefined | stringThe name of the model to use.
Optional
onCustom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
Optional
streamWhether or not to include token usage when streaming.
This will include an extra chunk at the end of the stream
with eventType: "stream-end"
and the token usage in
usage_metadata
.
Optional
streaming?: undefined | booleanWhether or not to stream the response.
Optional
tags?: undefined | string[]Optional
temperature?: undefined | numberWhat sampling temperature to use, between 0.0 and 2.0. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic.
Optional
verbose?: undefined | boolean
The API key to use.