Optional
authenticator authenticator ?: string
Optional
cache cache ?: boolean | BaseCache < Generation [] >
Optional
callback Manager callback Manager ?: CallbackManager
Optional
callbacks callbacks ?: Callbacks
Optional
concurrency concurrency ?: number
Optional
decoding Method decoding Method ?: string
Optional
id Or Name id Or Name ?: string
Optional
include Stop Sequence include Stop Sequence ?: boolean
Optional
length Penalty length Penalty ?: TextGenLengthPenalty
Optional
max Concurrency max Concurrency ?: number
Optional
max New Tokens max New Tokens ?: number
Optional
max Retries max Retries ?: number
Optional
metadata metadata ?: Record < string , unknown >
Optional
min New Tokens min New Tokens ?: number
Optional
on Failed Attempt on Failed Attempt ?: FailedAttemptHandler
Optional
project Id project Id ?: string
Optional
random Seed random Seed ?: number
Optional
repetition Penalty repetition Penalty ?: number
Optional
return Options return Options ?: ReturnOptionProperties
service Url service Url : string
Optional
space Id space Id ?: string
Optional
stop Sequence stop Sequence ?: string []
Optional
streaming streaming ?: boolean
Optional
tags tags ?: string []
Optional
temperature temperature ?: number
Optional
time Limit time Limit ?: number
Optional
topK topK ?: number
Optional
topP topP ?: number
Optional
truncate Inpu Tokens truncate Inpu Tokens ?: number
Optional
verbose verbose ?: boolean
Optional
watsonx Callbacks watsonx Callbacks ?: RequestCallbacks < any >
Deprecated
Use
callbacks
instead