Optional
decodingMethod
decodingMethod?: string
Optional
includeStopSequence
includeStopSequence?: boolean
Optional
lengthPenalty
lengthPenalty?: TextGenLengthPenalty
Optional
maxNewTokens
maxNewTokens?: number
Optional
minNewTokens
minNewTokens?: number
Optional
randomSeed
randomSeed?: number
Optional
repetitionPenalty
repetitionPenalty?: number
Optional
returnOptions
returnOptions?: ReturnOptionProperties
Optional
stopSequence
stopSequence?: string[]
Optional
temperature
temperature?: number
Optional
timeLimit
timeLimit?: number
Optional
topK
topK?: number
Optional
topP
topP?: number
Optional
truncateInpuTokens
truncateInpuTokens?: number
Input to LLM class.