Abstract
Optional
streaming: booleanOptional
apiThe version of the API functions. Part of the path.
Model to use
Model to use
Alias for model
What platform to run the service on. If not specified, the class should determine this from other means. Either way, the platform actually used will be in the "platform" getter.
Whether or not to stream.
Hostname for the API call (if this is running on GCP)
Region where the LLM is stored (if this is running on GCP)
Optional
runManager: BaseRunManager
Parameters needed to setup the client connection. AuthOptions are something like GoogleAuthOptions (from google-auth-library) or WebGoogleAuthOptions.