Class AzureCosmosDBNoSQLSemanticCache

Represents a Semantic Cache that uses CosmosDB NoSQL backend as the underlying storage system.

Example

const embeddings = new OpenAIEmbeddings();
const cache = new AzureCosmosDBNoSQLSemanticCache(embeddings, {
  databaseName: DATABASE_NAME,
  containerName: CONTAINER_NAME
});
const model = new ChatOpenAI({cache});

// Invoke the model to perform an action
const response = await model.invoke("Do something random!");
console.log(response);
Copy