Class AzureCosmosDBMongoDBSemanticCache

Represents a Semantic Cache that uses CosmosDB MongoDB backend as the underlying storage system.

Example

const embeddings = new OpenAIEmbeddings();
const cache = new AzureCosmosDBMongoDBSemanticCache(embeddings, {
  client?: MongoClient
});
const model = new ChatOpenAI({cache});

// Invoke the model to perform an action
const response = await model.invoke("Do something random!");
console.log(response);
Copy