Class VercelKVCache

A cache that uses Vercel KV as the backing store.

Example

const cache = new VercelKVCache({
  ttl: 3600, // Optional: Cache entries will expire after 1 hour
});

// Initialize the OpenAI model with Vercel KV cache for caching responses
const model = new ChatOpenAI({
  cache,
});
await model.invoke("How are you today?");
const cachedValues = await cache.lookup("How are you today?", "llmKey");
Copy