Class LlamaCppEmbeddings

Example

// Initialize LlamaCppEmbeddings with the path to the model file
const embeddings = await LlamaCppEmbeddings.initialize({
  modelPath: llamaPath,
});

// Embed a query string using the Llama embeddings
const res = embeddings.embedQuery("Hello Llama!");

// Output the resulting embeddings
console.log(res);

Hierarchy

  • Embeddings
    • LlamaCppEmbeddings

Constructors

constructor

Properties

caller

Methods

embedDocuments embedQuery initialize

Constructors

constructor

Properties

caller

caller: AsyncCaller

The async caller should be used by subclasses to make any async calls, which will thus benefit from the concurrency and retry logic.

Methods

embedDocuments

  • embedDocuments(texts): Promise<number[][]>

  • Generates embeddings for an array of texts.

    Parameters

    • texts: string[]

      An array of strings to generate embeddings for.

    Returns Promise<number[][]>

    A Promise that resolves to an array of embeddings.

embedQuery

  • embedQuery(text): Promise<number[]>

  • Generates an embedding for a single text.

    Parameters

    • text: string

      A string to generate an embedding for.

    Returns Promise<number[]>

    A Promise that resolves to an array of numbers representing the embedding.

Staticinitialize

Settings

Member Visibility

On This Page

Constructors
Properties
Methods