Abstract class that provides a default implementation for the loadAndSplit() method from the DocumentLoader interface. The load() method is left abstract and needs to be implemented by subclasses.

Hierarchy (view full)

Constructors

Methods

  • Parameters

    • Optionalsplitter: BaseDocumentTransformer<DocumentInterface<Record<string, any>>[], DocumentInterface<Record<string, any>>[]>

    Returns Promise<Document<Record<string, any>>[]>

    A Promise that resolves with an array of Document instances, each split according to the provided TextSplitter.

    Use this.load() and splitter.splitDocuments() individually. Loads the documents and splits them using a specified text splitter.

  • Asynchronous generator function for lazily loading documents from Airtable. This method yields each document individually, enabling memory-efficient handling of large datasets by fetching records in pages.

    Returns AsyncGenerator<Document<Record<string, any>>, any, unknown>

    An asynchronous generator yielding Document objects one by one.