Class RecursiveUrlLoader

Interface that defines the methods for loading and splitting documents.

Hierarchy (view full)

BaseDocumentLoader
- RecursiveUrlLoader

Implements

DocumentLoader

Index

Constructors

Methods

load loadAndSplit

Constructors

constructor

new RecursiveUrlLoader(url, options): RecursiveUrlLoader
Parameters
- url: string
- options: RecursiveUrlLoaderOptions
Returns RecursiveUrlLoader
Overrides BaseDocumentLoader.constructor
- Defined in libs/langchain-community/src/document_loaders/web/recursive_url.ts:36

Methods

load

load(): Promise<Document<Record<string, any>>[]>
Loads the documents.

Returns Promise<Document<Record<string, any>>[]>
A Promise that resolves with an array of Document instances.
Implementation of DocumentLoader.load
Overrides BaseDocumentLoader.load
- Defined in libs/langchain-community/src/document_loaders/web/recursive_url.ts:204

loadAndSplit

loadAndSplit(splitter?): Promise<Document<Record<string, any>>[]>
Parameters
- Optionalsplitter: BaseDocumentTransformer<DocumentInterface<Record<string, any>>[], DocumentInterface<Record<string, any>>[]>
Returns Promise<Document<Record<string, any>>[]>
A Promise that resolves with an array of Document instances, each split according to the provided TextSplitter.

Deprecated
Use this.load() and splitter.splitDocuments() individually. Loads the documents and splits them using a specified text splitter.
Implementation of DocumentLoader.loadAndSplit
Inherited from BaseDocumentLoader.loadAndSplit
- Defined in langchain-core/dist/document_loaders/base.d.ts:27