Class HTMLWebBaseLoader

Interface that defines the methods for loading and splitting documents.

Hierarchy (view full)

BaseDocumentLoader
- HTMLWebBaseLoader

Implements

WebBaseLoader

Index

Constructors

Properties

caller headers? textDecoder? timeout webPath

Methods

load loadAndSplit

Constructors

constructor

new HTMLWebBaseLoader(webPath, fields?): HTMLWebBaseLoader
Parameters
- webPath: string
- Optionalfields: WebBaseLoaderParams
Returns HTMLWebBaseLoader
Overrides BaseDocumentLoader.constructor
- Defined in libs/langchain-community/src/document_loaders/web/html.ts:60

Properties

caller

caller: AsyncCaller

`Optional`headers

headers?: HeadersInit

`Optional`textDecoder

textDecoder?: TextDecoder

timeout

timeout: number

webPath

webPath: string

Methods

load

load(): Promise<Document<Record<string, any>>[]>
Loads the documents.

Returns Promise<Document<Record<string, any>>[]>
A Promise that resolves with an array of Document instances.
Implementation of WebBaseLoader.load
Overrides BaseDocumentLoader.load
- Defined in libs/langchain-community/src/document_loaders/web/html.ts:69

loadAndSplit

loadAndSplit(splitter?): Promise<Document<Record<string, any>>[]>
Parameters
- Optionalsplitter: BaseDocumentTransformer<DocumentInterface<Record<string, any>>[], DocumentInterface<Record<string, any>>[]>
Returns Promise<Document<Record<string, any>>[]>
A Promise that resolves with an array of Document instances, each split according to the provided TextSplitter.

Deprecated
Use this.load() and splitter.splitDocuments() individually. Loads the documents and splits them using a specified text splitter.
Implementation of WebBaseLoader.loadAndSplit
Inherited from BaseDocumentLoader.loadAndSplit
- Defined in langchain-core/dist/document_loaders/base.d.ts:27