Optional
allowAllow crawling external domains.
Optional
categories?: undefined | CrawlCategory[]Only crawl URLs containing these categories.
Optional
excludeExclude these domains.
Optional
excludeExclude these paths.
Optional
instructions?: undefined | stringNatural language instructions to guide the crawler
Optional
limit?: undefined | numberThe maximum number of pages to crawl.
Optional
maxThe maximum number of pages to crawl per level.
Optional
maxThe maximum number of hops from the starting URL.
Optional
selectOnly crawl these domains.
Optional
selectOnly crawl URLs containing these paths.
The URL to start mapping from.
Example: "https://example.com"
The parameters for the Tavily Map API.