OptionalallowAllow crawling external domains.
Optionalcategories?: undefined | CrawlCategory[]Only crawl URLs containing these categories.
OptionalexcludeExclude these domains.
OptionalexcludeExclude these paths.
Optionalinstructions?: undefined | stringNatural language instructions to guide the crawler
Optionallimit?: undefined | numberThe maximum number of pages to crawl.
OptionalmaxThe maximum number of pages to crawl per level.
OptionalmaxThe maximum number of hops from the starting URL.
OptionalselectOnly crawl these domains.
OptionalselectOnly crawl URLs containing these paths.
The URL to start mapping from.
Example: "https://example.com"
The parameters for the Tavily Map API.