On this page_BasicCrawlerOptionsGeneric Generic options the BasicCrawler constructor.Hierarchy_BasicCrawlerOptionsGenericBasicCrawlerOptionsIndex Propertiesrequest_handlerstatisticsProperties request_handlerrequest_handler: NotRequired[Callable[[TCrawlingContext], Awaitable[None]]]A callable responsible for handling requests.statisticsstatistics: NotRequired[Statistics[TStatisticsState]]A custom Statistics instance, allowing the use of non-default configuration.
Generic options the
BasicCrawler
constructor.