Skip to main content
Version: 3.9

CrawlerAddRequestsOptions

Hierarchy

Index

Properties

Properties

optionalbatchSize

batchSize?: number = ```ts 1000 ```

optionalforefront

forefront?: boolean = ```ts false ```

If set to true:

  • while adding the request to the queue: the request will be added to the foremost position in the queue.
  • while reclaiming the request: the request will be placed to the beginning of the queue, so that it's returned in the next call to RequestQueue.fetchNextRequest. By default, it's put to the end of the queue.

optionalwaitBetweenBatchesMillis

waitBetweenBatchesMillis?: number = ```ts 1000 ```

optionalwaitForAllRequestsToBeAdded

waitForAllRequestsToBeAdded?: boolean = ```ts false ```

Whether to wait for all the provided requests to be added, instead of waiting just for the initial batch of up to batchSize.