Skip to main content

AddRequestsFunction

crawlee.basic_crawler.types.AddRequestsFunction

Type of a function for adding URLs to the request queue with optional filtering.

This helper method simplifies the process of adding requests to the request provider. It opens the specified request provider and adds the requests to it.

Index

Methods

Methods

__call__

  • __call__(requests, kwargs): Coroutine[None, None, None]
  • Parameters

    • requests: Sequence[str | BaseRequestData | Request]
    • kwargs: Unpack[AddRequestsKwargs]

    Returns Coroutine[None, None, None]