AddRequestsKwargs

Keyword arguments for the add_requests methods.

Hierarchy

• EnqueueLinksKwargs
  • AddRequestsKwargs

Index

Properties

• base_url
• exclude
• include
• limit
• requests
• strategy

Properties

keyword-onlybase_url

base_url: str

Base URL to be used for relative URLs.

keyword-onlyexclude

exclude: list[re.Pattern | Glob]

List of regular expressions or globs that URLs must not match to be enqueued.

keyword-onlyinclude

include: list[re.Pattern | Glob]

List of regular expressions or globs that URLs must match to be enqueued.

keyword-onlylimit

limit: int

Maximum number of requests to be enqueued.

requests

requests: Sequence[(str | BaseRequestData) | Request]

Requests to be added to the request provider.

keyword-onlystrategy

strategy: EnqueueStrategy

Enqueueing strategy, see the EnqueueStrategy enum for possible values and their meanings.