Skip to main content

AddRequestsKwargs

crawlee.basic_crawler.types.AddRequestsKwargs

Keyword arguments for crawler's add_requests method.

Index

Properties

base_url

base_url: NotRequired[str]

exclude

exclude: NotRequired[list[re.Pattern | Glob]]

include

include: NotRequired[list[re.Pattern | Glob]]

limit

limit: NotRequired[int]

strategy

strategy: NotRequired[EnqueueStrategy]