Skip to main content

CrawleeRequestData

Crawlee-specific configuration stored in the user_data.

Index

Properties

crawl_depth

crawl_depth: int

The depth of the request in the crawl tree.

enqueue_strategy

enqueue_strategy: str | None

The strategy used when enqueueing the request.

forefront

forefront: bool

Indicate whether the request should be enqueued at the front of the queue.

last_proxy_tier

last_proxy_tier: int | None

The last proxy tier used to process the request.

max_retries

max_retries: int | None

Maximum number of retries for this request. Allows to override the global max_request_retries option of BasicCrawler.

session_rotation_count

session_rotation_count: int | None

The number of finished session rotations for this request.

skip_navigation

skip_navigation: bool

state

state: RequestState | None

Describes the request's current lifecycle state.