CrawleeRequestData

crawlee._request.CrawleeRequestData

Crawlee-specific configuration stored in the user_data.

Index

Properties

• enqueue_strategy
• forefront
• last_proxy_tier
• max_retries
• session_rotation_count
• skip_navigation
• state

Properties

enqueue_strategy

enqueue_strategy: Annotated[str | None, Field(alias='enqueueStrategy')]

forefront

forefront: Annotated[bool, Field()]

last_proxy_tier

last_proxy_tier: Annotated[int | None, Field(alias='lastProxyTier')]

max_retries

max_retries: Annotated[int | None, Field(alias='maxRetries')]

Maximum number of retries for this request. Allows to override the global max_request_retries option of BasicCrawler.

session_rotation_count

session_rotation_count: Annotated[int | None, Field(alias='sessionRotationCount')]

skip_navigation

skip_navigation: Annotated[bool, Field(alias='skipNavigation')]

state

state: RequestState | None

Describes the request's current lifecycle state.