ParselCrawlingContext

The crawling context used by the ParselCrawler.

It provides access to key objects as well as utility functions for handling crawling tasks.

Hierarchy

• HttpCrawlingResult
• BasicCrawlingContext
  • ParselCrawlingContext

Index

Properties

• add_requests
• enqueue_links
• get_key_value_store
• http_response
• log
• proxy_info
• push_data
• request
• selector
• send_request
• session

Properties

add_requests

add_requests: AddRequestsFunction

enqueue_links

enqueue_links: EnqueueLinksFunction

The Parsel EnqueueLinksFunction implementation.

get_key_value_store

get_key_value_store: GetKeyValueStoreFromRequestHandlerFunction

http_response

http_response: HttpResponse

The HTTP response received from the server.

log

log: logging.Logger

proxy_info

proxy_info: ProxyInfo | None

push_data

push_data: PushDataFunction

request

request: Request

selector

selector: Selector

The Parsel Selector object for the current page.

send_request

send_request: SendRequestFunction

session

session: Session | None