BasicCrawlingContext

Basic crawling context intended to be extended by crawlers.

Hierarchy

• BasicCrawlingContext
  • HttpCrawlingContext
  • PlaywrightPreNavigationContext
  • ParselCrawlingContext
  • BeautifulSoupCrawlingContext

Index

Properties

• add_requests
• get_key_value_store
• log
• proxy_info
• push_data
• request
• send_request
• session

Properties

add_requests

add_requests: AddRequestsFunction

get_key_value_store

get_key_value_store: GetKeyValueStoreFromRequestHandlerFunction

log

log: logging.Logger

proxy_info

proxy_info: ProxyInfo | None

push_data

push_data: PushDataFunction

request

request: Request

send_request

send_request: SendRequestFunction

session

session: Session | None