Skip to main content

PlaywrightCrawlingContext

The crawling context used by the PlaywrightCrawler.

It provides access to key objects as well as utility functions for handling crawling tasks.

Hierarchy

Index

Properties

add_requests

add_requests: AddRequestsFunction

enqueue_links

enqueue_links: EnqueueLinksFunction

The Playwright EnqueueLinksFunction implementation.

get_key_value_store

infinite_scroll

infinite_scroll: Callable[[], Awaitable[None]]

A function to perform infinite scrolling on the page. This scrolls to the bottom, triggering the loading of additional content if present.

log

log: logging.Logger

page

page: Page

The Playwright Page object for the current page.

proxy_info

proxy_info: ProxyInfo | None

push_data

push_data: PushDataFunction

request

request: Request

response

response: Response

The Playwright Response object containing the response details for the current URL.

send_request

send_request: SendRequestFunction

session

session: Session | None