Skip to main content

ParselCrawler

crawlee.parsel_crawler._parsel_crawler.ParselCrawler

A crawler that fetches the request URL using httpx and parses the result with Parsel.

Index

Constructors

Constructors

__init__

  • __init__(*, additional_http_error_status_codes, ignore_http_error_status_codes, kwargs): None

  • Initialize the ParselCrawler.

    Parameters

    • additional_http_error_status_codes: Iterable[int] = ()keyword-only
    • ignore_http_error_status_codes: Iterable[int] = ()keyword-only
    • kwargs: Unpack[BasicCrawlerOptions[ParselCrawlingContext]]

    Returns None