HTTP crawlers
Learn about Crawlee's HTTP crawlers including BeautifulSoup, Parsel, and raw HTTP crawlers for efficient server-rendered content extraction without JavaScript execution.
Playwright crawler
Learn how to use PlaywrightCrawler for browser-based web scraping.
Adaptive Playwright crawler
Learn how to use the Adaptive Playwright crawler to automatically switch between browser-based and HTTP-only crawling.
Pydantic AI crawler
Learn how to use PydanticAiCrawler to extract structured data from HTML pages with an LLM.
Stagehand crawler
Learn how to use StagehandCrawler for AI-powered browser automation and data extraction.