Architecture overview
An overview of the core components of the Crawlee library and its architecture.
Requests
How Crawlee represents a single request, how it carries data between handlers, how it's deduplicated, retried, and tracked through its lifecycle.
Crawling context
What a request handler receives, how each crawler extends the basic crawling context, and how the context helpers store results.
Request router
Learn how to use the Router class to organize request handlers, middleware, error handlers, and pre-navigation hooks in Crawlee.
Error handling
How to handle errors that occur during web crawling.