📄️ HTTP clients
Crawlee supports multiple HTTP clients when making requests.
📄️ Proxy management
Using proxies to get around those annoying IP-blocks
📄️ Request storage
How to store the requests your crawler will go through
📄️ Result storage
How to store and retrieve the scraping results in Crawlee.
📄️ Scaling crawlers
Learn how to scale your crawlers by controlling concurrency and limiting requests per minute.